View job here

Data Engineer – Data Lakehouse

The "Data Engineer – Data Lakehouse" is responsible for the implementation of the appropriate data architecture of the Data Lakehouse for different analytical use cases and to prepare and deliver data for requesters for business intelligence, data exploration and advanced analytics.

 

Main responsibilities and activities:

·    Conception and implementation of data integration and transformation processes to support data driven applications, BI and data science projects.

·       Development of analysis-optimized data architectures based on data lakehouses and file-based storage systems (object stores).

·       Ensuring the scalability and parallelizability of data management processes.

·       Establishment of an efficient operation of the data lakehouse

·       Preparation and provision of data for: Data Analysts, Business Engineers, Data Scientist.

 

Challenges within the scope of the activity:

·       Ensuring seamless integration and consistency of data from diverse sources within the data lakehouse environment.

·       Adhering to data management guidelines, standards, and processes specific to data lakehouses.

·       Staying current with and implementing the latest technologies in the rapidly evolving data lakehouse and analytics landscape.

·       Providing and maintaining scalable, secure, and efficient data lakehouse infrastructure on cloud platforms.

  ·     Coordinating and communicating effectively to implement architectural principles and governance measures within data lakehouse projects.

 

Expertise and skills:

-Several years of professional experience in the development of backend or data management systems, ideally within upscaling, massively parallel environments.

-Very good knowledge of SQL and Python as well as basics of cloud infrastructure.

-Good knowledge of the implementation and application of integration and transformation processes, concepts and technologies.

-Experience with cloud platforms highly desirable.

-Willingness to work in an international team.

-Good coordination and communication skills.

-Successfully completed Bacherlor‘s degree in Information Technology or comparable. 

-3-5 years of professional experience as "Data Engineer".

-Structured thinking and very good analytical skills.