Senior Data Engineer
Posted
Description
Senior Data Engineer
Goal: Independent conception, implementation and operation of data processing pipelines for the provision and preparation of mass data. Ensuring data quality and data availability.
Services & responsibilities:
§ Monitoring and ensuring data quality, data availability and processing performance
§ Provision of interfaces for data exchange
§ Conception, implementation and testing of scalable data processing architectures
§ Conception, implementation and testing of ETL processes in coordination with data scientists and business analysts
§ Close coordination with front-end, back-end engineers, product managers and analysts
§ Application and provision of machine learning and statistical methods for evaluating and predicting patterns in the data
§ Continuous coordination and proactive communication with data protection functions
§ Evaluation and analysis of data sets of various complexity and the development and optimization of the data processing infrastructure based on them
§ Development of solution options in order to get from the actual to the target state as well as evaluation and presentation of the solution options
Experience:
§ Several years of experience in the development of cloud-based applications
§ Several years of experience as a software developer or comparable position
§ Several years of experience in the area of agile software development