Data Engineer – Berlin – Spark/Python
Location: Berlin, Hybrid
Availability: 40 hours per week
About the Role
Our client is seeking an experienced Data Engineer to design, build, and maintain reliable data pipelines that support reporting, analytics, and business decision-making across their tools and platforms. This position blends hands-on data engineering with close collaboration with stakeholders, with a strong emphasis on SQL, data modelling, and data accuracy.
Key Responsibilities
* Design, build, and optimise scalable batch data pipelines for product and analytics use cases
* Develop efficient Spark SQL transformations on large-scale datasets
* Use Python for data processing, workflow orchestration, and automation
* Design and maintain robust data models (facts, dimensions, aggregates) with clearly defined grain and metrics
* Take ownership of data quality and accuracy, including:
o Ensuring metric consistency and reliability
o Managing edge cases such as late-arriving data, duplicates, and adjustments
o Reconciling outputs with source systems and downstream requirements
* Implement data validation, quality checks, and reconciliation processes
* Collaborate with business stakeholders to gather requirements, define metrics, and deliver trusted data assets
* Partner with platform and infrastructure teams on pipeline standards, performance optimisation, and best practices
Required Experience & Skills
* 5+ years’ experience in data engineering or a related field
* Strong Spark SQL expertise for large-scale data transformation
* Practical Python experience for data processing and pipeline development
* Solid understanding of dimensional data modeling concepts (facts, dimensions, grain, slowly changing dimensions, etc.)
* Proven experience building and maintaining batch data pipelines in production environments
* Strong focus on data quality, accuracy, and metric integrity for analytics and reporting
* Ability to communicate effectively with non-technical stakeholders and translate business requirements into data solutions
* Excellent problem-solving skills and attention to detail
If this is of interest, please forward your CV to taylor.lewis@darwinrecruitment.com
Darwin Recruitment is acting as an Employment Business in relation to this vacancy.
