About the tech stack:
Azure Fabric, Azure Databricks, PySpark, Apache Spark, Python, SQL, Azure Data Platform, DBT, Snowflake, Docker, Kubernetes.
About your tasks:
- Design and build scalable data pipelines that power high-impact data products across multiple business domains.
- Drive cloud data migration initiatives, helping modernize existing platforms and supporting the transition to Azure-based solutions.
- Transform and optimize large-scale datasets to enable reliable reporting, analytics, and business decision-making across the organization.
- Collaborate closely with Data Analysts, ML Engineers, DevOps Engineers, Backend Developers, Product Managers, and business stakeholders to deliver robust end-to-end data solutions.
- Contribute to engineering best practices by promoting clean, maintainable code, automation, and continuous improvements across the data platform.
About you:
- You bring 5+ years of experience in Data Engineering, with expertise in Data Platforms, Data Modeling, and building production-grade data pipelines. You have strong Python and SQL skills and know how to translate business requirements into scalable technical solutions.
- You have experience designing and supporting distributed data processing systems such as Apache Spark, Flink, or Beam, and are comfortable working with large-scale datasets, data lakes, data warehouses, and ETL/ELT architectures across Azure, AWS, or GCP.
- You have a solid understanding of scalable system design, data engineering best practices, and modern Lakehouse technologies such as Apache Delta, Iceberg, and Hudi.
- Experience with Snowflake, DBT, Docker, Kubernetes, workflow orchestration tools such as Dagster, Airflow, or NiFi, and CI/CD pipelines is highly valued.
- You have worked with both relational databases (PostgreSQL, SQL Server, Oracle) and NoSQL databases such as HBase or Cassandra, and understand DevOps principles and automated deployment practices.
- You combine strong problem-solving skills, ownership, and a consultative mindset with the ability to work independently and confidently in complex, fast-paced environments.
About your Benefits:
In order to provide our employees with the best possible support for their individual needs, we offer a wide range of benefits:
- Work from Home: If your job does not require you to be present in the office, we can arrange the place you work from individually - even for up to 20 days a year anywhere in the EU.
- Redcare events: We promote teambuilding through creative team events, and celebrate our successes together at regularly scheduled parties.
- Kindergarten Grant: We offer our employees who pay for childcare in kindergarten 100,00 € (total) per month.
- Mental health: Get quick professional help from psychologists from nilo if you feel overwhelmed in your personal or professional life. Anonymously and free of charge.
- Personal Development: We are all constantly learning. That's why we support and foster your career development through internal & external training and help you grow.
- Mobility: Your commute matters to us. We provide our employees with a fully costed Deutschland Ticket which can be used at any time.
- Sports & Health: Your well-being is our top priority. Therefore, we offer you a range of opportunities to improve your health. Profit from a membership (M) package at Urban Sports Club, providing a variety of sports offers tailored to your interests.
While this is a remote position based in Germany, it may require occasional on-site collaboration at our offices in Berlin or Cologne, depending on business and team requirements.