data engineer in data platforms

Описание:

Sytac provides data platforms for some of the Netherlands' largest companies, including KLM, ABN AMRO, ING, Rabobank, Bol, and Ahold. The company operates in software development, data infrastructure and analytics, and IT consulting.

Задачи:

• Build maintainable, modular, tested, and versioned ETL/ELT pipelines in Python, PySpark, and SQL
• Design Lakehouse environments using Medallion architecture and dimensional/Star Schema modelling on Azure and GCP
• Own infrastructure as code with Terraform or Bicep and containerized deployments on Docker and Kubernetes
• Orchestrate data workflows with Apache Airflow
• Run CI/CD for data pipelines using Azure DevOps and GitHub Actions
• Use AI tools in the development workflow and integrate LLMs into pipelines where appropriate
• Translate business logic into clear technical specifications
• Set the quality bar through code quality
• Maintain accurate data lineage and governance.

Требования:

• 6+ Years of experience building production software
• HBO/WO level of thinking
• Expert Python and SQL across PostgreSQL, MSSQL, and Oracle
• Deep Apache Spark/PySpark experience for distributed processing
• Experience with pandas or polars
• Experience with Azure Databricks, Data Factory, and Synapse, and/or GCP BigQuery and Dataflow
• Experience with Lakehouse/Data Lake environments and Star/dimensional modelling
• Experience with Apache Airflow orchestration
• Experience with Git, Azure DevOps Pipelines, and CI/CD for data pipelines
• Daily experience with Docker and Kubernetes
• Experience with Kafka and Elasticsearch
• Experience with data quality, lineage, and governance
• Experience with AI-assisted development
• Strong stakeholder management and ability to translate business needs into technical solutions
• Strong English
• NL residency required; expats must already be living and working in the Netherlands; Nice to have: Scala, Java, Kotlin, Dutch, dbt, FastAPI, Terraform/Bicep, Medallion, Delta, Iceberg, Hudi, GitHub Actions, Helm, ArgoCD, Kafka, Debezium, Azure Event Hub/Service Bus, GCP Pub/Sub, Snowflake, AWS Glue/Athena, OpenAI/Azure OpenAI, LLM integration in pipelines, MDM, reference data.

Условия:

• Unlimited Growth Days for professional development and Sytac activities
• Private laptop under €4,000 with 50% paid by the company
• Technology budget
• €2,400 Annual growth budget for training and conferences
• Company contribution of 3.75% to the pension
• Annual ski trips, beach BBQs, and parties
• No relocation support is offered.