Databricks Data Engineer

Location: North Dublin, Ireland (Hybrid)

Contract: B2B, 12 months

TechShack is partnering with a leading organisation in North Dublin to find an experienced Databricks Data Engineer for a 12-month B2B contract. You’ll join a growing data team to design, build and optimise modern data platforms on Databricks, delivering reliable, scalable pipelines that drive key business decisions.

What you’ll be doing

• Designing, building and maintaining scalable data pipelines on Databricks
• Developing ETL/ELT processes with PySpark, Spark SQL and Delta Lake
• Putting Lakehouse architecture and Medallion (Bronze, Silver, Gold) design patterns in place
• Working with stakeholders to turn business needs into strong data solutions
• Tuning Spark jobs and Databricks clusters for performance and cost
• Setting up data quality, governance and security best practice, including Unity Catalog
• Building CI/CD pipelines and following engineering best practice across the data platform
• Supporting migration of legacy data workloads to Databricks

What we’re looking for

• Strong commercial experience as a Data Engineer with hands‑on Databricks delivery
• Advanced skills in Python/PySpark and SQL
• Solid experience with Delta Lake, Spark and Lakehouse architecture
• Experience with at least one major cloud platform (Azure, AWS or GCP)
• Knowledge of Unity Catalog, Databricks Workflows and Delta Live Tables
• Experience with CI/CD, Git and infrastructure as code (e.g. Terraform)
• Strong communication skills and confidence working directly with stakeholders
• Able to work onsite in North Dublin 3-4 days per week

Nice to have

• Databricks certifications (Data Engineer Professional)
• Experience with streaming data (Structured Streaming, Kafka, Event Hubs)
• Experience with dbt, Airflow or similar orchestration tools
• Background in consultancy or enterprise data delivery

Why apply?

• 12-month contract with a long-term, high-impact data programme
• Work with a modern Databricks Lakehouse stack
• Hybrid working with a collaborative onsite team in North Dublin
• ASAP start for the right candidate