Data Engineer

Ascendion is looking for Hands-on Level 3 data engineer responsible for designing and delivering target-state data platform and strategic workloads into governed, scalable Lakehouse data products using PySpark, Spark, Iceberg, Airflow, Kafka, Databricks, Starburst and object storage.

Full-time role with Ascendion

Hybrid working Setup

Key Responsibilities:

• Design, build and optimise enterprise-scale batch, NRT and streaming pipelines using PySpark, Apache Spark and Kafka.
• Deliver target-state Lakehouse products using Apache Iceberg, object storage and reusable data-engineering patterns.
• Engineer cloud data-processing solutions on Databricks and support portability across on-premises and cloud compute.

Profile:

• Expert-level hands-on PySpark and Spark engineering experience, including performance tuning, partitioning, joins, caching and workload optimisation.
• Strong practical knowledge of Lakehouse architecture, Apache Iceberg, advanced SQL, data modelling and distributed processing.

Primary Engagement:

Works as a senior hands-on engineer, independently delivering complex components while collaborating with architecture, product and controls.

#DataEngineering #Hiring #PySpark #ApacheSpark #ApacheIceberg #Databricks #Kafka #Airflow #Lakehouse #Trino #DataJobs