Data Engineer : Tech Lead – Databricks

We are looking for a Data Engineer Tech Lead to join a world-leading Energy Trading company to lead, design and build data foundations and end-to-end solutions for the Business to maximize value from data.

The candidate is expected to be a subject matter expert who designs and builds data solutions as well as AI-coded automated data pipelines while also mentoring junior engineers. They are also a key driver in translating Vision and Data Strategy into IT solutions and delivering on them.

Strong hands-on expertise in Databricks, PySpark, Python and SQL is central to this role.

Key Skills

• Azure Stack
• ELT Experience
• Data Modeling
• Data Integration & Ingestion
• Data Manipulation and Processing
• GitHub, GitHub Actions, Azure DevOps
• Data Factory, Databricks, SQL DB, Synapse, Stream Analytics, Glue, Airflow, Kinesis, Redshift, SonarQube, PyTest
• AI based Code developed and AI-built automated data pieplines

Key Characteristics

• Technology expert who constantly pursues knowledge enhancement and has an inherent curiosity to understand work from multiple dimensions.
• Deep data focus with expertise across relevant technology domains.
• A skilled communicator capable of engaging both technical developers and business managers; respected and trusted by leaders and staff.
• Actively delivers the roll-out and embedding of Data Foundation initiatives in support of key business programs.
• Coordinates the change management, incident management, and problem management processes.
• Presents reports and findings to key stakeholders and acts as the subject matter expert on Data Analysis & Design.
• Drives implementation efficiency and effectiveness across pilots and future projects to minimize cost, increase speed of delivery, and maximize value.
• Contributes to community-building initiatives such as Centers of Excellence (CoE) and Communities of Practice (CoP).