Data Engineering Lead - Insurance

As a Data Engineering Lead in the insurance industry, you will oversee data engineering initiatives and drive technical excellence within the organisation. This temporary role offers the chance to lead innovative projects and support business growth through data-driven solutions.

Leading insurance firm

Description

As a Data Engineering Lead, your main responsibilities will include:

• Collaborate closely with Health business leaders, product owners, regional teams, and IT stakeholders to gather business requirements, define project scope, and drive successful delivery within agreed timelines.
• Partner with regional teams to align data initiatives, priorities, and implementation strategies across multiple markets.
• Perform effort estimation and project planning, translating complex business requirements into technical epics, user stories, and delivery roadmaps.
• Design, develop, and maintain scalable data platforms, including batch and real-time data pipelines, data lakehouses, and enterprise data warehouse solutions.
• Provide technical leadership for enterprise data environments, establishing architecture standards, engineering best practices, and platform optimization strategies across Azure Cloud and Databricks.
• Build and enhance data ingestion, orchestration, transformation, and data quality frameworks to ensure reliable and efficient data processing.
• Drive data governance, technical standards, and best practices to maintain data integrity, security, and compliance.
• Lead code reviews, technical troubleshooting, performance tuning, and cost-optimization initiatives to ensure robust and resilient data solutions.

Profile

A successful Data Engineering Lead should have:

• Bachelor's or Master's degree in Computer Science, Information Systems, Engineering, or a related discipline.
• Minimum 8 years of IT experience, including at least 5 years in data engineering leadership, technical lead, or solution delivery roles.
• Strong hands-on experience with Azure technologies, including Azure Data Lake Storage (ADLS), Azure Data Factory (ADF), Azure Synapse Analytics, and Azure SQL.
• Deep expertise in Azure Databricks, Apache Spark (PySpark/Spark SQL), and modern ETL/ELT framework design and implementation.
• Solid experience with relational database technologies such as Oracle, SQL Server, or PostgreSQL.
• Proven ability to lead large-scale data platform initiatives and communicate complex technical concepts effectively to both technical and non-technical stakeholders.
• Familiarity with Alibaba Cloud (AliCloud) big data technologies, including DataWorks, MaxCompute, OSS, and Hologres, is highly desirable.
• Experience with data visualization and reporting tools such as Power BI, FineBI, Tableau, or similar enterprise BI platforms.
• Strong analytical, stakeholder management, and problem-solving skills, with the ability to work effectively in a fast-paced and collaborative environment.

Job Offer

This is a role to take on a leadership role in data engineering within the insurance sector.