Lead Data Engineer, Technology Consulting- London, Leeds, Manchester or Newcastle

Overview

In this Lead Engineer role, you will lead complex data engineering delivery for client projects, shaping modern data platforms on AWS and AI/ML workloads. You’ll work with architects and stakeholders in a collaborative, learning-focused environment to deliver impactful, regulated solutions. The role blends hands-on delivery with coaching and internal initiatives, supporting career growth and upskilling across diverse engagements. You’ll join a flexible hybrid UK-wide team and help drive innovation and best practices in data and AI.

Pay / Benefits

• Competitive salary 84,000-100,000
• Comprehensive benefits package
• Personalised development opportunities
• Flexible hybrid working model
• Rapid progression for high performers
• Global colleagues and client assignments

Responsibilities

• Lead multiple, complex data engineering delivery efforts to time, cost, and quality targets
• Manage and mentor teams, acting as escalation point for scope decisions
• Build data pipelines using Spark, Python or SQL
• Work with AWS data and AI/ML services (e.g., SageMaker)
• Utilise big data/lakehouse platforms on AWS (EMR, Databricks, Snowflake)
• Create data platforms (Data Lakes, Lakehouses, Data Mesh) underpinning analytics/AI workloads
• Incorporate Data Security, Data Governance and responsible AI principles
• Partner with senior stakeholders to drive delivery and build trust
• Anticipate risk and coordinate multi-SME teams to resolve issues
• Be recognised as SME, driving innovation and market-leading practices
• Continually upskill, including learning new programming languages
• Productionise and operate data/AI/ML solutions, including Generative AI / LLMs
• Coach and mentor engineers, enabling development opportunities for juniors and client counterparts
• Hold active SC clearance

Key requirements

• Leading multiple, complex data engineering delivery efforts
• Experience managing teams and escalation handling
• Data pipelines with Spark, Python or SQL
• Experience with AWS data/AI services (SageMaker)
• Big data/lakehouse platforms on AWS (EMR, Databricks, Snowflake)
• Building data platforms (Data Lakes, Lakehouses, Data Mesh)
• Data Security, Data Governance, responsible AI knowledge
• Ability to influence senior stakeholders
• Track record in risk management and coordinating SMEs
• Subject-matter expert driving innovation
• Drive for self-improvement and learning, including new languages
• Experience productionising data/AI/ML including Generative AI/LLMs
• Coaching/mentoring engineers
• Active SC clearance

• Perceptive
• Personable
• Culturally sensitive
• Spark
• Python
• SQL