Technical Data Engineer

Overview

As a Data Engineer in a specialist technical consultancy, you design, build, and maintain robust data pipelines for high-priority projects across central government, defence, and critical national infrastructure. You’ll work with customers and internal teams to shape data engineering strategy, roadmaps, and adoption of emerging technologies. The role combines hands-on pipeline work with governance, security, and data quality initiatives in regulated environments. This is a chance to impact mission-critical outcomes while growing technical depth in a collaborative setting.

Pay / Benefits

• Flexible working
• Hybrid/remote working options
• Learning & Development budget
• Career development opportunities
• Pension (employer-matched)
• Healthcare benefits

Responsibilities

• Interpret and validate data requirements across complex environments
• Profile and analyze large datasets to ensure quality and completeness
• Design and implement robust ETL/ELT frameworks for data ingestion and cleansing
• Develop scalable data pipelines to support analytics and decision-making
• Implement data quality controls and prepare datasets for reporting/visualisation
• Design and maintain data models to support analytical needs
• Manage and optimise cloud storage solutions (S3, Azure Blob, BigQuery, Snowflake)
• Contribute to data governance, policies, and best practices
• Support data anonymisation and secure data handling
• Monitor and optimise data workflows for performance and cost efficiency
• Evaluate emerging data technologies and opportunities to enhance capabilities
• Present findings to customers and stakeholders
• Collaborate with cross-functional teams throughout the project lifecycle

Key requirements

• Proven experience as a Data Engineer in complex technical environments
• Strong knowledge of data management principles (modelling, quality, governance)
• Deep experience with Snowflake and Databricks – essential
• Experience assessing data management systems and recommending improvements
• Experience with cloud-based and distributed architectures
• Proficient in SQL and Python
• Experience with Apache Airflow and Spark
• Experience with AWS and Azure cloud platforms
• Knowledge of big data technologies and data analytics/visualisation
• Understanding of data standards, interoperability, governance, and sharing
• Experience with sensitive/security-conscious data environments is beneficial
• Strong analytical, problem-solving, communication, and stakeholder-management skills
• Eligibility to obtain UK security clearance (citizenship + five years UK residency)

• Collaborative mindset
• Strong communication
• Stakeholder-management
• Snowflake
• Databricks
• SQL