Data Engineer | London, UK

Role Summary

We are looking for experienced Data Engineers / Data Analysts to support a ledger migration and data clean-up initiative across the data lake, reporting and downstream feeds. The role will involve working on large-scale batch processing, data validation, regression testing and migration readiness activities within a financial services environment.

Key Responsibilities

• Support ledger migration activities, including data extraction, transformation, reconciliation and validation.

• Work on data lake clean-up, data quality checks, reporting pipelines and downstream feeds.

• Develop, enhance and validate SQL queries, batch jobs and data processing logic.

• Perform regression testing on batch processes to ensure data accuracy and completeness before and after migration.

• Collaborate with engineering, product and business teams to understand migration requirements and resolve data issues.

• Document data mapping, validation rules, test results and migration exceptions clearly.

• Support production readiness, defect triage and post-migration validation activities.

Required Skills and Experience

• Strong hands-on experience with SQL and data analysis across large datasets.

• Experience with batch processing, batch regression testing and data reconciliation.

• Working knowledge of Spark or similar distributed data processing technologies.

• Experience working with data lakes, reporting platforms, feeds and data migration programmes.

• Ability to identify data inconsistencies, investigate root causes and support remediation.

• Strong understanding of data quality, controls, validation and auditability in enterprise environments.

• Good communication skills with the ability to work across engineering, business and product stakeholders.

Preferred Experience

• Prior experience in financial services, banking, ledger systems or regulatory data environments.

• Experience supporting enterprise-scale migration, modernisation or platform transformation programmes.

• Exposure to reporting, dashboards, data views and operational data feeds.

• Ability to work in distributed teams across London, Bangalore and Singapore.