Data Engineer (Python Enterprise Developer)
Location: Canary Wharf, London, UK
Contract Type: Long‑Term Contract
Experience Required: 8+ Years
Role Overview
We are seeking a highly skilled and hands‑on Data Engineer (Python Enterprise Developer) with deep expertise in Python development, SQL, ETL engineering, and data processing. This role requires a strong Python engineer who can independently design, build, optimise, and support production‑grade data pipelines and applications.
The successful candidate will demonstrate extensive real‑world experience with Python data processing libraries, advanced SQL development, ETL pipeline engineering, cloud platforms, and DevOps practices. Candidates should be comfortable participating in live coding assessments and discussing technical design decisions in depth.
Experience within Energy Trading, Commodities Trading, Front Office Trading, or other fast‑paced data‑intensive environments will be highly advantageous.
Mandatory Skills
- 8+ years of hands‑on Python development experience
- Strong understanding of core Python programming concepts
- Experience building production‑grade Python applications
- Object‑Oriented Programming (OOP)
- Error handling, performance optimisation, and code modularisation
Python Data Libraries
- Pandas
- NumPy
- Polars
- Selenium
- BeautifulSoup
- Requests
Database & Settings
- Advanced SQL development
- Complex joins, window functions, query optimisation
- Performance tuning
- Design and development of Python‑based ETL pipelines
- Data extraction, transformation, and loading using native Python
- Data manipulation and processing using Pandas and Polars
- Web scraping and automation solutions
Workflow Orchestration
Key Responsibilities
- Design, develop, and maintain enterprise‑grade Python applications
- Build scalable Python‑based ETL and data processing pipelines
- Develop web scraping and automation frameworks using Selenium and BeautifulSoup
- Process and transform large datasets using Pandas, NumPy, and Polars
- Design, optimise, and support PostgreSQL databases and SQL solutions
- Create and maintain Apache Airflow workflows
- Work with AWS S3 and Azure Databricks platforms
- Implement and maintain CI/CD pipelines using Azure DevOps and Git
- Troubleshoot production issues and optimise system performance
- Collaborate with distributed teams across multiple locations and time zones
- Participate in Agile and Scrum delivery methodologies
- Contribute to architecture discussions and technical solution design
Ideal Candidate
- A strong Python engineer first and a Data Engineer second
- Able to explain technical design decisions and ETL trade‑offs
- Experienced in building solutions without heavy dependency on Spark abstractions
- Capable of completing live coding exercises confidently
- Hands‑on throughout the development lifecycle, from design to deployment
- Experienced working in high‑pressure, business‑critical environments