Senior data engineer (data pipelines, etl/elt, aws) at AES Global – Cape Town | Jobyssey

Data engineering here is an integration problem before it is anything else. A Cape Town business whose work runs on regulated fund and market data is hiring a senior data engineer to take technical ownership of it: feeds from a spread of outside vendors and internal platforms, landing across a hybrid on-premises and multi-cloud estate, that have to reconcile, hold up under audit and stay supportable at volume.

The seat is a senior individual contributor one, not a management one, and it is scoped as the step before Lead Data Engineer or Data Architect - deliberately. You stay hands-on in the pipelines every week. You also carry the technical standard for the team: reviewing designs and code, mentoring the engineers around you, and leading the conversations with the business stakeholders whose data this is.

What you'll do Lead the design and implementation of complex, large-scale data pipelines integrating market, reference and investment data. Solve advanced data engineering problems - high-volume processing, complex transformations, reconciliation and performance optimisation. Make sure what you deliver is scalable, resilient, secure and fit for purpose in a regulated financial environment. Act as a technical authority in the team, setting the standard for coding, testing, deployment and operational support. Review the designs, code and implementations of junior and mid-level engineers for quality and consistency, and contribute to the standards, patterns and reusable frameworks the team works to. Coach and mentor junior and mid-level data engineers in the tools, techniques and technology stack, and guide them on solution design and operational readiness. Lead technical engagement with business stakeholders, architects and analysts to refine requirements and shape solutions that will actually hold up. Translate complex business and regulatory requirements into clear technical designs and delivery plans. Work with data and IT architects so what you build lines up with enterprise architecture, integration patterns and data models. Make sure pipelines meet data governance, lineage, auditability and regulatory expectations, balancing delivery speed against control and long-term maintainability. Own production pipelines end to end, with the monitoring, alerting and support processes that go with them. Lead root-cause analysis on complex production issues and put durable fixes in rather than patches. What you'll need A track record of leading the delivery of complex data integration work. Modern programming skills - Python, Java or Java Script - or deep hands-on experience with low-code data integration platforms. Advanced experience with ETL and ELT frameworks, orchestration tools and scheduling platforms. A solid grasp of hybrid on-premises and cloud-based data architectures, AWS in particular. Real depth in data engineering inside complex enterprise environments - built over years rather than months - or equivalent depth carried across from software engineering, or from a business-oriented or data-focused career that took you into engineering. Strong understanding of integration patterns, performance optimisation and data quality frameworks. A tertiary qualification in computer science, information systems, information technology, engineering or similar. A demonstrated ability to mentor and lift less-experienced engineers, and to communicate clearly with technical and non-technical audiences alike. A high level of ownership, accountability and attention to detail.

If you are a software engineer looking to move into data engineering, or you moved into engineering from a business or data background and have been building at this level since, this role is open to you on the strength of what you have actually delivered.

Nice to have Financial services experience - asset management, fund services, banking or insurance - or time at a vendor serving that industry. AWS certifications. A deep understanding of investment data domains: pricing, reference data, positions, trades and NAVs. Familiarity with front-office, middle-office and back-office data flows, and the regulatory, audit and risk considerations attached to financial data. What's on offer Work that genuinely matters: these pipelines carry the investment and market data the business runs on, so engineering quality is visible rather than theoretical. Real autonomy - you are accountable for the technical outcome of what you deliver, not just your slice of it. A clear next step towards Lead Data Engineer or Data Architect. A hybrid on-premises and multi-cloud estate to work across, rather than one narrow corner of a stack. A team you help shape, through the standards you set and the engineers you grow.

Cape Town. Hybrid. Permanent. #J-18808-Ljbffr

Explore more jobs