Data engineering here is an integration problem before it is anything else. A Cape Town business whose work runs on regulated fund and market data is hiring a senior data engineer to take technical ownership of it: feeds from a spread of outside vendors and internal platforms, landing across a hybrid on-premises and multi-cloud estate, that have to reconcile, hold up under audit and stay supportable at volume.
The seat is a senior individual contributor one, not a management one, and it is scoped as the step before Lead Data Engineer or Data Architect - deliberately. You stay hands-on in the pipelines every week. You also carry the technical standard for the team: reviewing designs and code, mentoring the engineers around you, and leading the conversations with the business stakeholders whose data this is.
What you'll do
- Lead the design and implementation of complex, large-scale data pipelines integrating market, reference and investment data.
- Solve advanced data engineering problems - high-volume processing, complex transformations, reconciliation and performance optimisation.
- Make sure what you deliver is scalable, resilient, secure and fit for purpose in a regulated financial environment.
- Act as a technical authority in the team, setting the standard for coding, testing, deployment and operational support.
- Review the designs, code and implementations of junior and mid-level engineers for quality and consistency, and contribute to the standards, patterns and reusable frameworks the team works to.
- Coach and mentor junior and mid-level data engineers in the tools, techniques and technology stack, and guide them on solution design and operational readiness.
- Lead technical engagement with business stakeholders, architects and analysts to refine requirements and shape solutions that will actually hold up.
- Translate complex business and regulatory requirements into clear technical designs and delivery plans.
- Work with data and IT architects so what you build lines up with enterprise architecture, integration patterns and data models.
- Make sure pipelines meet data governance, lineage, auditability and regulatory expectations, balancing delivery speed against control and long-term maintainability.
- Own production pipelines end to end, with the monitoring, alerting and support processes that go with them.
- Lead root-cause analysis on complex production issues and put durable fixes in rather than patches.
What you'll need
- A track record of leading the delivery of complex data integration work.
- Modern programming skills - Python, Java or JavaScript - or deep hands-on experience with low-code data integration platforms.
- Advanced experience with ETL and ELT frameworks, orchestration tools and scheduling platforms.
- A solid grasp of hybrid on-premises and cloud-based data architectures, AWS in particular.
- Real depth in data engineering inside complex enterprise environments - built over years rather than months - or equivalent depth carried across from software engineering, or from a business-oriented or data-focused career that took you into engineering.
- Strong understanding of integration patterns, performance optimisation and data quality frameworks.
- A tertiary qualification in computer science, information systems, information technology, engineering or similar.
- A demonstrated ability to mentor and lift less-experienced engineers, and to communicate clearly with technical and non-technical audiences alike.
- A high level of ownership, accountability and attention to detail.
If you are a software engineer looking to move into data engineering, or you moved into engineering from a business or data background and have been building at this level since, this role is open to you on the strength of what you have actually delivered.
Nice to have
- Financial services experience - asset management, fund services, banking or insurance - or time at a vendor serving that industry.
- AWS certifications.
- A deep understanding of investment data domains: pricing, reference data, positions, trades and NAVs.
- Familiarity with front-office, middle-office and back-office data flows, and the regulatory, audit and risk considerations attached to financial data.
What's on offer
- Work that genuinely matters: these pipelines carry the investment and market data the business runs on, so engineering quality is visible rather than theoretical.
- Real autonomy - you are accountable for the technical outcome of what you deliver, not just your slice of it.
- A clear next step towards Lead Data Engineer or Data Architect.
- A hybrid on-premises and multi-cloud estate to work across, rather than one narrow corner of a stack.
- A team you help shape, through the standards you set and the engineers you grow.
Cape Town. Hybrid. Permanent.
#J-18808-Ljbffr