AI Data Engineer – Migration
PBT Group · Cape Town, South Africa ·
- Category
- Data engineering
- Experience
- 3+ years
PBT Group · Cape Town, South Africa ·
PALO IT · Ciudad de México
Total Performance Consulting · State of São Paulo
lplfinancial · Hyderabad
Cloudwerx · Australia
ocbc · OCBC Singapore
Data engineering role at PBT Group in Cape Town focused on a data migration and modernisation initiative, building ETL/ELT pipelines and using AI agents/LLMs to automate data discovery, schema mapping, transformation and validation. Core stack is Python, SQL, cloud data platforms (AWS/Azure/GCP), plus exposure to AI/agentic tooling like LangChain, LLM APIs and RAG.
We are looking for an AI Data Engineer – Migration to join a specialist data modernisation initiative, combining traditional Data Engineering with emerging AI and agentic technologies.
The role will focus on using AI-assisted and agent-based solutions to support complex data migration and modernisation, including data discovery, schema mapping, transformation, validation and data-quality processes.
We are not looking for an exact technology match. Strong Data Engineering experience combined with practical exposure to AI, LLMs or agentic development will be considered.
What You'll Be Doing
Design and develop data migration and modernisation pipelines.
Work with AI agents to automate data discovery, schema mapping, transformation and validation.
Integrate AI/agentic workflows with traditional Data Engineering platforms and tools.
Analyse legacy data structures and support migration to modern cloud environments.
Build data-quality, validation and human-in-the-loop processes.
Develop and integrate APIs and data services.
Work with technical teams to ensure solutions are scalable, reliable and secure.
Apply AI-assisted development tools while reviewing and validating generated outputs.
Support data governance, security and privacy requirements.
What We're Looking For
Essential / Relevant Experience:
3+ years' experience in Data Engineering.
Strong Python and SQL skills.
Experience with ETL/ELT pipelines and data transformation.
Experience with a cloud data environment such as AWS, Azure or GCP.
Exposure to AI, LLMs, Generative AI or AI agents.
Experience with APIs, microservices, Docker or CI/CD would be advantageous.
Strong analytical and problem-solving ability.
Comfortable working with complex or legacy data environments.
Ability to work independently and collaborate with technical and business stakeholders.
AI / Agentic Experience
Exposure to technologies such as the following would be advantageous:
LangChain / LangGraph
AutoGen / CrewAI / LlamaIndex
OpenAI / Anthropic / other LLM APIs
Prompt engineering and structured outputs
RAG / Vector Databases
AI-assisted coding and development tools
You do not need experience across all of the above. We are particularly interested in candidates who understand the concepts and have hands-on exposure to applying AI within Data Engineering or software development.
Advantageous Experience
Legacy-to-modern data migration or application modernisation.
AWS, Azure or GCP data platforms.
Spark / PySpark, dbt, Airflow, Snowflake, BigQuery or Databricks.
Experience working with legacy relational, mainframe or NoSQL data.
Data quality, testing and validation frameworks.
Experience implementing AI solutions within regulated or enterprise environments.
Qualifications
A Bachelor's or Master's degree in Computer Science, Data Engineering, Artificial Intelligence, Information Technology or a related field would be advantageous.
Why Join?
This is an opportunity to work at the intersection of Data Engineering, AI and modernisation, contributing to practical solutions that use emerging agentic technologies to solve complex data migration challenges.