Senior Data Engineer

Senior Data Engineer

Location: Offshore (India)
Experience: 7-10+ Years

Role Purpose

We are looking for a Senior Data Engineer to build and support data pipelines that connect Cards Modernisation, commbank.data, and Collections platforms. The role involves developing scalable data solutions using Snowflake, PySpark, Python, and AWS while ensuring data accuracy, quality, and reliability.

Key Responsibilities

• Develop and maintain data pipelines using Snowflake, PySpark, and Python.

• Build data transformations and models to support Collections data requirements.

• Work with AWS services and S3 for data ingestion and processing.

• Develop and optimize SQL queries and data workflows.

• Implement data quality checks, reconciliations, and monitoring processes.

• Support ETL/ELT development and production deployments.

• Troubleshoot and resolve data-related issues in production environments.

• Participate in code reviews, testing, and CI/CD practices.

• Collaborate with business and technology teams to deliver reliable data solutions.

Mandatory Skills

• Snowflake

• PySpark

• Python

• Advanced SQL

• AWS

• S3

• Data Pipelines

• ETL/ELT

• Data Modelling

• Data Quality & Reconciliation

• CI/CD

Preferred Skills

• EMR / EMR Serverless

• AWS Step Functions

• AWS Lambda

• Cards or Payments Domain Experience

• Banking Experience

• Exposure to PowerCurve Collections (PCC)

Ideal Candidate

• Strong hands-on experience in production data engineering environments.

• Experience building scalable, secure, and high-quality data pipelines.

• Strong troubleshooting and problem-solving skills.

• Ability to work in Agile and enterprise environments.

• Banking, Cards, or Financial Services experience will be an added advantage.