Project description
We are seeking a highly experienced and hands-on Senior ETL Test Engineer with at least 7 years of ETL and Data Warehouse testing experience. You will be responsible for validating complex data pipelines, ETL workflows, database transformations, APIs, and data migration processes across enterprise systems.
The three primary requirements for this position are:
Strong hands-on Python automation
Advanced Oracle database and SQL expertise
Extensive hands-on ETL testing experience
You need to have strong data testing capabilities with practical Python automation skills. You should be able to independently design test strategies, write complex SQL queries, automate data validation, investigate data discrepancies, and perform end-to-end testing of batch and real-time data pipelines.
This is a senior, hands-on engineering position that requires direct involvement in testing, automation, troubleshooting, and defect resolution.
Responsibilities
- Validate end-to-end ETL workflows, including data extraction, ingestion, transformation, loading, and reporting.
Review and validate source-to-target mappings, data transformation rules, business rules, and data quality requirements.
Design, develop, and execute comprehensive ETL test cases for:
Batch data pipelines
Real-time and near-real-time data pipelines
Data warehouse solutions
Data migration initiatives
Data integration processes
Perform hands-on database testing across Oracle Database and MongoDB environments.
Write and execute complex SQL queries for:
Source-to-target validation
Data reconciliation
Record-count verification
Duplicate detection
Referential integrity checks
Data completeness and accuracy checks
Transformation-rule validation
Aggregation and reporting validation
Develop and maintain reusable test automation frameworks and scripts using Python and PyTest.
Use Python to automate data extraction, comparison, reconciliation, validation, and test reporting activities.
Validate data files and datasets stored, transferred, or processed through AWS S3.
Test REST APIs and verify data flow, payload structure, response codes, error handling, and system-to-system integration.
Use tools such as Postman and Swagger to perform API validation and troubleshooting.
Perform end-to-end testing of data ingestion, transformation, storage, integration, and reporting processes.
Execute functional, integration, regression, system, and data validation testing.
Test data warehouse components, including fact tables, dimension tables, staging layers, aggregates, historical data, and reporting outputs.
SKILLS
Must have
- 7+ years of hands-on ETL and Data Warehouse testing experience
Strong hands-on Python development and test automation experience
Advanced hands-on experience with Oracle Database and SQL
Strong experience with ETL testing concepts, methodologies, and validation techniques
Proven ability to write complex SQL queries involving:
Multiple joins
Subqueries
Common table expressions
Aggregations
Analytical functions
Stored procedures
Data reconciliation logic
Strong experience validating source-to-target mappings and complex data transformation rules
Hands-on experience testing data warehouse and data migration solutions
Practical experience with MongoDB and testing MongoDB-based applications
Hands-on experience validating data stored and processed through AWS S3
Strong experience with REST API testing
Experience using Postman, Swagger, or similar API testing tools
Hands-on experience developing automation scripts and frameworks using Python
Practical experience with PyTest or similar Python testing frameworks
Experience performing:
Functional testing
Integration testing
Regression testing
End-to-end testing
Database testing
Data validation testing
Strong knowledge of data reconciliation, data quality, data integrity, and data accuracy validation
Experience with defect management tools such as Jira and/or Azure DevOps
Strong analytical, debugging, troubleshooting, and root cause analysis skills
Excellent stakeholder communication, collaboration, and coordination skills
Ability to work independently in a senior, hands-on testing role
Nice to have
N/A