Data QA Engineer (Python)

Project description

Working within the client's test and government framework, you will be responsible for creating the automation framework to support all data warehousing progression and regression testing and fix the defects.

Responsibilities

• Analyze and document test data, results, and recommendations.
• Perform functional and non-functional testing for data validation between source and target DBs as per the business requirements using relevant Azure components such as Azure data bricks and Azure data factories.
• Conduct smoke, integration, regression, and other tests on products under development and released.
• Collaborate with developers, business analysts, and users to understand testing needs and identify opportunities for automation and testing.
• Ensure that automated test scripts are created, maintained, and executed to: - Meet all data Project deliverables and project testing requirements. - Create test and training data. - Support integrated testing.
• Contribute to the continuous improvement of test quality by undertaking reviews and recommending improvements.

SKILLS

Must have

• 5+ years experience in data automation using Python, PySpark.
• Hands on experience in building customized Automation framework using Python, PySpark and SQL.
• Extensive experience with ETL concepts & technologies, Data migration testing, Data warehouse testing, and BI Reporting
• Hands on experience in working with CSV and JSON using PySpark.
• High level of Proficiency in writing complex SQL queries in Azure data bricks from Business requirements to read data from source DB hosted in Azure and compare it with the target DB
• Proficiency in relational database models, SQL queries, XML data models
• Extensive experience with software test automation tools and working in fast-paced Agile environments
• Experience with Azure Data Factory for pipeline execution and analysis
• Experience with Azure Databricks to access data from Azure Data Lakes
• Experience with Azure Notebooks
• Experience with Cosmos DB
• Experience in understanding in version control, CI/CD solutions using tools such as Azure DevOps.
• Experience in the Banking domain is highly desirable
• Bachelor's Degree in IT, Business, Computer Science, or a related field
• Good knowledge of testing lifecycle processes
• Experience with Atlassian tools (Jira and Confluence)
• Good communication and presentation skills
• Experience in Waterfall and Agile environments

Nice to have

• Experience with Azure Data Factory for pipeline execution and analysis Experience with Azure Databricks to access data from Azure Data Lakes • Experience with Azure Notebooks • Experience with Cosmos DB • ISTQB Certification • Experience in the finance industry is highly desirable