AWS Data Engineer (ETL, AWS Glue, Snaplogic, Fivetran HVR, Microsoft Data Factory)

Role: Data Engineer

Exp: 4+ Years

No. of Positions: 04

Mode: Remote Work

Budget: Upto 20 LPA

Availability: Immediate Joiners

Must Skills: AWS Glue, Snaplogic, Fivetran HVR, Microsoft Data Factory, Data Integration, Data Lake, Data Warehouse, AWS, multiple sources, ETL, “flat” files, formatted files, API and ODBC

The data platforms group builds, delivers and manages data integration solutions, a data lake and a data warehouse to deliver data across the world for VWT for backend and customer focused solutions. Our platform is entirely built on a serverless infrastructure currently hosted in the AWS cloud.

We are in the early stages of building a “harmonized” data ecosystem which combines data from multiple sources spread throughout the world.

To ensure that our product roadmap is executed successfully, we are seeking an experienced and dynamic data engineer, with a DevOps mindset, to complement our teams.

We are looking for an experienced data engineer to join our existing multicultural team on this journey, working together to ensure that our customers get the best experience possible.

The Data Engineer will be fully integrated into the development team, which is based mostly in Europe and North America practicing Agile development methodologies.

You will:

• Create complex data movements “ETL”s from a variety of sources such as “flat” files, formatted files, API and ODBC using industry leading tools such as AWS Glue, Snaplogic, Fivetran HVR and Microsoft Data Factory following well established, industry standard design patterns.
• Support and evolve existing “ETLs” while maintaining a keen understanding of the cost of error.
• Collaborate with business users on new data projects seeking to expand or improve the quality and content of an enterprise data warehouse operating in a multinational 24x7x365 environment.
• Participate in code reviews and design analysis as a member of a high performing Agile team.
• Implement systems to monitor data quality for optimised accuracy and clarity.
• Design and implement scalable and high-performing solutions.
• Use cloud based source control systems to automate, monitor and maintain deployments.
• Take part in L3 support.
• Identify synergies between software components and improve efficiency of development and code maintenance.
• Continuously improve our agile development process, architecture, and engineering practices.
• The platform being very rich and diverse, you will have the opportunity to work on different areas and projects

Education & Experience

• Bachelor's degree in Computer Science
• 4+ years of experience in software development or data-related fields with hands on experience creating and supporting ETL’s in a production environment
• Experience working in an agile team