Python ETL Developer

About the Role

As a Python ETL Developer, you will play a critical role in designing, developing, and maintaining robust data integration and ETL solutions. You'll work closely with data architects, analysts, and business stakeholders to ensure data quality, reliability, and performance across our data systems.

Key Responsibilities

• Design, develop, and maintain ETL pipelines to support data integration and data warehousing.

• Collaborate with stakeholders to gather and analyze data requirements.

• Use open-source tools and libraries, especially Pandas, to enhance ETL workflows.

• Troubleshoot and optimize existing ETL processes for accuracy and performance.

• Implement best practices for data extraction, transformation, loading, and quality validation.

• Develop and maintain technical documentation for ETL processes.

• Stay informed on the latest trends and best practices in data engineering and integration.

• Support continuous improvement and automation efforts across the data platform.

Required Qualifications

• Bachelor's or Masters degree in Computer Science, Information Technology, or a related field.

• 5+ years of ETL development experience using Python.

• Hands-on experience with open-source ETL tools such as Apache Airflow, Luigi, Petl, and Pandas.

• Proficiency in Oracle SQL and PL/SQL for database development.

• Familiarity with UNIX and/or Windows environments.

• Experience with scripting languages such as Shell or Perl.

• Understanding of Object-Oriented Analysis and Design (OOAD) and Service-Oriented Architecture (SOA).

• Strong grasp of data warehousing, data modeling, and data integration principles.

• Excellent analytical, problem-solving, and communication skills.

Preferred Qualifications

• Experience with Docker, Kubernetes, or other container/orchestration tools.

• Familiarity with version control tools such as Git.

• Exposure to Agile/Scrum development methodologies.