Data Engineer

Job Description:

Key Responsibilities:

• Design, develop, and maintain high-performance, scalable, high-volume, and efficient ETL/ELT pipelines to extract, transform, and load data from various sources such as Oracle.
  

• Create and optimize data models and schemas to support various use cases (such as AI/ML solutions, benchmarking, customer data delivery) in Snowflake and Redshift.
  

• Ensure data quality, integrity/completeness, and governance by implementing best practices for monitoring and validation. Build automated monitoring and alerting mechanisms.
  

• Collaborate with cross-functional teams to understand data requirements to support business objectives.
  

• Stay up to date with emerging trends and technologies in data engineering.
  

Required Skills/Qualifications:

• 4-10 years of experience in building and maintaining ETL/ELT data pipelines using tools such as Informatica, Pentaho Data Integration, or other third-party tools.
  

• 4+ years of hands-on experience with relational databases such as Oracle and data modeling.
  

• Strong programming skills in Python, SQL, or Scala.
  

• 3+ years of experience on data warehouse platforms such as Snowflake and Redshift.
  

• Familiarity with data governance, security, and compliance best practices.
  

• Keen eye for data accuracy, completeness, and privacy.
  

• Familiarity with cloud services such as AWS and Azure.
  

• Familiarity with version control systems (e.g., Git), JIRA, Confluence.
  

• Experience in delivering customer-facing SaaS solutions.
  

• Bachelor’s degree in Computer Science, Engineering, or a related field, or equivalent practical experience.
  

• Strong problem-solving skills and the ability to optimize data processing workflows.
  

• Excellent verbal and written communication and teamwork skills.
  

Desirable Skills:

• Experience with AI and machine learning applications.
  

• Understanding of containerization technologies like Docker.
  

• Knowledge of CI/CD pipelines and DevOps practices.
  

Benefits:

• Competitive salary and benefits package.
  

• Opportunity to work on cutting-edge technologies and innovative projects.
  

• Collaborative and inclusive work environment.
  

• Professional development and growth opportunities.