Data Engineer

Position Summary

We are seeking a skilled and experienced Data Engineer to join our team for a cutting-edge Big Data Project. The ideal candidate will be responsible for designing, developing, and maintaining scalable and efficient data pipelines and infrastructure to support our data-driven initiatives. This role requires a strong technical background in big data technologies and data engineering best practices.

Role and Responsibilities

Duties & Responsibilities:

• Implement, maintain and evolve cloud-based Big Data products and services
• Responsible for designing, implementing, testing, and maintaining ETL processes for Analytics and Business Intelligence Systems
• Analyze data warehouses and suggest optimizations to SQL Queries used for Business Intelligence reporting
• Modify structured and unstructured data to provide meaningful reports to business
• Write large amounts of code, perform code reviews, write unit tests
• Write documentation
• Interface with other groups including Product Management, QA and Operations
• Create quick proof-of-concept prototypes
• Participate in an agile team

Work Experience:

At least 2 years relevant work experience

Skills & Competencies

• Working experience in software development using Java, Scala, or Python is a must
• Extensive experience in implementing scalable and reliable ETL pipelines using Big Data Technologies such as Apache Spark, Hadoop, AWS Glue
• Experience transforming data in various formats ( JSON,CSV, PARQUET, YAML, Avro, Orc)
• Experience managing and scheduling workflows (Apache Airflow experience is preferred)
• Experience with working on SQL Databases (Cloud Data Warehouses such as Amazon Redshift, Google BigQuery, and Data Lakes/Delta Lakes are preferred)
• Ability to analyze and simplify complex code and algorithms in Java, Scala or Python
• Ability to adapt and learn different technologies that best solves the problem regardless of whether it is written in Python, Java, Scala, etc.
• Ability to perform ad-hoc complex SQL queries and query optimization
• Team player with strong communication skills
• Desire to learn fast and pick up latest technologies and tools
• Experience with data visualization software (Tableau preferred) is a plus
• Experience with Kubernetes and Machine Learning is a plus

Please visit to see Privacy Policy, which defaults according to your location. You can change Country/Language at the bottom of the page. If you are European Economic Resident, please click .