Distributed Cloud | Data Pipeline Specialist
Devoteam · Lisboa, Lisboa, pt ·
- Experience
- 5+ years
- Company size
- 1000+
Devoteam · Lisboa, Lisboa, pt ·
We are seeking versatile and experienced Senior Data Engineers to join our growing data teams in Lisboa or Porto. In this role, you will be responsible for designing, building, and optimizing mission-critical data pipelines and ETL/ELT solutions. You will work across diverse data platforms and technologies, ensuring the scalability, performance, and reliability of our data assets.
Key Responsibilities
Design, build, and optimize robust ETL/ELT data pipelines for batch and real-time processing.
Work with Big Data technologies and distributed computing frameworks (e.g., Spark) to process large datasets efficiently.
Develop, test, and deploy code primarily using Python (and ideally Scala), focusing on high performance and data integrity.
Manage and maintain data environments built on various platforms, including Cloudera and traditional data warehouses like Teradata.
Collaborate with Data Architects and Analysts to translate complex requirements into technical data models and solutions.
5+ years of proven experience as a Data Engineer, ETL Developer, or Big Data Engineer.
Strong expertise in building data pipelines and extensive knowledge of ETL/ELT methodologies.
Mandatory proficiency in SQL and strong programming skills in Python (experience with Scala is highly valued).
Demonstrable experience with at least one Big Data ecosystem, such as Spark or the Cloudera platform.
Experience with traditional data warehousing platforms like Teradata is a strong advantage.
Familiarity with cloud environments (AWS, Azure, or GCP) is a plus.
Good level of English, both written and spoken.
The Devoteam Group works for equal opportunities, promoting its employees based on merit and actively fights against all forms of discrimination. We are convinced that diversity contributes to the creativity, dynamism and excellence of our organization. All of our vacancies are open to people with disabilities.