Data Engineer

Data Engineer

Primary mission:

As a Senior Data Engineer, you will contribute to bring data analytics to production at scale.

Establish the core discipline and guidelines. Taking part on data teams building data platforms and data products.

Core activities:

Data Platform, provision infrastructure for other teams to work with.

Data Pipelines Development (Batch + Real Time pipelines)

Data Operations (Exploring, Provisioning, Cleansing and Testing)

Technical stack:

Languages (required): Python, SQL

Languages (appreciated): Java, .NET and others

Experience with Data Ops, infrastructure as Code (Terraform, Ansible, etc)

Experience in data architecture design (Data lakes, Data Warehousing, Event

Streams. Etc)

Big Data Frameworks: Spark, Kafka, Kubernetes, Hive.. strongly appreciated

experience with Databricks.

Data Base: relational (SQL Server) & non-relational (MongoDB, ELK,

Cassandra)

Experience working in cloud environments (Azure appreciated)

Experience in Agile methodology.

As a bonus, knowledge in Machine Learning tools (Scikit-Learn, Pandas, Spark

ML, MLflow)

Soft skills and competencies:

Passion for learning new tools, languages and frameworks

Ability to be creative and innovation-minded, self-motivated and proactive.

Fast adaptation to changing requirements and strong problem-solving skills.

To work in a collaborative model, side by side with the business

Experience:

MSs degree in Computer Science, Engineering, or related field

4+ years experience in software development & Data Frameworks

Proven experience in setting up data infrastructures from scratch