Data Engineer
Value1 · India ·
- Work mode
- Remote
- Category
- Data engineering
- Experience
- 5+ years
Value1 · India ·
Publicis Groupe Holdings B.V · Toronto, Canada
UARROW PTE. LTD. · Singapore, Singapore
Publicis Groupe · Victoria, Australia
DVT · Melrose Arch, Gauteng, South Africa
Senior Associate L1 Data Engineer at Publicis Sapient (India, remote-friendly): designs and builds end-to-end data pipelines covering ingestion, integration, transformation, storage, and analytics using the Hadoop ecosystem (Spark, Kafka, Hive, Airflow), Java/Scala/Python, NoSQL/MPP stores, and at least one cloud platform (AWS, GCP, or Azure).
We at Publicis Sapient, enable our clients to thrive in Next and to create
business value through expert strategies, customer-centric experience design,
The future of business is disruptive, transformative and becoming digital to the
In our 20 + years in IT, never before have we seen such a dire need for
transformation in every major industry - from financial services to automotive,
consumer products, retail, energy, and travel.
To make this transformative journey a reality in these exciting times, we seek
Our people thrive because of the belief that it is both our privilege and
responsibility to usher our clients and the world into Next.
This is the world-class engineering team where you should build your career.
As Senior Associate L1 in Data Engineering, you will do technical design, and
implement components for data engineering solution. Utilize deep
understanding of data integration and big data design principles in creating
custom solutions or implementing package solutions. You will independently
drive design discussions to insure the necessary health of the overall solution
The role requires a hands-on technologist who has strong programming
background like Java / Scala / Python, should have experience in Data
Ingestion, Integration and data Wrangling, Computation, Analytics pipelines
and exposure to Hadoop ecosystem components. Having hands-on knowledge
on at least one of AWS, GCP, Azure cloud platforms will be preferable.
Job Title: Senior Associate L1 Data Engineering
Your role is focused on Design, Development and delivery of solutions
Data Ingestion, Integration and Transformation
Data Storage and Computation Frameworks, Performance
Build functionality for data ingestion from multiple heterogeneous
Build functionality for data analytics, search and aggregation
1. Overall 3.5+ years of IT experience with 1.5+ years in Data related technologies
2. Minimum 1.5 years of experience in Big Data technologies
3. Hands-on experience with the Hadoop stack HDFS, sqoop, kafka, Pulsar, NiFi, Spark,
Spark Streaming, Flink, Storm, hive, oozie, airflow and other components required in
building end to end data pipeline. Working knowledge on real-time data pipelines is added
4. Strong experience in at least of the programming language Java, Scala, Python. Java
5. Hands-on working knowledge of NoSQL and MPP data platforms like Hbase, MongoDb,
Cassandra, AWS Redshift, Azure SQLDW, GCP BigQuery etc
Preferred Experience and Knowledge (Good to Have):
1. Good knowledge of traditional ETL tools (Informatica, Talend, etc) and database
technologies (Oracle, MySQL, SQL Server, Postgres) with hands on experience
2. Knowledge on data governance processes (security, lineage, catalog) and tools like
3. Knowledge on distributed messaging frameworks like ActiveMQ / RabbiMQ / Solace,
search & indexing and Micro services architectures
4. Performance tuning and optimization of data pipelines
5. CI/CD Infra provisioning on cloud, auto build & deployment pipelines, code quality
6. Working knowledge with data platform related services on at least 1 cloud platform, IAM
7. Cloud data specialty and other related Big data technology certifications
Job Title: Senior Associate L1 Data Engineering
Strong written and verbal communication skills
Self-starter who requires minimal oversight
Ability to prioritize and manage multiple tasks
DVT · Melrose Arch, Gauteng, South Africa