AWS Data Engineer (Python, Pyspark)
Tata Consultancy Services · Hyderabad, India ·
- Category
- Data engineering
- Experience
- 6+ years
- Company size
- 1000+
Builds and maintains big-data pipelines for TCS clients in Hyderabad: hands-on development with Python/Scala/Java, Apache Spark, Hive and Oozie on AWS and Cloudera platforms, plus performance tuning, unit testing and Git/Jenkins CI/CD. Requires 6-8 years of experience.
Greetings from TCS!!!
Come and join us for an exciting career with TCS!!!
Role- AWS Data Engineer
Experience: 6 - 8 Years
Location- Hyderabad
Required Skills & Qualifications
- Proficiency in Scala/Java/Python
- Oozie, Hive & Scala (hands on)
- Experience with Apache Spark
- Cloud expertise: primarily AWS
- Hands-on experience in building on-premises data pipelines using big data platforms like Cloudera, including basic Hive and Oozie
- Performance tuning techniques - for hive & scala
- CI CD Pipelines (GIT/Jenkins)
- Unit testing
- Familiarity with GitLab for source control