Dataops Engineer
Talent Folks · Bengaluru, KA, in ·
- Work mode
- Remote
- Experience
- 5+ years
- Develop complex code using Dataflow, write complex sql queries in Bigquery, schedule end-to-end Composer based data pipelines
Actively participate in the cloud design, configuration, and implementation to meet program and customer needs
Provide recommendations on cloud infrastructure upgrades and supports project integration as required
• 5+ years of experience in Big Data technologies.
Proven experience in maintaining and setting up Data pipelines for Data warehouse / Data Lake for business analytics, minimum 2 projects with technologies like; HDFS, Hive, MySQL, MongoDB, Cassandra
Strong experience in non-cloud big data processing techniques like Apache Spark, Apache Flink etc.
Hands-on experience in Core Java, advanced Java and python
Experience leading a substantial feature in an enterprise product (Preferably in the monitoring space e.g., DataDog, AppDynamics, DynaTrace etc)
Professional Attributes:
• Team player!
• Good communication and interpersonal skills
• Excellent problem-solving skills and mitigate technical issues