Senior Technology Engineer – DevOps Data Hadoop

Senior Technology Engineer – DevOps Data Hadoop

Job Overview:

We are looking for hands-on Tier-2 Production Engineer with strong Cloudera Data Platform (CDP) expertise to install, maintain, secure, and optimize enterprise Hadoop/Cloudera data platforms.

The role requires deep expertise across cluster administration, automation, containerization, platform security, observability, and collaboration with data engineering teams to ensure reliable and high-performing data services.

Key Responsibilities:

Cloudera & Data Platform Administration

• Provide hands‑on Tier‑2 production support for Cloudera Data Platform (CDP).
• Install, configure, maintain, and optimize the Cloudera environment.
• Install and maintain the latest supported CDP version, including CDP 7.1.9 or later and associated Cloudera Data Services.
• Support ongoing platform maintenance and operational stability.

Security & Compliance

• Implement and maintain security requirements for CDP.
• Automate security and regulatory checks.
• Support secure operation of the enterprise data platform.

Performance Engineering

• Optimize Cloudera cluster performance.
• Work closely with data engineering teams to optimize Spark job performance.
• Troubleshoot:
  • Spark jobs
  • Hive jobs
  • YARN jobs
• Drive platform optimization and service reliability.

Containerization

• Implement CDP containerization with data services.
• Work with container technologies and enterprise container‑management platforms.
• Support Kubernetes/OpenShift‑based environments.

Automation & CI/CD

• Build automated pipelines and workflows for data projects.
• Use tools such as:
  • GitHub Actions
  • Jenkins
  • ArgoCD
  • Similar CI/CD technologies
• Python‑based automation is preferred.
• Drive automated patching and platform observability.

Required Skills & Experience:

• 8+ years of relevant experience, with the source specifically calling for 10+ years of hands‑on Tier‑2 production experience with Cloudera.
• Shell
• Terraform
• Ansible
• Experience with containerization technologies including:
  • Podman
  • Docker
  • OCP
• Experience with container management using:
  • Kubernetes
  • OpenShift
• Strong Linux operating system and networking fundamentals.
• Proficiency with Git and Agile engineering practices.

We craft, deploy, and manage bespoke services in CRM, data and AI, cybersecurity and consulting.