Data Engineer - IT

Job Description:

Required Skills & Experience
Strong hands-on experience in:

• Databricks (Lakehouse platform, notebooks, jobs, clusters)

• PySpark / Apache Spark

• Advanced SQL (joins, window functions, performance tuning)

• Solid understanding of ETL concepts, data warehousing, and data modeling

• Experience building scalable data pipelines for structured and semi-structured data

• Familiarity with data lake / delta lake architecture

• Good understanding of performance optimization techniques in Spark and SQL

• Experience with version control (Git) and deployment practices

• Strong problem-solving and analytical skills

Good to Have

• Experience with cloud platforms (AWS)

• Exposure to CI/CD pipelines (Jenkins)

• Knowledge of Delta Lake, Unity Catalog, or similar governance tools

• Understanding of data quality frameworks / monitoring tools

• Experience working in Agile / Scrum teams

Location:

This position can be based in any of the following locations:

Chennai, Gurgaon

Current Guardian Colleagues: Please apply through the internal Jobs Hub in Workday