Senior Data Engineer
Azira · Bengaluru, India ·
- Seniority
- Senior
- Category
- Data engineering
- Experience
- 3+ years
Azira · Bengaluru, India ·
Why This Role Matters
Azira is seeking a Senior Data Engineer to be part of its Data Engineering team. In this role, you will utilize your extensive knowledge to design, define, develop, deploy, and manage secure, scalable data pipelines. Responsibilities include planning and executing the data engineering roadmap, as well as implementing improvements. You will work independently to tackle challenging problems and set the pace.
This position offers the opportunity to join Azira's Engineering team, providing exposure to large-scale data and cutting-edge technology stacks. Your role involves enhancing data techniques and collaborating with Data Scientists, Software Engineers, and UI Engineers to solve complex problems as part of a high-performance team.
What You’ll Do
Develop and optimize scalable data processing pipelines for diverse data sources, formats, and content at a petabyte scale on the Azira Platform.
● Hands-on role involving coding, system architecture, and tackling complex technical challenges.
● Enhance product development, contributing to Azira’s Operational Intelligence & Marketing Intelligence solutions.
● Use the latest AI Technologies & Tools to bring in efficiency and standardization.
● Ensure high-quality product delivery by designing and executing comprehensive integration tests.
● Conduct code and design reviews to drive efficiency and innovation within Data Engineering modules.
● Plan and optimize system capacity, defining resource requirements for various deployment scenarios.
● Create clear and concise documentation, including deployment guides and technical references.
● Work in an agile environment, actively tracking and updating tasks/stories.
● Understand business needs, ensuring applications align with operational goals.
● Collaborate cross-functionally to develop creative solutions.
● Strong interpersonal and communication skills, effectively translating business requirements into data-driven solutions while working with diverse stakeholders.
What You Bring
● Experience: 6-9 years of overall experience, with at least 3 years in a data-driven company/platform.
● Programming Skills: Proficiency in Python is essential
● AI Development: Claude superusers are welcome
● Cloud Expertise: Experience with AWS Cloud, Distributed systems (EMR, Amazon Athena), Apache Iceberg, AWS Glue, Databases ( MongoDB, Cassandra, Kafka, HBase )
● Big Data Expertise: Hands-on experience with at least one distributed big data processing framework such as Apache Spark, Airflow, Apache Kafka, Apache HBase, or Redshift.
● Technical Proficiency: Expertise in frameworks, distributed systems, along with a strong grasp of algorithms, data structures, and design patterns.
● Bonus Skills: Experience with Java, Spring Boot and API development is a plus.
● Soft Skills: A team player who thrives in collaborative and start-up environments, with strong interpersonal, verbal, and written communication skills.
Why You’ll Love It Here