Senior Product Data Engineer
emagine · Pune, India ·
- Work mode
- Hybrid
- Seniority
- Middle
- Employment
- Contract
- Category
- Data engineering
- Experience
- 2+ years
emagine · Pune, India ·
everience · Brussels, Brussels, be
Wk · IND-Pune-Smartworks
Health-E Commerce · United States
Systems Limited · Punjab, Pakistan
A senior data engineer role focused on designing, building, and troubleshooting enterprise-level data pipelines (real-time and batch) with Scala, Spark, Azure Databricks, Azure Data Factory, and SQL Server. Day to day involves translating business requirements into data solutions, ensuring data quality and governance, and mentoring junior engineers.
About the Role:
Take your software engineering career to the next level as a Senior Product Software Data Engineer. You will play a key role in designing, developing, and troubleshooting software programs. Your technical skills and innovative mindset will contribute to the continuous improvement of our products, making a significant impact on user experience and satisfaction.
Responsibilities:
Collaborate with cross-functional teams to review use cases and translate business requirements into scalable data solutions.
Design and develop highly optimized, reliable, and secure enterprise-level data pipelines for real-time and batch processing.
Analyze existing business processes, identify gaps, and recommend data-driven improvements.
Build modern real-time data solutions using Scala, Apache Spark, and Azure Databricks.
Partner with data scientists and business stakeholders to operationalize machine learning models.
Champion data governance, metadata management, and operational excellence across data platforms.
Ensure data quality and integrity by developing validation frameworks and monitoring mechanisms.
Adhere to coding standards, participate in peer code reviews, and contribute to technical documentation.
Mentor junior engineers and contribute to knowledge sharing across the team.
Key Requirements:
7+ years of overall experience in data engineering or related fields.
5+ years of experience building data pipelines for structured and unstructured data.
2+ years of experience with big data technologies including PySpark, Hadoop, Kafka, EventHub, and Stream Analytics.
3+ years of experience in relational and dimensional data modeling using SQL Server and data warehousing concepts.
3+ years of experience with T-SQL, stored procedures, and performance tuning.
3+ years of experience with Azure Data Factory, Azure Data Lake, Azure SQL DB, and Azure Synapse Analytics.
Good to have 2+ years of experience with Azure ML, Python, and Scala.
Good to have 2+ years of experience with Power BI and Azure Analysis Services.
Experience working with business stakeholders for requirements gathering and use case analysis.
Strong communication, collaboration, and creative problem-solving skills.
Nice to Have:
Bachelor’s degree in computer science, Engineering, or equivalent practical experience.
Experience with Agile/Scrum methodologies and DevOps practices.
Familiarity with CI/CD pipelines and version control systems (e.g., Git).
Azure Data Engineer Certification or equivalent is a strong advantage.
Other Details:
This role is focused on delivering impactful data solutions that enhance product performance and requires a collaborative approach within a team environment. Flexibility in remote work options is available, as well as opportunities for professional growth.
jobgether · US