Job Title: Lead Data Engineer
Location: Bhubaneswar, India
Job Type: Full-time
Spikewell India Pvt. Ltd (a subsidiary of Spikewell LLC, USA) is a rapidly growing Information Technology products and services company. We pioneer in providing innovative, scalable, robust, and secure solutions in the ever-changing technology landscape of Web, Mobile, Cloud, AI/ML, and Blockchain technologies. Spikewell's portfolio includes leading consumer banks, large health care institutions, and rapidly growing AdTech companies. We are constantly pursuing acquiring and retaining the best talent with competitive employment benefits and fostering a supportive work environment.
Job Overview:
We are seeking an experienced and a highly skilled Azure Data Engineer with 4+ years of experience to join our Data Engineering team, playing a critical role in supporting and enhancing our client’s Azure Data Lakehouse environment. This role involves developing, maintaining, and optimizing data pipelines using Azure Data Factory, ensuring efficient data ingestion and ETL processes from various upstream sources. Additionally, the role includes data modeling to design and implement models that fulfill both analytical and operational requirements, aligning with business needs and best practices. The team will work closely with our client’s onshore team to manage and organize large datasets, ensuring data quality, integrity, and security while adhering to healthcare regulations and standards. The team will also support data governance through the use of Informatica, implementing policies, managing data catalogs, and maintaining data lineage and metadata. The team members are expected to be available online until at least 11am EST to facilitate seamless communication with the onshore team.
Key Responsibilities:
- Develop, maintain, and optimize data pipelines using Azure Data Factory for efficient data ingestion and ETL processes.
- Design and implement scalable data models that meet both analytical and operational needs.
- Manage and organize large datasets to ensure data quality, integrity, and compliance with healthcare regulations.
- Troubleshoot and resolve data-related issues to enhance system performance and reliability.
- Assist in managing the data governance platform (Informatica), including data cataloging, metadata management, and data lineage.
- Implement and enforce data governance policies and procedures.
- Participate in data quality initiatives to ensure accuracy, integrity, and consistency across datasets.
- Collaborate with onshore team members, maintaining overlapping working hours as needed for effective communication.
Required Skills and Knowledge:
- 4+ Years of Experience: 4+ years of relevant experience in data engineering is a must.
- Azure Data Lakehouse Proficiency: Experience with Azure Data Lakehouse architecture for data storage and analytics.
- Azure Data Factory Expertise: Skilled in developing, maintaining, and optimizing data pipelines using Azure Data Factory for data ingestion and ETL processes..
- Data Modeling Skills: Ability to design and implement efficient data models that meet analytical and operational requirements..
- Informatica Experience: Knowledge of using Informatica for data governance, including data cataloging, metadata management, and data lineage.
- Data Governance Principles: Familiarity with data governance implementation and policy enforcement.
- Data Quality Management: Experience in maintaining data accuracy, integrity, and consistency across large datasets.
- Healthcare Data Regulations: Understanding of healthcare industry standards and regulations such as HIPAA to ensure data security and compliance.
- SQL and Programming Skills: Proficiency in SQL and possibly other programming languages like Python or Scala used in data engineering.
- Large Dataset Management: Ability to manage and organize large volumes of data efficiently.
- Data Security Practices: Knowledge of best practices for securing sensitive data within cloud environments.
- Relevant certification (e.g., Microsoft Certified: Azure Data Engineer Associate) is preferred.
Education Requirements:
- Bachelor’s degree in Computer Science, Information Technology, or a related field, with 4+ years of relevant experience.
What We Offer:
- A chance to work with some of the world’s leading healthcare providers.
- Competitive salary and benefits package.
- Opportunities for professional development and certifications.
- A collaborative and innovative work environment, with a focus on healthcare IT.
- The opportunity to work on impactful projects that improve patient care and healthcare services.
How to Apply:
Please submit your resume and a cover letter detailing your relevant experience to [email protected]