Expertshub.ai · Pune, Maharashtra, India ·
Builds and maintains data pipelines using Python, SQL, Spark, and Kafka to extract, transform, and load data for AI/ML integration and cloud-based analytics.
Artefact Consulting · Manila, Philippines
BFN Engineering Services · Philippines
Inteliment · Pune City, India
Archisurance · Lahore, Pakistan
NEXBRIDGE RECRUITMENT PTE. LTD. · Singapore, Singapore
DATA Engineer - PUNE
About Role
As a Data Engineer, your role involves crafting and maintaining robust data pipelines, utilising Python and SQL, to ensure efficient extraction, transformation, and loading (ETL) of data.
Your responsibilities will include:
Data Pipeline Development: Building and optimising data pipelines to facilitate seamless data flow across systems and platforms.
Database Management: Managing databases, ensuring their integrity, and implementing data storage and retrieval solutions.
Cloud Services Integration: Leveraging cloud services such as MS Azure, GCP to architect and deploy scalable data solutions.
Machine Learning Integration: Collaborating with teams to integrate machine learning models into data pipelines for enhanced data processing.
Utilising Spark & Kafka: Implementing and working with Spark and Kafka for real-time data processing and analytics.
What we are looking for?
Technical Skills:
Proficiency in Python, SQL, and database management.
Experience with Data Pipelines ETL, Cloud Services (MS Azure, GCP), ML Modeling, Spark & Kafka.
Attitude & Soft Skills:
Proven problem-solving skills and a solution-oriented mindset.
Excellent communication skills to collaborate effectively within teams and with stakeholders.
Strong business acumen with an interest in business-facing roles.
Adaptability and a start-up mentality to thrive in a dynamic environment.
Artefact is the place to be: come and build the future of data and AI
Innovation: We have a passion for creating impacting projects and believe innovation can come from anyone.
Action: We make things rather than telling people how to make them.
Collaboration: We believe in bringing talented people together, winning together, and in learning from each other.