About xCroTek
xCroTek is a product- and service-based AI software company that builds innovative, AI-powered solutions to drive intelligent automation and digital transformation. We specialize in creating scalable, impactful technologies for modern businesses.
Job Overview
We are seeking a talented Snowflake Data Engineer with 1–5 years of experience in building and managing modern data pipelines. The ideal candidate should have strong expertise in Snowpipe, Azure Data Factory (ADF), and hands‑on experience with batch, near real-time, real-time, and CDC (Change Data Capture) data processing. The role involves designing scalable, cost‑efficient, and high‑performing data solutions to support advanced analytics and reporting.
Key Responsibilities
- Design, develop, and maintain data pipelines on Snowflake using Azure Data Factory for orchestration.
- Implement Snowpipe-based continuous data ingestion for near real-time use cases.
- Build solutions supporting batch, near real-time, and real-time data processing.
- Implement and optimize CDC (Change Data Capture) pipelines to ensure timely and accurate data updates.
- Optimize Snowflake performance (warehouses, clustering, micro-partitions, caching).
- Develop scalable data models (star, snowflake, normalized/denormalized) aligned with analytics needs.
- Ensure data quality, lineage, and governance across pipelines.
- Integrate data from diverse sources including APIs, databases, cloud storage, and streaming platforms.
- Automate workflows and data orchestration using ADF pipelines, triggers, and event‑based executions.
- Collaborate with cross‑functional teams (BI, Data Science, Product) to deliver reliable datasets.
- Monitor, troubleshoot, and optimize pipeline performance while ensuring cost efficiency.
Required Skills & Qualifications
- Bachelor’s degree in Computer Science, Information Systems, or related field.
- 1–5 years of experience as a Data Engineer, with at least 2+ years working on Snowflake.
- Strong hands‑on expertise with Snowpipe for near real‑time ingestion.
- Proven experience with Azure Data Factory (ADF) (pipelines, triggers, linked services).
- Experience in batch, near real-time, and real-time data processing.
- Hands‑on experience implementing CDC solutions (using tools like Debezium, Kafka, ADF, or other connectors).
- Strong SQL skills for query tuning, optimization, and transformation logic.
- Proficiency in Python or other scripting languages for data engineering and automation.
- Knowledge of cloud storage services (Azure Blob, ADLS, or AWS S3).
- Familiarity with RBAC, security, and compliance best practices in Snowflake.
- Excellent problem‑solving, analytical, and communication skills.