Data Engineer (Databricks)

Czym będziesz się zajmować?

Project details and scope:

• Build and optimize Azure and Databricks data platforms, lakehouses, and analytics solutions.
• Design and maintain scalable pipelines with ingestion from databases, APIs, files, and event streams.
• Transform, validate, and quality check end to end data flows.
• Collaborate with Business Analysts and stakeholders to turn requirements into data solutions.
• Support production, analyze incidents, optimize performance, and follow governance, security, and regulatory standards.
• IT Services project in Wrocław Swojczyce with a hybrid model requiring 2 office days per week.
• Project until the end of 2026 with possible extension, starting ASAP. EU citizenship and residence in Poland are required.

• Full time B2B agreement with a rate of 125 to 145 PLN net per hour.
• Private medical and dental care covering 70 percent of costs, Multisport card, and life insurance.

• 4 or more years of Data Engineering experience.
• At least 2 years of production experience with Databricks and Delta Lake.
• At least 2 years building and maintaining Azure Data Factory pipelines.
• Very strong Python, Spark SQL, and PySpark skills.
• Azure Data Lake Storage Gen2, Medallion architecture, and dimensional models.
• REST APIs, batch ingestion, and streaming ingestion.
• GitHub Copilot, CI/CD, and Azure DevOps or similar.
• Strong understanding of data quality, performance, scalability, data modeling, ETL, ELT, and modern data architecture.
• Very good English skills.
• European Union citizenship and residence in Poland.

• PostgreSQL integration.
• Time series processing for GPS and parameter data, plus Slowly Changing Dimensions.
• Spark performance tuning and Adaptive Query Execution.
• Change Data Capture, incremental loading, and SSIS migration patterns.

• Databricks
• Python
• PySpark
• Azure Data Lake Storage Gen2
• Azure Data Factory
• Spark SQL
• Data Quality
• Performance optimization
• Scalability
• Data modeling
• Modern data architecture principles

• Data Engineering

• Polski
• Angielski

• 21k–24.4k PLN netto/m (B2B)
• B2B - Elastyczne godziny pracy (100%)
• Praca zdalna: Hybrydowo
• Pakiet medyczny, Ubezpieczenie, Pakiet sportowy

In the vibrant sphere of international consulting, Cyclad distinguishes itself with deep specialization in the IT/ICT sectors. Our commitment to excellence propels us to deliver a broad array of outsourcing services, spanning HR and IT domains.

Catering to diverse industries such as Banking, Aviation, Travel, Cybersecurity, and BPO, Cyclad's offerings are as varied as the clients we serve. This diversity not only demonstrates our versatility but also our capability to tailor solutions to the unique challenges and opportunities within each sector.

Central to Cyclad’s philosophy is a commitment to delivering services of unmatched quality while nurturing enduring relationships with our clients and our team. We believe that the foundation of our success lies in a blend of innovative technologies and the profound value we place on human connections and dedication.