For one of our clients in the sportswear industry we are looking for a freelance
Data Engineer Databricks
Overview:
The Data Engineering Solutions project is an initiative within the client to design, develop, and implement data engineering solutions on the existing Databricks Lakehouse Platform.
The project focuses on delivering scalable, reliable, and governed data products that support business reporting, analytics, operational transparency, and decision-making. The solutions are developed using the established client data platform, engineering frameworks, governance standards, and delivery processes.
The scope of this assignment is limited to the delivery of the following initiatives:
- Product Margin Data Pipeline Implementation
- MRM Data Readiness Tracking Solution
Tasks:
The contractor independently performs services related to the design, development, testing, documentation, and technical validation of data engineering solutions on the existing client Databricks platform, in accordance with client-approved standards, frameworks, and implementation guidelines.
Deliverable 1: Product Margin Data Pipeline Implementation
Objective
Implement a scalable and maintainable data pipeline supporting Product Margin reporting and analytics requirements.
Deliverable 2: MRM Data Readiness Tracking Solution
Objective
Implement a data readiness tracking solution providing visibility into data availability, completeness, quality, and readiness status for MRM-related business processes.
Scope of Services:
- Analyze source data structures and business requirements.
- Design and implement data ingestion processes from approved source systems.
- Develop data transformation, enrichment, and business calculation logic.
- Create curated datasets supporting reporting and analytical use cases.
- Implement data quality validation, reconciliation, and exception handling controls.
- Optimize data processing performance and operational reliability.
- Produce technical documentation covering solution design, data flows, and processing logic.
- Support testing, deployment, and solution validation activities.
Activities:
- Utilize the existing Databricks platform and approved technology stack.
- Adhere to data architecture principles, governance requirements, security standards, and development guidelines.
- Follow established engineering frameworks, deployment processes, and CI/CD practices.
- Develop solutions that are maintainable, scalable, and aligned with existing platform patterns.
- Deliver appropriate technical documentation for all implemented components.
- Ensure developed solutions meet agreed functional and technical requirements prior to handover.
- The contractor retains responsibility for determining the detailed technical implementation necessary to achieve the agreed deliverables while complying with client standards and requirements.
Required skills:
- At least 3 years of experience with PySpark and Databricks
Start: ASAP
Capacity: Full-time, 40h/week
Duration: Till end of 2026
Location: 2–3 days onsite (Porto, Portugal), the rest remote.