Data Engineer at Qode – UAE | Jobyssey

Experience

5–6 years | Location: Dhahran/Khobar, KSA — onsite only | Duration: 3 months (extension possible) | Availability: Immediate

Role overview

Build the data backbone of the MRO inventory optimization solution — ingestion, cleansing, transformation, and the optimization logic that turns raw SAP material master and inventory data into actionable outputs. You'll own pipelines from source through to the analytics and application layers.

Must-have — technical depth expected

Python: Production-grade code, modular design, packaging, logging, config management, unit testing (pytest); strong grasp of data structures and performance.

Pandas / NumPy: Vectorized transformations, joins/merges, groupby/aggregation, handling large datasets, deduplication, type coercion, working with messy real-world MRO/master data.

Airflow: Authoring DAGs, operators/sensors, scheduling and backfills, task dependencies, retries/SLAs, idempotent pipeline design, parameterization.

BigQuery: Writing performant SQL, partitioning/clustering, cost-aware querying, loading/exporting data, working with nested/repeated fields.

SQL: Advanced joins, window functions, CTEs, aggregation, query optimization across relational and warehouse engines.

API development: Building and consuming REST APIs (FastAPI/Flask), request validation, pagination, integration with upstream systems (e.g., SAP-sourced data via CPI/OData).

Good-to-have

PySpark (distributed transforms), ML basics (forecasting/classification relevant to inventory optimization — EOQ, demand forecasting, slow-moving/obsolete stock detection), data quality frameworks (Great Expectations or similar), Docker, CI/CD.

Scope of work

Data ingestion from SAP material master and inventory feeds (via API/OData) and other sources into the warehouse.

Data cleansing and master data processing — standardizing material descriptions, deduplication, classification, handling incomplete records.

Build and orchestrate ETL pipelines (Airflow, BigQuery), ensuring reliability, idempotency, and data lineage.

Implement inventory optimization logic (reorder points, safety stock, EOQ, criticality/ABC analysis, obsolescence flags).

Develop backend services / APIs exposing processed data to the UI and BI layers.

Explore more jobs

Experience

Role overview

Must-have — technical depth expected

Good-to-have

Scope of work