Data Engineer

We are seeking an experienced and highly technical Data Engineer to design, develop, and implement our corporate Business Intelligence (BI) platform. This role will lead the extraction, transformation, and ingestion of critical enterprise data from our two main core systems: SAP ERP ECC6 (running on SAP HANA 2) and Epicor Kinetic (running on MS SQL Server 2019). The ideal candidate will be the foundational architect of our data warehouse pipeline.

Key Responsibilities:

As our Data Engineer, you will be responsible for building robust, scalable ETL/ELT pipelines that consolidate transactional data from highly complex ERP schemas into an optimized analytics repository. You will work closely with Business Analysts, Technical Operations, and Project Sponsors to translate enterprise business processes into high-performance data models.

Pipeline Development:

Design, build, and optimize highly reliable ETL/ELT pipelines to ingest data from SAP ECC6 (HANA 2) and Epicor (SQL Server 2019).

Data Architecture:

Design and maintain the corporate Data Warehouse/Data Lake schemas (Star, Snowflake, or OBT) optimized for BI reporting tools.

Performance Optimization:

Troubleshoot and tune complex database queries, pipeline execution bottlenecks, and storage configurations across both source systems and target analytical databases.

Data Governance:

Implement pipeline monitoring, data reconciliation frameworks, and audit logs to guarantee data integrity, completeness, and freshness.

Collaboration:

Partner with SAP functional consultants, Epicor administrators, and downstream BI report developers to ensure end-to-end alignment.

Technical Competency:

1.SAP Integration & Extraction

Experience extracting data from SAP ECC6 using standard methods (ABAP Core Data Services (CDS) views, SAP SLT, OData Services, or RFC-based SDKs).

Direct querying, view creation, and performance tuning inside SAP HANA 2 databases. Understanding of HANA schemas and calculation views.

2.SQL Server & Epicor Integration

High proficiency in MS SQL Server 2019 database administration and query design. Deep capability in writing and optimizing complex T-SQL (stored procedures, CTEs, dynamic SQL, indexing).

Understanding of the Epicor database schema structure or Epicor BAQs (Business Activity Queries) is highly preferred.

3.ETL/ELT Technologies

Strong command of standard ETL tools (SSIS (SQL Server Integration Services), Azure Data Factory, Talend, Apache Airflow, or modern ELT tools like dbt).

Experience setting up incremental/delta-loading patterns (Change Data Capture - CDC) to minimize performance impacts on the production ERPs.

4.Data Modeling & Warehouse Design

Expertise in dimensional modeling (Kimball methodology), building robust Fact and Dimension tables.

Ability to map complex business domains (Finance, Sales, Supply Chain, Inventory) across mismatched ERP models (SAP & Epicor) into a unified warehouse schema.

5.Scripting & Automation

Strong scripting skills using Python or PowerShell to orchestrate pipelines, handle system telemetry, run custom API extractions, or trigger administrative tasks.

Qualifications:

Education:

Bachelor's degree in Computer Science, Information Technology, Computer Engineering, or related fields.

Experience:

Minimum 4+ years of dedicated experience in Data Engineering or BI Pipeline development, with at least 2 years dealing directly with enterprise ERP backends.

Analytical Skills:

Excellent analytical and troubleshooting skills, particularly with complex transactional data schemas.

Communication:

Strong communication skills to act as a bridge between PMO, external vendors, and technical infrastructure teams.

Mindset:

Self-driven, with a strict commitment to data precision and pipeline reliability.

Lyman Group was established in 1959. Commencing from a trading business Lyman Group presently diversified into other lines of business: Timber, Property, Building materials & Distribution, and Oil & Gas.

Our philosophy has always be “Reliability & Quality is Our Business”. It is highly reflected in the excellence of our products & services and the integrity of our management expertise.

We are committed to working together and contributing the best efforts for our people, business partners and clients

Lyman Group was established in 1959. Commencing from a trading business Lyman Group presently diversified into other lines of business: Timber, Property, Building materials & Distribution, and Oil & Gas.

Our philosophy has always be “Reliability & Quality is Our Business”. It is highly reflected in the excellence of our products & services and the integrity of our management expertise.

We are committed to working together and contributing the best efforts for our people, business partners and clients