Data Warehouse and ETL
Developer
Role Summary
The Data Warehouse and
ETL Developer is responsible for the architecture, development, and maintenance
of the enterprise data warehouse. This role focuses on building
high-performance data pipelines using Talend, optimizing MS SQL Server
environments, and ensuring seamless data flow between QAD (ERP) and Salesforce
(CRM) using Open Query and API-driven integrations.
Key Technical
Responsibilities
Data Warehousing &
Modeling
- Warehouse Architecture: Design
and maintain scalable data warehouse structures (Star and Snowflake
schemas) to support company-wide analytics.
- SQL Development: Write and
optimize advanced T-SQL, including complex window functions and CTEs, to
transform raw ERP data into actionable insights.
- Database Optimization: Manage
indexing, partitioning, and execution plan analysis to ensure the data
warehouse performs efficiently as data volume grows.
- Legacy Connectivity: Expertly
utilize Open Query to extract data from Progress-based QAD/Mfg./Pro
environments into SQL Server.
ETL & Integration
Development
- Talend Pipelines: Design,
develop, and deploy Talend ETL jobs to automate the extraction,
transformation, and loading of data from disparate sources.
- System Synchronization: Build
and monitor critical integrations between QAD and Salesforce, ensuring
customer, order, and inventory data remains synchronized.
- API Integration: Develop Talend
workflows that utilize REST/SOAP APIs to push and pull data from
cloud-based platforms like Salesforce.
- Error Handling: Implement
robust logging and alerting frameworks within Talend to proactively
identify and resolve data discrepancies.
Data Governance &
Quality
- Data Cleansing: Develop
automated scripts to identify and correct "dirty" data, ensuring
high-quality inputs for Power BI dashboards.
- Documentation: Maintain
detailed data lineage documentation, mapping source-to-target
transformations for compliance and audit purposes.
Expertise and Attributes
- Core Stack: 5–7 years of
experience with MS SQL Server and Talend (Open Studio or Data Management
Platform).
- ERP/CRM Expertise: Strong
functional understanding of QAD (Mfg /Pro) and Salesforce objects/tables.
- Technical: High proficiency in
T-SQL, Open Query, Linked Servers, and JSON/XML data parsing.
- Environment: Experience working
in a Medical Device or manufacturing environment is highly preferred.
- Problem Solving: Ability to
troubleshoot complex data bottlenecks in a fast-paced, production-critical
environment.
Education and Experience
- Bachelor’s degree in computer
science, Data Science, or Information Technology.
- 5–7 years of dedicated
experience in ETL development and Data Warehousing.