Sr Data Engineer
Full-time | Commack, NY | Hybrid
Position Overview:
Our client, a global haircare company, is seeking a highly skilled and motivated Sr Data Engineer to create and manage a data warehouse, integrating data from various sources including NetSuite, IRI, and other point-of-sale data sources. This role is pivotal in owning the ETL processes, developing Power BI dashboards, and supporting our data analysts in report and dashboard creation. The ideal candidate will be adept at developing architecture such as databases and large-scale processing systems and aligning data projects with organizational goals. This position is also responsible for guiding and managing the third-party resources contracted for data analytics projects.
Essential Job Duties & Responsibilities:
- Design, construct, test, and maintain robust data architectures to align with business requirements.
- Build and manage API’s for data extraction and transformation.
- Develop and optimize ETL processes for efficient data extraction, transformation, and loading from various sources.
- Develop data extracts to feed data warehouse data to other internal and/or external systems.
- Create and manage Power BI dashboards and reports, providing actionable insights to business stakeholders.
- Assist data analysts in the development of reports and dashboards, ensuring data accuracy and relevance.
- Maintain and improve SQL, Power BI, Cognos, and other data engineering tools and practices.
- Collaborate with various departments to understand data needs and provide technical solutions that align with business objectives.
- Ensure data integrity and security, adhering to data governance and compliance standards.
- Continuously evaluate and recommend improvements to existing data systems and processes.
- Conduct research for industry and business questions using large data sets.
- Recommend ways to improve data reliability, efficiency, and quality.
- Deliver Data Analytics using AI.
Required Skills/Qualifications:
- Bachelor’s degree in Computer Science, IT, or related field
- Proven experience in data engineering, especially in a manufacturing/distribution environment.
- Extensive experience in data collection and standardizing database schema to accommodate bespoke data sources
- Proficiency in SQL, JSON, XML. Power BI, Cognos, Python, and other relevant tools.
- Strong understanding of ETL processes and tools (like Fivtran, SSIS, Azure Data Factory Pipelines).
- Experience Building/managing API.
- Experience with data warehouse design and management.
- Experience Building Database Objects (Design and create schemas, tables, views, and indexes)
- Experience Writing Code (complex stored procedures, functions, and triggers)
- Experience Optimizing Performance (Query Optimization, Execution Plans, Index Management)
- Experience with Analysis Services, multi-dimensional databases, parent child dimensions, alternate hierarchies, OLAP/ROLAP cubes.
- Experience deploying database on SQL server with role-based access control (RBAC) for admins and users.
- Prefer experience with Microsoft Fabric, Azure Data Factory, Data Lake)
- Prefer Experience configuring MCP Servers connecting data models to LLMs
- Excellent problem-solving skills and attention to detail.
- Ability to work collaboratively in a team environment and communicate effectively with non-technical stakeholders
Benefits
Medical insurance, Vision insurance, Dental insurance, 401(k)