Senior Data Engineer

Iris's Fortune 100 direct client is looking for Senior Data Engineer.

Key Responsibilities

• Lead the migration of enterprise data platforms from Netezza and SSIS to AWS-native data architectures using Glue, PySpark, S3, Redshift, and Lambda.
• Design, develop, and validate scalable ETL/ELT migration patterns, ensuring functional parity and performance optimization between legacy and target platforms.
• Provide hands-on architecture leadership with active involvement in data engineering, coding, troubleshooting, and performance tuning across AWS services.
• Own end-to-end data migration and reconciliation strategy, including source-to-target validation, data completeness checks, and exception management.
• Design and implement robust data quality, auditability, lineage, and regulatory reporting controls to support enterprise risk and compliance requirements.
• Optimize Amazon Redshift data models, schema design, workload management, and query performance for large-scale reporting and batch processing workloads.
• Develop and enhance AWS Glue and PySpark pipelines for data ingestion, transformation, enrichment, and orchestration across multiple source systems.
• Lead the modernization of legacy Netezza SQL, nz_unload processes, and SSIS workflows, ensuring efficient conversion to cloud-native solutions.
• Define and enforce PII protection, encryption standards, data governance policies, and secure data handling practices throughout the migration lifecycle.
• Collaborate with risk, analytics, and data science teams to enable data consumption for risk models, scoring engines, model inference pipelines, and reporting platforms.
• Implement and support CI/CD, deployment automation, and workflow orchestration using Airflow, Glue Workflows, or equivalent tools to ensure reliable production operations.
• Provide technical leadership, code reviews, architecture governance, and best-practice guidance while ensuring successful delivery of large-scale Netezza-to-AWS migration initiatives.

About Iris Software Inc.

With 4,000+ associates and offices in India, U.S.A. and Canada, Iris Software delivers technology services and solutions that help clients complete fast, far-reaching digital transformations and achieve their business goals. A strategic partner to Fortune 500 and other top companies in financial services and many other industries, Iris provides a value-driven approach - a unique blend of highly-skilled specialists, software engineering expertise, cutting-edge technology, and flexible engagement models. High customer satisfaction has translated into long-standing relationships and preferred-partner status with many of our clients, who rely on our 30+ years of technical and domain expertise to future-proof their enterprises. Associates of Iris work on mission-critical applications supported by a workplace culture that has won numerous awards in the last few years, including Certified Great Place to Work in India; Top 25 GPW in IT & IT-BPM; Ambition Box Best Place to Work, #3 in IT/ITES; and Top Workplace NJ-USA.