Data Engineer

We are looking for a Data Engineer to build and maintain scalable data pipelines and integrations supporting CRM operations, data matching, and reporting. You’ll work closely with Full Stack Engineers and internal data teams.

Key Requirements

• Strong hands-on experience with AWS: S3, RDS/PostgreSQL, IAM, EMR, Glue, Athena, and Redshift.
• Strong Apache Spark experience for transformations, joins, calculations, and batch processing.
• Solid expertise in ETL/ELT, data modeling, schema design, data quality, reconciliation, metadata, and data lineage.
• Advanced SQL skills, including complex transformations, validation, and performance optimization.
• Experience with Git, CI/CD, automated data testing, parameterization, monitoring, logging, and production support.
• Strong understanding of data security, including IAM, least privilege, encryption, and secrets management.
• Experience building scalable, reliable, and production-ready data pipelines.
• Exposure to near-real-time processing is a plus.

What You’ll Do

• Design and maintain data ingestion, transformation, and publishing pipelines.
• Analyze source systems and define data contracts and integration requirements.
• Develop data models for customer profiles, opportunities, matching, tracking, and reporting.
• Implement data quality checks, reconciliation, error handling, monitoring, and traceability.
• Optimize data workloads for performance, scalability, and cost efficiency.
• Partner with Full Stack teams to enable effective application data consumption.
• Maintain documentation for data lineage, dependencies, business rules, and recovery procedures.