Azure Data Engineer I
Remote · Latin America · Full-time
We’re looking for an Azure Data Engineer to join a team building and modernizing enterprise-scale data platforms. This role will focus on developing scalable data pipelines, data models, and lakehouse solutions using Databricks, Apache Spark, Python, and SQL.
You’ll work closely with data architects, analytics teams, product managers, and business stakeholders to build reliable data solutions that support reporting, analytics, AI, and operational decision-making.
Responsibilities
- Design, develop, and maintain scalable batch and streaming data pipelines using Databricks and Apache Spark.
- Build ETL/ELT pipelines using PySpark, Spark SQL, Delta Lake, Python, and SQL.
- Develop enterprise data models and business-ready datasets for analytics and reporting.
- Implement Bronze, Silver, and Gold layers using Medallion Architecture.
- Work with data from ERP, manufacturing, supply chain, CRM, IoT, and other enterprise systems.
- Optimize Spark jobs and data models for performance, scalability, and cost efficiency.
- Contribute to data quality, lineage, monitoring, testing, and CI/CD practices.
- Help modernize legacy data pipelines and platforms onto Databricks.
- Collaborate with technical and business stakeholders to translate requirements into scalable data solutions.
- Promote engineering best practices and contribute to a culture of quality and continuous improvement.
Requirements
- Bachelor’s or Master’s degree in Computer Science, Engineering, Information Systems, or a related field.
- 5–8+ years of experience in Data Engineering, Data Warehousing, or Big Data development.
- 3+ years of hands-on experience with Databricks and Apache Spark.
- Strong experience with data modeling and enterprise data structures.
- Advanced proficiency in PySpark, Python, Spark SQL, and SQL.
- Hands-on experience with the Databricks Lakehouse Platform and Delta Lake.
- Experience with Unity Catalog, Databricks Workflows, and Structured Streaming.
- Strong understanding of dimensional modeling, including Star and Snowflake schemas.
- Experience working with cloud-based data platforms, preferably Azure.
- Familiarity with Git, CI/CD, Infrastructure as Code, and data quality/monitoring practices.
- Strong analytical, problem-solving, communication, and stakeholder management skills.
- Ability to work effectively in large-scale data transformation initiatives.
Nice to Have
- Experience with Delta Live Tables.
- Knowledge of Data Vault modeling.
- Experience with SAP ECC/S4HANA, MES, WMS, TMS, IoT, or production telemetry data.
- Experience in manufacturing, CPG, food & beverage, supply chain, or logistics analytics.
- Experience mentoring junior engineers or influencing engineering and architecture decisions.
Mandatory: Databricks and strong data modeling experience.
Why join us?
- Competitive compensation paid in USD.
- 100% Remote.
- Paid Time Off: 12 PTO days per year.
- Local Holidays: All official holidays in your country.
- Birthday Off.
- Career Growth opportunities.
- Recognition Program.
- Paid approved leaves