Senior Data Engineer
idt · Bogotá ·
- Work mode
- Remote
- Seniority
- Senior
- Employment
- Contract
- Category
- Data engineering
- Experience
- 8+ years
- Company size
- 1000+
idt · Bogotá ·
onhires · Latin America
corespecialtyinsurance · TX Dallas
aimpoint-digital · Atlanta, United States
NielsenIQ · Ciudad de México, DIF, mx
IDT Corporation (global communications & payments company) is hiring a LATAM-based Senior Data Engineer for its BI team to design, build, and maintain end-to-end data pipelines and warehouse architecture powering LLM-driven apps and AI-based BI. Core stack: Python, SQL/PLSQL, Spark, Hadoop, Kafka, Snowflake/Redshift, plus vector stores and LLM frameworks like LangChain.
Demonstrated experience in utilizing Python for data engineering tasks, including transformation, advanced data manipulation, and large-scale data processing.
Hands-on experience with big data technologies including Apache Spark, Hadoop, and Kafka for distributed processing and real-time data ingestion.
Experience designing complex data pipelines extracting data from RDBMS, JSON, API, and Flat file sources.
Demonstrated skills in SQL and PLSQL programming, with advanced mastery in Business Intelligence and data warehouse methodologies, along with hands-on experience in one or more relational database systems and cloud-based database services such as Snowflake/Redshift
Understanding of software engineering principles and skills working on Unix/Linux/Windows Operating systems, and experience with Agile methodologies.
Proficiency in version control systems, with experience in managing code repositories, branching, merging, and collaborating within a distributed development environment.
Effective oral and written English communication skills with BI team and user community.
IDT Corporation is a global communications company founded in 1990 and headquartered in Newark, New Jersey. We are industry leaders in prepaid communication and payment services and one of the largest international voice carriers. We are listed on the NYSE, employ over 1800 people across 20 countries, and have over $1.5 billion in revenues.
IDT is not ”another big IT corporation”— we encourage and support in-house entrepreneurs in developing their ideas into business actions.
Our flagship brand, BOSS Revolution, offers Money Transfer, International Calling, and Mobile Top-Up services and supports IDT’s mission of enabling people to keep in touch and share resources with family and friends worldwide.
E-Merge IT Recruitment · Johannesburg, South Africa