We are seeking an experienced and driven Senior Data Engineer to join our expanding Data Engineering team.
This position involves working as part of one of our established Platform Teams, where you will design, develop, and scale data pipelines in Databricks with PySpark on Microsoft Azure, empowering our AI Factory teams to create and deploy advanced machine learning solutions.
This role offers the chance to contribute at the nexus of big data, cloud engineering, and MLOps, delivering reliable, scalable, and high-performance data platforms that support innovation across the organization.
Responsibilities
- Design cloud-native analytical solutions using Big Data and NoSQL technologies
- Build scalable data pipelines in Databricks with PySpark on Azure
- Collaborate with MLOps and ML Engineering teams to deliver data platforms for AI development and deployment
- Support requirements gathering and deliver aligned solutions with architects, technical leads, and cross-functional teams
- Assist the SAP Platform Team in utilizing SAP BTP and hyperscaler offerings for enterprise-grade data solutions
- Conduct code reviews to ensure technical standards and practices are maintained
- Provide mentorship to junior engineers to cultivate a high-performance culture
- Incorporate CI/CD methodologies into data engineering workflows using tools like Jenkins or GitLab CI/CD
- Engage with stakeholders to understand processes, model input data, and ensure deliverable alignment
Requirements
- 4+ years of experience in Software Engineering with a focus on Data Engineering, Machine Learning, or MLOps
- Proficiency in Python and PySpark
- Background in Databricks and Microsoft Azure cloud services
- Knowledge of software version control tools, including GitHub or Git
- Capability to work with CI/CD frameworks such as Jenkins, Concourse, or GitLab CI/CD
- Expertise in building scalable, robust, and available data solutions
- Competency in problem-solving and analytical skills, along with effective stakeholder engagement
Nice to have
- Skills in an additional programming language like Java, SQL, or Scala
- Understanding of SAP BTP or similar enterprise data platforms
- Familiarity with agile development environments
Benefits
- Opportunity to Engineer your Future and to drive the world’s digital transformation with top industry clients
- Personal development program that will allow you to be valued for your strengths
- Wide range of professional trainings and workshops
- Being part of a collaborative, fast-growing, and innovative design team
- Established and accelerated growth toward different career paths, competencies, and roles
- Broad projects variety and possible mobility between projects over the time
- Collaboration in a multicultural environment and exchange of best practices with colleagues around the world
- Varied social benefits, Sports, Transportation and Health programs
- Work-life balance and flexible schedule, team buildings and sport opportunities
- Modern office/collaboration spaces (incl. new Infinity Tower business center, Sofia)
- Hybrid By Design - we provide you with the best productivity options from the 2 worlds. Meet, socialize and enjoy F2F time with your colleagues, while working from the modern EPAM's office for a few days per week and benefit from the EPAM's virtual working environment - making you able to be productive and work from remote for the rest of the week