Senior Big Data Software Engineer [Databricks, Azure, AI]

We are seeking a skilled Big Data Engineer to become an essential part of this forward-looking and dynamic team.

In this role, you will leverage advanced cloud technologies to deliver impactful solutions.

If you excel at tackling complex challenges, creating robust cloud-based solutions, and driving meaningful business outcomes, this opportunity offers the chance to join a fast-paced, collaborative environment where your work shapes global success.

Responsibilities

• Build scalable, cloud-based systems in Azure using tools like Azure Data Factory, Azure Data Lake Storage, and Databricks to enhance seamless, high-performance data pipelines
• Migrate on-premises MS SQL databases to Azure Data Lake, utilizing the Delta Lake format to optimize operational performance
• Develop interfaces that connect non-Microsoft proprietary applications, enabling interoperability and unlocking valuable data insights
• Provide expertise in Data Lakes, Data Warehouses (DWH), and Delta Lakehouse architectures to guide transformative business solutions
• Assess new feature proposals, prioritize them based on business value, and collaborate to make impactful product development decisions

Requirements

• 4+ years of experience as a Data Engineer
• Background in working with Python or Scala
• Expertise with Databricks or Spark
• Experience with Clouds: AWS or Azure
• Background in working with Agile or XP methodologies, thriving in fast-moving, adaptive environments
• Experience in AI development would be a plus
• Good English communication skills (Upper-Intermediate/B2+ or higher) to engage effectively with diverse teams and stakeholders

Nice to have

• Proficiency in advanced Azure tools such as Synapse Analytics, Cosmos DB, or Apache Synapse
• Flexibility to use Core Python or Scala for automation and advanced data processing

Benefits

With us you can:

• Work on a flexible schedule remotely or from any of our comfortable offices or coworking spaces in Ukraine
• Receive the necessary equipment to perform your work tasks
• Change projects and technology stacks within EPAM
• Gain experience in various business domains (Insurance, E-commerce, Healthcare, Finance, Travelling, Media, Artificial Intelligence, and more)
• Relocation opportunities may be available for eligible candidates, depending on the role and openings at other EPAM locations
• Participate in volunteer, charity programs and communities (both technical and interest-based)

We focus on your professional growth:

• You can plan your individual career path together with your manager
• Receive regular feedback from colleagues
• Improve your English for free with certified teachers (Speaking Clubs, client interview preparation courses, etc.)
• Get the opportunity to undergo free training and certification in AWS, GCP, or Azure Clouds
• Use the internal E-learn training program (18,200+ specialized training and mentoring programs)
• Access corporate accounts on LinkedIn Learning, Get Abstract and other partner resources
• Study at EPAM Solution Architecture School with the instructors who are practicing architects
• Develop as a leader, join Delivery Management, Resource Management, Leadership Essentials school and more
• Participate in internal communities (500+ meetups, technical discussions, brainstorming sessions, online events and conferences annually)

What we offer:

• Vacation and sick leave (including a sick leave without a medical certificate)
• A wide range of Voluntary Medical Insurance programs providing both medical treatment and various preventive options (including sports activities)
• Medical insurance for family members at corporate rates
• Company support during significant life events (childbirth or adoption, marriage, etc.)
• Support for psychological comfort: discounts on services from mental health specialists or coaches, thematic training
• E-kids program - a free programming language training program for EPAMers' children