Software Data Engineer - Spark & Python

Software Data Engineer - Spark & Python

Location: Warsaw
Contract Type: 6 Months

Job type: On-site

• Work on large-scale data platforms using Apache Spark and Python
• Join a collaborative, cross-functional team operating in a hybrid model
• Apply 6-8 years of experience to solve complex data engineering challenges
• Leverage your Java and software engineering expertise in a technical role
• Contract opportunity based in Warsaw with flexible working arrangements

Company Overview

Our client is an established organisation operating across the technology and data sectors. They focus on building robust data platforms and distributed systems that process information at scale. The company values strong engineering fundamentals and collaborative ways of working, bringing together cross-functional teams across different locations to deliver technical solutions.

They are currently seeking an experienced Software Data Engineer to join their team in Warsaw on a contract basis, offering the opportunity to work with modern data technologies and contribute to large-scale data processing initiatives.

Position Overview

As a Software Data Engineer, you'll play a key role in developing and maintaining data platforms that handle distributed data processing at scale. You'll work with Apache Spark and Python to build reliable data pipelines and systems, collaborating with virtual teams across different functions and locations. This position requires solid software engineering skills and the ability to work effectively in a hybrid pod model, contributing to technical solutions that support the organisation's data infrastructure.

Responsibilities

• Develop data processing solutions using Python and Apache Spark (PySpark)
• Build and maintain scalable data pipelines for large-scale data platforms
• Apply software engineering best practices to ensure code quality and reliability
• Collaborate with cross-functional teams across different locations in a hybrid model
• Design and implement distributed data processing systems
• Work with Java-based systems and integrate data solutions where required
• Contribute to technical decisions and architecture discussions
• Support the development and improvement of data platform capabilities

Requirements

• Strong Python development skills with proven professional experience
• Hands-on experience with Apache Spark, specifically PySpark
• Java knowledge from current or previous professional roles
• Solid understanding of software engineering fundamentals and development best practices
• 6-8 years of relevant experience in software or data engineering
• Ability to work effectively in hybrid, cross-functional teams
• Experience collaborating with virtual teams across different locations
• Scala experience (desirable but not essential)
• Experience with distributed data processing and large-scale data platforms (desirable but not essential)

Please note: Databricks experience is not required. Spark expertise is the key requirement for this role.

Benefits

While specific benefits have not been detailed for this contract position, you'll have the opportunity to work with modern data technologies including Apache Spark and Python, applying your skills to large-scale data challenges. You'll collaborate with cross-functional teams in a hybrid working environment, gaining exposure to distributed data processing systems and contributing to technical solutions that operate at scale.