Big Data Engineer

Описание

The Corporate and Investment Banking division at SG Group is building a data platform that supports business processes and structured finance activities within the GLBA business line. Its team develops data solutions using big data technologies for a financing datahub.

Задачи

Design and develop solutions for collecting, transforming, and processing large datasets Analyze data from multiple sources and translate findings into technical specifications Industrialize data processing to improve reliability, robustness, efficiency, and resilience Develop data collection and processing jobs, and data mapping using Spark and Scala Conduct code reviews and collaborate with team members on continuous improvement Contribute to agile feature teams and advance agile best practices Deliver IT solutions in Scrum cycles of 2–3 weeks with tangible business value Recommend and contribute to big data architecture strategies Stay up to date with emerging data technologies and implement best practices Support applications and troubleshoot production issues as needed Ensure code quality and maintainability using BDD, TDD, clean code, and DevOps practices Produce technical documentation, test plans, and project deliverables Identify potential project risks related to costs and deadlines, and propose mitigation strategies

Требования

3–5 Years of professional experience in big data engineering; a banking background is preferred Fluency in English Expertise in Spark, Scala, and SQL Additional knowledge of Python, Java, DevOps, Big Data, CI/CD tools, microservices, APIs, Airflow, and GIT Strong analytical and problem-solving skills Proactive attitude and strong teamwork ability Effective communication skills Ability to work in a global team across different time zones Strong planning and prioritization skills Будет плюсом: Polish, French

Условия

Competitive salary based on seniority and skills Work in a brand-new office in central Warsaw, designed with facilities for people with disabilities Access to educational platforms and language courses Stability and support with quick adaptation to the company Extraordinary health package with extensive dental care Hybrid work with 2 or 3 days per week in the office One-time bonus for home office equipment Meal allowance, holiday fund, sports card, and insurance Only resumes in English are accepted Employees can dedicate several days per year during working hours to solidarity actions, including supporting people with orientation or professional integration, financial education for young apprentices, and sharing skills with charities