Senior Data Engineer
remotestar-team · Karnataka, Bengaluru, India ·
- Work mode
- Hybrid
- Seniority
- Senior
- Category
- Data engineering
- Experience
- 7+ years
- Visa sponsorship
- No
- Company size
- 501-1000
remotestar-team · Karnataka, Bengaluru, India ·
Client Server · London, United Kingdom
Talentedge · Kraków, Poland
NPAworldwide · Manchester, United Kingdom
Bravo · Maadi, Al Qāhirah, Egypt
Senior Data Engineer builds and maintains data governance tools and risk reports using Python, SQL, and GCP, while improving pipelines and participating in Agile workflows for a global fintech company.
About Client: A FTSE 250 global fintech company headquartered in London with a presence
in 18 countries and five continents. Their award-winning products and platforms empower
go-getters worldwide, giving them access to over 19,000 financial markets.
About Client: A FTSE 250 global fintech company headquartered in London with a presence in 18
countries and five continents. Their award-winning products and platforms empower go-getters
around the world giving them access to over 19,000 financial markets
Your task will be to run a project generating risk reports important for the entire company. The tool is currently under consideration for a complete renovation. The main scope of responsibilities is the implementation of new functionalities, adding new reports, writing tests, pipeline analysis and active participation in the team's scrum life. Technologies used: Python, pandas, numpy, Kafka, Airflow, Rest, GCP, bash. Candidates do not need to have big data knowledge or a lot of cloud experience - it's important that you are willing to expand your skills!
What you’ll do
You will be responsible to ensure a high quality deliverable within Data Engineering Team.
You will be:
Adding new reports
Writing tests
Building deployment pipeline
Analyze and design technical solutions
Actively participate in the team's scrum life
What you’ll need for this role
You will be someone who has 7+ years of experience on the below areas:
Strong experience in Python
Data processing (pandas/pyspark)
Good experience of SQL & GCP
Understanding development life-cycle (CI/CD, Gitlab)
Unit testing
DBT
Cloud
It would be great if you have experience on:
Apache Kafka
Apache Spark
Message formats AVRO/Parquet/ORC/Json
Terraform
The perks
It really is more than a job. We’ll recognize your talent and make sure that you can still have a life – at work, and outside of it. Networks, committees, awards, sports and social clubs, mentorship, volunteering opportunities, extra time off… the list goes on.
• Matched giving for your fundraising activity
• Flexible working hours and work-from-home opportunities
• Performance-related bonuses
• Insurance and medical plans
• Career-focused technical and leadership training's in-class and online, including unlimited access to LinkedIn Learning platform.
• Contribution to gym memberships and more
• A day off on your birthday
• Two days’ volunteering leave per year
Where you’ll work
They follow a hybrid working model; they reckon it’s the best of both worlds. This model also feeds into their secret ingredients for innovation: diversity, flexibility, and close connection.
Plus, you’ll be welcomed into a diverse and inclusive workforce with a lot of creative energy.
Ask their employees what their favorite thing is about working with them, and you’ll hear an echo of
‘their culture’! That’s because you can come to work as your authentic self. The things that make you, you – like your ethnicity, sexual orientation, faith, age, gender identity/expression or physical capacity – can bring a fresh perspective or new skill to their business.
That’s why they welcome people from various walks of life; and anyone who wants to help them realize their vision and strategy.
So, if you’re keen to connect with our values, and lead the charge on innovation, you know what to do.
Valtech · Bengaluru