WE ARE HIRING: Technical Lead – Data Engineering
Location: Sri Lanka
Employment Type: Contract
Industry: Information Technology
Role Overview
We are seeking an experienced and highly capable Technical Lead – Data Engineering to lead the design, development, and optimization of large-scale data processing solutions supporting enterprise-scale operations. The successful candidate will provide technical leadership across enterprise data platforms, mentor engineering teams, drive best practices in data architecture and software engineering, and contribute to highly scalable data solutions that process large volumes of business-critical information. This role is ideal for a hands-on technical leader who enjoys solving complex data engineering challenges, guiding development teams, and driving innovation within a fast-paced enterprise technology environment.
Key Responsibilities
- Design and develop enterprise-grade data engineering solutions supporting large-scale business operations.
- Lead the architecture, design, and implementation of highly scalable data processing applications.
- Provide technical leadership and mentorship to Data Engineers and development teams.
- Drive best practices across software engineering, coding standards, code reviews, and solution design.
- Develop and maintain enterprise ETL pipelines capable of processing large volumes of structured and unstructured data.
- Create scalable and reliable data integration frameworks supporting business intelligence and analytics initiatives.
- Design distributed data processing solutions using modern data engineering technologies.
- Ensure high performance, reliability, scalability, and maintainability of data platforms.
- Optimize data processing workflows, database performance, and data storage architectures.
- Lead technical discussions relating to data architecture, infrastructure, and engineering solutions.
- Work closely with Product Owners, Architects, Business Stakeholders, and Project Teams to define technical solutions.
- Drive Continuous Integration and Continuous Delivery (CI/CD) practices within the engineering environment.
- Support production environments through troubleshooting, root cause analysis, and performance tuning initiatives.
- Collaborate with DevOps and Infrastructure teams to support deployments and platform stability.
- Contribute to Agile delivery processes including sprint planning, estimation, backlog refinement, and technical reviews.
- Promote innovation and continuous improvement through evaluation of emerging technologies and engineering practices.
Candidate Profile
- Bachelor's Degree in Computer Science or an equivalent qualification.
- 5–6+ years of experience developing enterprise-grade data processing applications and integration solutions.
- Previous experience leading technical teams and mentoring engineers.
- Strong experience processing large volumes of data using distributed data processing frameworks.
- Hands-on expertise in Apache Spark and large-scale ETL development.
- Strong database development and optimization experience, preferably using MySQL.
- Strong understanding of database architecture, OLTP, OLAP, indexing strategies, query optimization, and performance tuning.
- Experience developing scalable data pipelines, integration platforms, and enterprise data solutions.
- Strong software engineering background with knowledge of design patterns, UML, and enterprise architecture principles.
- Experience with Big Data technologies such as Hadoop, Elasticsearch, CouchDB, MongoDB, or similar platforms will be an advantage.
- Experience working within Agile Scrum environments.
- Good understanding of DevOps principles, source control, and CI/CD methodologies.
- Experience working with cloud platforms, particularly AWS, will be an added advantage.
- Strong analytical and problem-solving capabilities.
- Excellent leadership, communication, and stakeholder management skills.
- Ability to influence technical direction and drive engineering excellence across teams.
- Passion for data engineering, innovation, and continuous learning.
Ready to take your career to new heights?
We're InTalent Asia, your go-to recruitment partner in Sri Lanka, and we've got an exciting opportunity for you!
Our client is looking for a skilled individual to fill the role of Technical Lead – Data Engineering.
Apply now and see how you can be the perfect fit for this exclusive position!
#InTalentAsia #CareerOpportunity #JobVacancy #TechnicalLead #DataEngineering #BigData #ApacheSpark #ETL #MySQL #AWS #DataArchitecture #SoftwareEngineering #ElevateYourCareer