Datalake Architect
MhyMatch ·
- Employment
- Full time
- Category
- Architecture
- Experience
- 7+ years
MhyMatch ·
QBrainX · Coimbatore South, India
Guidehouse · US - VA, Arlington
Nexus Recruitment Group · Makati, Metro Manila, Philippines
pwc · London - 7 Morelondon Riverside
iLink Digital · Bangalore North, India
1. Design and implement scalable data architectures using Databricks to meet the specific needs of financial services, such as risk management, compliance, and customer analytics.
2. Conduct assessments of existing data architectures to identify areas of improvement and recommend remediation plans to optimize data management processes and systems.
3. Develop data migration strategies and oversee the execution of data migration activities to ensure data integrity and minimal disruption to client operations.
4. Build and optimize data ingestion and processing pipelines to facilitate real-time analytics and reporting.
5. Collaborate with business units to understand their data requirements and translate them into technical specifications that align with business goals.
6. Ensure data solutions adhere to financial regulations and best practices in data governance, including data security and privacy standards.
7. Monitor and tune the performance of data systems to ensure efficiency and reliability, addressing any bottlenecks or issues that arise.
8. Provide guidance to junior data engineers and analysts to promote a culture of continuous improvement and skill development.
9. Develop and maintain comprehensive documentation for data architectures, including architecture diagrams, deployment guides, and operational procedures.
10. Lead the design and implementation of data artifacts, including data modeling, data integration, data storage, and data governance based on industry best practices and client-specific requirements.
11. Stay informed about the latest industry trends, tools, and techniques in Databricks Platform Architecture to drive innovation and maintain competitive advantage.
12. Ensure availability during month-end deck generation, including weekends or holidays, to support critical business operations.