Senior Data Engineer

Senior Data engineer

Role:

• 10+ years hands on experience in software development.
• Strong in algorithms and data structures, knowledge of Object-oriented design, Design Patterns
• Multi-threaded programming
• Strong troubleshooting, debugging, and analytical skills.
• Google cloud development experience

Mandatory Skills

• SQL skills (BQ, Hive and Spark)
• Spark jobs debugging and tuning
• Python, PySpark
• Good architecture skills to understand end to end flows/data pipelines
• -big data architecture, hadoop, hive, Sql, and airflow
• Knowledge of Unix, Github

Secondary skills

• Client stakeholder management
• Offshore team and delivery management
• Certification in relevant skills

Responsibilities

• The candidate must have complete understanding with hands-on experience in design, coding, and testing aspects
• Design, implement, and support multi-tier software applications, document and test systems, modify as necessary
• Work independently and with other engineers, and Ops teams, design and develop strategic and tactical processes, and create solutions that meet business requirements.
• Demonstrate thought processes in solving business and technical problems. Design and code should be easy to maintain, available, performing well, and can be reused across a sub-system or feature. Code may persist for the lifetime of a software version.
• Own to deliver very high-quality code that is thoroughly tested and is supported by unit tests for a flawless execution
• Can be relied on to deliver features and sub-systems on time and to requirements
• Works well within a team and contributes effectively to the success of those they interact with regularly.

Education:

Bachelors degree in computer science, Software Engineering, MIS or equivalent combination of education and experience