Sr Big Data Engineer
AccionLabs · Singapore, sg ·
- Seniority
- Senior
- Category
- Data engineering
- Experience
- 3+ years
AccionLabs · Singapore, sg ·
Role:- Sr Big Data Engineer
Job Description
· 3+ years of professional software development experience with languages and systems such as Java, Python (PySpark), and version control (git), with good analytical & debugging skills.
· Big data: You have extensive experience with data analytics, and working knowledge of big data infrastructure such as Hadoop Eco System, HDFS, Spark, and AWS or Google or Azure (nice to have). You've routinely built data pipelines with gigabytes/terabytes of data and understand the challenges of manipulating such large datasets.
· Data Modeling: Flair for data, schema, data model, PL/SQL,Star & snow flake schema, how to bring efficiency in data modeling for efficient querying data for analysis, understands criticality TDD and develops data validation techniques.
· Real Time Systems: Understands evolution of databases for in-memory, NoSQL& indexing technologies along with experience on real-time & stream processing systems like kafka, Storm.
· Project management: You demonstrate excellent project and time management skills, exposure to scrum or other agile practices in JIRA.
· CS fundamentals: You have earned at least a B.S. / MS in Computer Science, or related degree AND you have a strong ethos of continuous learning.
All your information will be kept confidential according to EEO guidelines.