Job Summary
We are seeking a skilled Data Engineer to join our team and contribute to designing, developing, and managing data solutions, including pipelines and data warehouses. The ideal candidate will handle high-volume data processing, integrate complex data structures, and optimize data storage solutions. You will ensure data reliability, quality, and compliance while collaborating on analytics and business intelligence projects in a diverse technological environment.
Must-Have Skillsets (Mandatory)
- Expertise in Advanced SQL, PLSQL, and handling bulk data processing.
- Proficiency with databases like Amazon Redshift, Oracle, SQL Server, MySQL, and Postgres.
- Experience in data modeling, including Star/Dimensional modeling.
- Knowledge of Data Warehouse development and ETL processes.
- Experience with structured and semi-structured data ingestion.
- Familiarity with big data platforms and technologies such as Hadoop, Scala, Spark, Hive, Shell Scripting, and AWS tools like EMR, Lambda, Glue, and Step Function.
- Strong problem-solving, debugging, and performance-tuning skills.
- Ability to design and optimize data storage and manage data governance principles.
Good-to-Have Skillsets (Optional)
- Hands-on experience with Hadoop/Big Data environments.
- Experience with streaming data platforms like Kafka or Flume.
- Knowledge of data analytics and business intelligence solutions.
- Proficiency in tools for data integration and orchestration like Sqoop.
Qualifications and Experience
- Bachelor's degree in Computer Science, Information Technology, or a related field.
- Minimum of [insert years, e.g., 4+ years] experience in database and enterprise data warehouse development.
- Proven track record of developing and managing complex data pipelines and integrating diverse data sources.
- Strong analytical and numerical skills with attention to detail.
This role is ideal for a dynamic professional eager to innovate in a data-driven environment and contribute to transformative projects.