Aws Data Engineer

Job Overview

We are seeking a skilled and experienced Data Engineer to join our dynamic team. In this role, you will be responsible for developing, testing, improving, and maintaining new and existing databases to help users retrieve data effectively. As a data engineer, you will work closely with our data team to optimize our data systems and pipeline architecture, develop set processes for data mining, data modeling, and data production. The ideal candidate should be an analytical problem solver, have a deep understanding of data relationship complexities, and be able to strategize and implement database solutions that support and enhance our company's data systems and data quality.

Responsibilities

• Develop, construct, test, and maintain architectures such as databases and large-scale processing systems.
• Discover opportunities for data acquisition and new uses for existing data.
• Develop data set processes for data modeling, mining, and production.
• Employ a variety of languages and tools to marry systems together or try to hunt down opportunities to acquire new data from other systems.

Required Skills

• Proficiency in SQL and NoSQL databases.
• Strong knowledge of Python, Java, or Scala.
• Experience with data pipeline and workflow management tools.
• The candidate must have a Bachelor's degree in Computer Science, Software Engineering, or a related field. A Master's degree or further education in Data Science or a related field is preferred.

Preferred Skills

• Familiarity with cloud services like AWS, Google Cloud, or Azure.
• Experience with big data tools: Hadoop, Spark, Kafka, etc.
• Knowledge of data integration tools like Informatica, Talend, etc.
• Understanding of machine learning algorithms and statistics.
• Experience with data visualization tools like Tableau, PowerBI, etc.
• Knowledge of data warehousing solutions and ETL tools.
• Familiarity with data architecture and data modeling techniques.
• Experience with stream-processing systems: Storm, Spark-Streaming, etc.
• Knowledge of software development methodologies like Agile/Scrum.
• Understanding of data privacy and governance.

Required Experience

10-15yrs