Hadoop Developer needs 5+ years of Python, Java/ Scala.
Hadoop Developer requires:
B.S. and M.S. in mathematics, computer science or engineering
3+ years of demonstrated technical proficiency with SPARK, big data projects, and experience in data modeling.
Experience designing and developing data ingestion and processing/transformation frameworks leveraging tools such as ADF, NiFi, Sqoop, Eclipse
Should have worked in Big data space for at least 5 years in Apache Spark, Hive and MapReduce. Experience with a variety of Big Data ETL tools, e.g. Spark, Hive, Kafka, Sqoop, MapReduce, Scala, Zookeeper, Etc
Should have experience in Cloudera or Hortonworks and exposure to Teradata is beneficial.
Hadoop Developer duties:
Translate complex functional and technical requirements into detailed design
Proficiency in SPARK for technical development and implementation
Load disparate data sets by leveraging various big data technology (Kafka)
Ability to utilize Hive, Spark, Cassandra, MLlib, Typescript,NodeJS, Pyspark, Eclipse