Hadoop Admin on w2 contract
Deegit · Chicago, IL, us ·
- Employment
- Contract
Hi,
Please let me know if you are comfortable for the below position
Hadoop Admin
Long term
Chicago, IL
Mandatory Skills:
1. Knowledgeable in SQL server DB
2. Aggressive self-starter, can operate without Infrastructure support
3. IOT experience
Desired Skills:
1. a. Config DB backup and recovery processes b. File system (Blob & HDFS) management and monitoring c. Manage and review Hadoop log files; house keeping d. Experience with at least one popular Hadoop flavor – Cloudera, HortonWorks, MapR e. Installation and Config of Hadoop projects such as Hive, Pig, HBase, Spark, etc. f. Performance optimization (MR job and other) g. Setup performance monitoring & tuning
2. Cloud a. Solid experience managing & administering cloud platform - Azure, AWS, BigTable, etc. b. deploying Big Data solutions in Cloud c. Cluster install & config d. Capacity estimation and configure for elasticity e. Script automation for allocation, deallocation, etc.
3. Establish Big Data Security a. Data at Rest & Transit b. Access from backend and front-end applications c. Row level security & Role based security d. integration - LDAP, AD, Okta
4. Ingestion a. Sqoop, Kakfa, Storm – highly desirable b. ADF, Informatica Cloud, etc. are definite plus c. Setup processes for historical and incremental data ingestion
5. Front-end access – Configure connectivity and interfaces enabling Cognos, Tableau, PowerBI, R, and SAS applications to access Hadoop Big data.
6. Scheduler & Runtime environment – Configure YARN and Oozie for optimal resource utilization and end-to-end workflow process.
7. Deploy and configure Neo4J (Graph DB), Document DB and emerging big data repositories 8. Big data modeling
Experience with at least one popular Hadoop flavor – Cloudera, HortonWorks, MapR e. Installation and Configration of Hadoop projects