Hadoop & Kafka Admin

Role: Hadoop / Kafka Admin

Job-type: Fulltime (Hybrid)

Location: Austin / Palo Alto

Job Description:

Person will be responsible to Perform Big Data Platform Administration and Engineering activities on multiple Hadoop, Kafka, Hbase and Spark clusters

Work on Performance Tuning and Increase Operational efficiency on a continuous basis

Monitor health of the platforms and Generate Performance Reports and Monitor and provide continuous improvements

Working closely with development, engineering, and operation teams, jointly work on key deliverables ensuring production scalability and stability

Develop and enhance platform best practices

Ensure the Hadoop platform can effectively meet performance & SLA requirements

Responsible for Big Data Production environment which includes Hadoop (HDFS and YARN), Hive, Spark, Livy, SOLR, Oozie, Kafka, Airflow, Nifi, Hbase etc

Perform optimization, debugging and capacity planning of a Big Data cluster

Perform security remediation, automation and selfheal as per the requirement

Hands on Experience in Hadoop Admin, Hive, Spark, Kafka, experience in maintaining, optimization, issue resolution of Big Data large scale clusters, supporting Business users and Batch process.

Hands-on Experience No SQL Databases HBASE is plus

Prior Experience in Linux / Unix OS Services, Administration, Shell, awk scripting is a plus

Excellent oral and written communication, analytical and problem-solving skills

Self-driven, Ability to work independently and as part of a team with proven track record

Experience on Hortonworks distribution or Open Source preferred.