Job Title: Hadoop Engineer
End Client: Morgan Stanley (Finance Industry)
Work Location: Onsite Hybrid Alpharetta GA
Interview Mode: 2 Video Sessions followed by In-person
Duration: 12 months
Visa: No OPT CPT TN
Skills kept in BOLD are required please review the below JD with your candidate and submit matching profiles
Required Skills:
- 7 years of IT experience with knowledge of Hadoop services - HDFS Hive HBase Impala Hue Ranger etc.
- Expert in setting up Hadoop cluster from scratch and server maintenance.
- Commissioning and decommissioning of the nodes to/from Hadoop cluster.
- Experience with Cloudera CDP Hadoop upgrade.
- Implementing managing and administering the overall Hadoop infrastructure
- Capacity planning and estimating the requirements for lowering or increasing the capacity of the Hadoop cluster.
- Monitoring the Hadoop cluster connectivity and performance of the cluster for application teams.
- Replicating huge amount data from one Hadoop cluster to another.
- Applying encryption to secure the data in the Hadoop cluster.
- Applying the configuration changes and testing the cluster in collaboration with the application teams and business users.
- Experience with access management and setting up user roles in Hadoop
- Able to create and debug complex Unix shell scripts.
- Nice to have Analyzing and troubleshooting the issues with the clusters.
- Nice to have Set up and maintain appropriate infrastructure to maintain performance and data integrity.
- Nice to have Experience with ELK Stack: Elasticsearch Logstash Kibana Apache Hadoop
- Nice to have Ensuring appropriate monitoring & alerting of Elasticsearch cluster.
- Nice to have Expert in networking and security settings to support network related pipelines.
- Nice to have Good to have Ruby and/or Python Unix and GIT Knowledge.
- Excellent verbal and written communication skills analytical and problem-solving skills and a good team player.
Please send your resumes to:
Sireesha P
Vikas K