Hadoop Engineer
Share
Job Location:
Austin, TX - USA
Monthly Salary:
Not Disclosed
Posted on:
2 days ago
Vacancies:
1 Vacancy
Job Summary
Job Title : Hadoop Engineer
Experience Required - 10 Years
Must Have Technical/Functional Skills
Performance tuning of Hadoop clusters and Hadoop workloads.
Screen Hadoop cluster job performances and capacity planning at application/queue level
Monitor Hadoop cluster connectivity and security
Manage and review Hadoop log files.
File system management and monitoring.
implementation and ongoing administration of Hadoop infrastructure
Screen Hadoop cluster job performances and capacity planning at application/queue level
Monitor Hadoop cluster connectivity and security
Manage and review Hadoop log files.
Roles & Responsibilities
Responsible for implementation and ongoing administration of Hadoop infrastructure.
Aligning with the systems engineering team to propose and deploy new hardware and software environments required for Hadoop and to expand existing environments.
Working with data delivery teams to setup new Hadoop users/applications. This job includes onboarding activities like setting up Linux users setting up Kerberos principals and testing HDFS Hive Pig Spark and MapReduce access for the new users/applications.
Cluster maintenance as well as creation and removal of nodes using tools like Ambari and other home-grown tools.
Performance tuning of Hadoop clusters and Hadoop workloads.
Screen Hadoop cluster job performances and capacity planning at application/queue level
Monitor Hadoop cluster connectivity and security
Manage and review Hadoop log files.
File system management and monitoring.
HDFS support and maintenance.
Diligently teaming with the infrastructure network database application and business intelligence teams to guarantee high data quality and availability.
Collaborating with application teams to install operating system and Hadoop updates patches version upgrades when required.
Optimize analytical jobs and queries against data in the HDFS/Hive environments
Develop considerable bash shell or python scripts LINUX utilities & LINUX Commands to ease day to day operations
Maintain central dashboards for all System Data Utilization and availability metrics
Salary Range - $100000 to $150000
TCS Employee Benefits Summary
Discretionary Annual Incentive
Comprehensive Medical Coverage Medical and Health Dental & Vision Disability Planning & Insurance Pet Insurance Plans
Family Support Maternal and Parental Leaves
Insurance Options Auto and Home Insurance Identity Theft Protection.
Convenience and Professional Growth Commuter Benefits and Certification and Training Reimbursement.
Time Off Vacation Time Off Sick Leave and Holidays.
Legal and Financial Assistance Legal Assistance 401K Plan Performance Bonus College Fund Student Loan Refinancing.
Key Skills
- ASP.NET
- Health Education
- Fashion Designing
- Fiber
- Investigation
