Sr/ Lead Engineer Hadoop
Lets be unstoppable together!
At Circana we are fueled by our passion for continuous learning and growth we seek and share feedback freely and we celebrate victories both big and small in an environment that is flexible and accommodating to our work and personal lives. We have a global commitment to diversityequityand inclusion as we believe in the undeniable strength that diversity brings to our business employees clients and communities (with us you can always bring your full self to work). Join our inclusive committed team to be a challenger own outcomes and stay curious together. Learn more at .
Job Responsibilities
- Experience in installing configuration Supporting and Managing of MapR and ODP Apache Hadoop Cluster with Ambari.
- Experiencing in installing and configuring components HDFS MapReduce TEZ Hive Yarn Sqoop Oozie HBase Scala Spark Kafka in Hadoop ecosystems.
- Worked with Ambari and MCS ( MapR ) for monitoring and administrating the Hadoop Multi Node Clusters.
- Expert in Administrating and Managing ODP Apache Hadoop Cluster with Ambari DR and MapR.
- Experience in Administrating the Linux/Unix systems to deploy Hadoop Clusters.
- Expertise in Monitoring multiple Hadoop Clusters environments using Ambari Metrics MCS and Grafana.
- Configuring Name Node Data Node Resource Manager and HiveServer2 High Availability and Clusters service coordination using Zookeeper.
- Performing Backup Disaster Recovery Root Cause Analysis for Hadoop and Troubleshooting Hadoop Cluster issues.
- Importing and Exporting Data between Relational Database Systems (RDBMS) and HDFS using Sqoop.
- Hands on Experience in Configuring Kerberos for Authentication.
- Experience in maintaining and monitoring the MapR and Ambari
- Proficient in performing Minor and Major Upgrades Commissioning and Decommissioning of data nodes on Hadoop Cluster.
- Experience in integrating Hadoop Cluster components with LDAP Active Directory and enabling SSL for Hadoop Cluster Components.
- Experiencing writing Hive queries using Hive Query Language HiveQL.
- Strong working knowledge in writing queries in SQL.
- Experience in monitoring the kerberized Hadoop Cluster using Grafana.
- Experience in Installation Configuration Backup Recovery Maintenance Support of Linux.
- Extensive knowledge on Hadoop Application Frameworks like Hive and Spark.
- Experience with System Integration Capacity Planning Performance Tuning System Monitoring System Security and Load Balancing.
- Excellent Knowledge on YUM and RPM Package Administration for Installing Upgrading and Checking dependencies.
- Very good knowledge on python Familiar with Java.
- Knowledge on Sudoers Configuration and administration on Red Hat Linux Environment.
Requirements
- 5 years of Hadoop Administration and Linux/Unix Experience
- Demonstrated success in communication collaboration and motivation of cross-functional departments to achieve exceptional service.
- Strategic thinking complex problem solving and analytical capabilities.
- Excellent Communication diagnostic and issue resolution skills
- Ability to see the big-picture and take a holistic approach to problem-solving.
- Ability to take complex information and communicate in a manner that is understandable to all audiences.
- Demonstrated understanding of the evolving landscape of technology.
- Ability to effectively network with colleagues to share knowledge and gain new perspectives.
Technical Skills:
- Hadoop Distribution: MapR Apache Hadoop (ODP) Cloudera/Hortonworks.
- Hadoop Ecosystem: HDFS MapReduce YARN Hive Sqoop Zookeeper HBase Spark.
- Configuration Management: Ambari MapR and Cloudera Manager.
- Security: LDAP AD SSL and Kerberos.
- Languages: SQL Shell Scripting bash Spark SQL HiveQL.
- Databases: MySQL PostgreSQL.
- Monitoring Tools: Ambari Grafana Kibana.
- Package Management: RPM YUM.
- Networking and Protocols: LAN WAN TCP/IP NFS LDAP DNS.
- Operating Systems: RHEL Oracle Enterprise Linux Cent OS Ubuntu.
- Job Scheduling Tools: Crontab Airflow Oozie.
Circana Behaviors
As well as the technical skills experience and attributes that are required for the role our shared behaviors sit at the core of our organization. Therefore we always look for people who can continuously champion these behaviors throughout the business within their day-to-day role:
- Stay Curious: Being hungry to learn and grow always asking the big questions
- Seek Clarity: Embracing complexity to create clarity and inspire action
- Own the Outcome: Being accountable for decisions and taking ownership of our choices
- Center on the Client: Relentlessly adding value for our customers
- Be a Challenger: Never complacent always striving for continuous improvement
- Champion Inclusivity: Fostering trust in relationships engaging with empathy respect and integrity
- Commit to each other: Contributing to making Circana a great place to work for everyone
Location
This position can be located in the following area(s): Bangalore
Prospective candidates may be asked to consent to background checks (in accordance with local legislation and our candidate privacy notice ) Your current employer will not be contacted without your permission.
Required Experience:
Unclear Seniority