BigData DevOps Engineer

As an important aide to both the IT Infrastructure and Development teams you will help support existing systems 24x7 and responsible for administering current Big Data environments. You will manage BigData Group environments and will work with teammates to maintain working solutions for our big data tech stack. To support product development following the product roadmap for product maintenance and enhancement such that the quality of software deliverables maintains excellent customer relationships and increases the customer base. You will report to the Engineering Manager Data Platforms.

If you have the skills and we would love to talk to you!

What youll do:

• Implement support and administer Hadoop and AWS EMR environments.
• Maintain Terraform and IaC for provisioning and managing AWS resources.
• Provide CI/CD solutions and apply SDLC best practices.
• Automate deployment and operations of Big Data technologies using DevOps tools.
• Onboard Hadoop users and manage Kerberos HDFS Hive HBase and Yarn access.
• Implement security best practices across HBase HDFS Kafka Hive and related components.
• Tune Hadoop clusters MapReduce Spark workloads and optimize EMR for performance and cost.
• Monitor group health logs storage and perform proactive capacity management.
• Collaborate with infrastructure network DB application and BI teams to ensure platform reliability.
• Support upgrades and patching for EMR HBase Spark and other data platforms.
• Troubleshoot system issues and analyze CPU memory OS storage and network performance.
• Deploy and manage Hadoop clusters configure HA manage nodes schedule jobs and perform backups.
• Support integrations across cloud/onprem networks and data platforms.
• Configure and maintain tools like Sentry Spark Kafka Oozie Solr MongoDB DocumentDB and ELK.
• Integrate AD/LDAP with Cloudera manage Sentry policies.

Qualifications :

• Typically requires a bachelors degree (in Computer Science or related field) or equivalent.
• 5 years of Hadoop infrastructure administration AWS EMR or Cloudera environments
• 2 years of Linux (Redhat) system administration (Optional)
• Cloud Platforms IaaS/PaaS Cloud solutions: AWS Azure VMWare.
• Gen AI / Agentic AI knowledge is plus
• Automation skills Ansible and Terraform.
• Kerberos administration skills
• Experience coding languages SQL Python
• Good experience in CI/CD tools such as Jenkins Puppet and Shell scripting
• Must have knowledge on DevOps tools.
• Working Knowledge of YARN HBase Hive Spark and Kafka.
• Experience working with geographically distributed teams
• Bachelors or masters degree in Computer Science or equivalent experience
• Knowledge of our strategy and use of back-office applications.
• To multi-lingual and multicultural environment additional language skills are a bonus.
• Receptive to change.
• With our users at all levels.

Additional Information :

Our benefits include: Medical life and dental insurance Asociacion Solidarista International Share Save Plan Flex Work/Work from home Paid time off Annual Performance Bonus Education Reimbursement Family Bonding Bereavement Leave Referral Program and more. 

At Experian our people and culture set us apart. Were deeply committed to creating an environment where everyone feels they belong and can excel. From inclusion and authenticity to work/life balance development wellness collaboration and recognition we focus on what truly matters. Our people-first approach has earned us global recognition: Worlds Best Workplaces 2024 (Fortune Top 25) Great Place To Work 2025 in 26 countries and Glassdoor Best Places to Work 2024 among others. 

Want to see what life at Experian is really like Explore Experian Life on social or visit our Careers Site. 

Experian is proud to be an Equal Opportunity Employer for all groups protected under applicable federal state and local law including protected veterans and individuals with disabilities. If you have a disability or special need that requires accommodation please let us know at the earliest opportunity.

Remote Work :

No

Employment Type :

Full-time