SRE - 2 Big Data

About PhonePe Group:

PhonePe is Indias leading digital payments company with 50 crore 500 Million) registered users and 3.7 crore 37 Million) merchants covering over 99 of the postal codes across India. On the back of its leadership in digital payments PhonePe has expanded into financial services (Insurance Mutual Funds Stock Broking and Lending) as well as adjacent techenabled businesses such as Pincode for hyperlocal shopping and Indus App Store which is Indias first localized App Store. The PhonePe Group is a portfolio of businesses aligned with the companys vision to offer every Indian an equal opportunity to accelerate their progress by unlocking the flow of money and access to services.

Culture

At PhonePe we take extra care to make sure you give your best at work Everyday! And creating the right environment for you is just one of the things we do. We empower people and trust them to do the right thing. Here you own your work from start to finish right from day one. Being enthusiastic about tech is a big part of being at PhonePe. If you like building technology that impacts millions ideating with some of the best minds in the country and executing on your dreams with purpose and speed join us!

Job Overview:

As a Site Reliability Engineer (SRE) specializing in DataPlatform OnPremise you will play a critical role in deployment ensuring the reliability scalability and performance of our Cloudera Data Platform (CDP) infrastructure. You will collaborate closely with crossfunctional teams to design implement and maintain robust systems that support our datadriven initiatives. The ideal candidate will have a deep understanding of Data Platform strong troubleshooting skills and a proactive mindset towards automation and optimization.You will play a pivotal role in ensuring the smooth functioning operation performance and security of large high density Clouderabased infrastructure.

Key Responsibilities:

1. Work on tasks related to implementation of Cloudera Data Platform Cloudera Data Platform onpremises and be a part of planning installation configuration and integration with existing systems.
2. Infrastructure Management: Manage and maintain the Clouderabased infrastructure ensuring optimal performance high availability and scalability. This includes monitoring system health and performing routine maintenance tasks.
3. Strong troubleshooting skills and operational expertise in areas such as system capacity bottlenecks memory CPU OS storage and networking.
4. Creating Runbooks and automating them using scripting tools like Shell scripting Python etc.
5. Working knowledge with any of the configuration management tools like Terraform Ansible or SALT
6. Data Security and Compliance: Implement and enforce security best practices to safeguard data integrity and confidentiality within the Cloudera environment. Ensure compliance with relevant regulations and standards (e.g. GDPR HIPAA DPR).
7. Performance Optimization: Continuously optimize the Cloudera infrastructure to enhance performance efficiency and costeffectiveness. Identify and resolve bottlenecks tune configurations and implement best practices for resource utilization.
8. Capacity Planning: Planning and performance tuning of Hadoop clusters Monitor resource utilization trends and plan for future capacity needs. Proactively identify potential capacity constraints and propose solutions to address them.
9. Collaborate effectively with infrastructure network database application and business intelligence teams to ensure high data quality and availability.
10. Work closely with teams to optimize the overall performance of the PhonePe Hadoop ecosystem.
11. Backup and Disaster Recovery: Implement robust backup and disaster recovery strategies to ensure data protection and business continuity. Test and maintain backup and recovery procedures regularly.
12. Develop tools and services to enhance debuggability and supportability.
13. Patches & Upgrades: Routinely apply recommended patches and perform rolling upgrades of the platform in accordance with the advisory from Cloudera InfoSec and Compliance.
14. Documentation and Knowledge Sharing: Create comprehensive documentation for configurations processes and procedures related to the Cloudera Data Platform. Share knowledge and best practices with team members to foster continuous learning and improvement.
15. Collaboration and Communication: Collaborate effectively with crossfunctional teams including data engineers developers and IT operations personnel. Communicate project status issues and resolutions clearly and promptly.

Qualifications:

1. Bachelors degree in Computer Science Engineering or related field.
2. Proficiency in Linux system administration shell scripting and networking concepts including IPtables and IPsec.
3. Strong understanding of networking opensource technologies and tools.
4. 35 years of experience in the design set up and management of largescale Hadoop clusters ensuring high availability fault tolerance and performance optimization.
5. Strong understanding of distributed computing principles and experience with Hadoop ecosystem technologies (HDFS MapReduce YARN Hive Spark etc..
6. Experience with Kerberos and LDAP.
7. Strong Knowledge of databases like MysqlNosqlSql server
8. Handson experience with configuration management tools (e.g. SaltAnsible Puppet Chef).
9. Strong scripting skills (e.g. PERLPython Bash) for automation and troubleshooting.
10. Experience with monitoring and logging solutions (e.g. Prometheus Grafana ELK stack).
11. Knowledge of networking principles and protocols (TCP/IP UDP DNS DHCP etc..
12. Experience with managing *nix based machines and strong working knowledge of quintessential Unix programs and tools (e.g. Ubuntu Fedora Redhat etc.
13. Excellent communication skills and the ability to collaborate effectively with crossfunctional teams.
14. Excellent analytical problemsolving and troubleshooting skills..
15. Proven ability to work well under pressure and manage multiple priorities simultaneously.

Good To Have:

1. Cloudera Certified Administrator (CCA) or Cloudera Certified Professional (CCP) certification preferred.
2. Minimum 2 years of experience in managing and administering medium/large hadoop based environments >100 machines) including Cloudera Data Platform (CDP) experience is highly desirable.
3. Familiarity with Open Data Lake components such as Ozone Iceberg Spark Flink etc.
4. Familiarity with containerization and orchestration technologies (e.g. Docker Kubernetes OpenShift) is a plus
5. Designdevelop and maintain Airflow DAGs and tasks to automate BAU processesensuring they are robustscalable and efficient.

PhonePe Full Time Employee Benefits (Not applicable for Intern or Contract Roles)

• Insurance Benefits Medical Insurance Critical Illness Insurance Accidental Insurance Life Insurance
• Wellness Program Employee Assistance Program Onsite Medical Center Emergency Support System
• Parental Support Maternity Benefit Paternity Benefit Program Adoption Assistance Program Daycare Support Program
• Mobility Benefits Relocation benefits Transfer Support Policy Travel Policy
• Retirement Benefits Employee PF Contribution Flexible PF Contribution Gratuity NPS Leave Encashment
• Other Benefits Higher Education Assistance Car Lease Salary Advance Policy

Working at PhonePe is a rewarding experience! Great people a work environment that thrives on creativity the opportunity to take on roles beyond a defined job description are just some of the reasons you should work with us. Read more about PhonePe on our blog.

Life at PhonePe

PhonePe in the news