Staff Engineer
Job Summary
About PhonePe Limited:
Headquartered in India its flagship product the PhonePe digital payments app was launched in Aug 2016. As of April 2025 PhonePe has over 60 Crore (600 Million) registered users and a digital payments acceptance network spread across over 4 Crore (40 million) merchants. PhonePe also processes over 33 Crore (330 Million) transactions daily with an Annualized Total Payment Value (TPV) of over INR 150 lakh crore.
PhonePes portfolio of businesses includes the distribution of financial products (InsuranceLending and Wealth) as well as new consumer tech businesses (Pincode - hyperlocal e-commerce and Indus AppStore Localized App Store for the Android ecosystem) in Indiawhich are aligned with the companys vision to offer every Indian an equal opportunity toaccelerate their progress by unlocking the flow of money and access to services.
Culture:
At PhonePe we go the extra mile to make sure you can bring your best self to work Everyday!. And that starts with creating the right environment for you. We empower people and trust them to do the right thing. Here you own your work from start to finish right from day one. PhonePe-rs solve complex problems and execute quickly; often building frameworks from scratch. If youre excited by the idea of building platforms that touch millions ideating with some of the best minds in the country and executing on your dreams with purpose and speed join us!
About the Role
We are building an in-house team to maintain and contribute to our internal Apache Kafka distribution. This is not an operations role you will work on the Kafka codebase itself: the broker the KRaft controller the protocol the clients and the storage layer. You will be our technical anchor for all things Kafka internals driving upstream contributions backporting critical fixes and shaping our internal distribution to meet the needs of a large-scale production fleet.
We already do this successfully with GlusterFS where we maintain an in-house distribution backed by deep upstream expertise. We want to replicate that model for Kafka.
Key Responsibilities
- Own our internal Kafka distribution: branch management patch curation release cutting upgrade planning
- Contribute upstream to Apache Kafka bug fixes KIPs code reviews design discussions
- Diagnose and fix deep broker/controller issues: replication partition reassignment KRaft consensus log storage ISR management protocol handling
- Build custom patches for production needs that arent suitable for upstream (performance tuning for our workload profile observability hooks operational safety valves)
- Establish engineering practices for Kafka development within the team: how we test how we benchmark how we validate patches before rolling them out
- Mentor a supporting engineer and grow the teams capability over time
- Act as the internal authority on Kafka internals advise platform teams on configuration capacity planning and architectural decisions that require knowledge of broker behavior
- Act as the primary interface for audit and compliance teams ensuring PhonePe Kafka distribution meets various compliance and regulatory standards
What are we looking for
- Deep familiarity with the Kafka codebase you have read modified and debugged the broker controller or client internals. Not just operated Kafka but worked on it.
- Track record of upstream contribution committed patches participated in KIP discussions reviewed PRs or equivalent engagement with the Apache Kafka community. Active committer/PMC status is strongly preferred but not strictly required if your contribution history demonstrates equivalent depth.
- Strong distributed systems fundamentals consensus protocols replication exactly-once semantics log-structured storage distributed state machines. You understand these not as buzzwords but as engineering tradeoffs youve navigated.
- Systems-level programming comfort JVM internals (GC tuning memory layout JIT behavior) OS-level I/O (page cache fsync semantics zero-copy) networking (TCP tuning socket buffers). Kafka performance work lives at this layer.
- Experience maintaining a fork or distribution youve managed the tension between carrying local patches and staying mergeable with upstream. You know what it costs to diverge and how to minimize that cost.
- 8 years of experience in systems/infrastructure software engineering with a meaningful portion spent on Kafka or comparable distributed systems (Pulsar Bookkeeper Zookeeper etcd CockroachDB etc.)
Good to have
- Apache Kafka Committer or PMC member
- Experience with KRaft (the ZooKeeper-free controller)
- Authored or co-authored a KIP
- Experience with Kafka Streams or Kafka Connect internals (not just usage)
- Familiarity with Kafkas test infrastructure (system tests Trogdor ducktape)
PhonePe Full Time Employee Benefits (Not applicable for Intern or Contract Roles)
- Insurance Benefits - Medical Insurance Critical Illness Insurance Accidental Insurance Life Insurance
- Wellness Program - Employee Assistance Program Onsite Medical Center Emergency Support System
- Parental Support - Maternity Benefit Paternity Benefit Program Adoption Assistance Program Day-care Support Program
- Mobility Benefits - Relocation benefits Transfer Support Policy Travel Policy
- Retirement Benefits - Employee PF Contribution Flexible PF Contribution Gratuity NPS Leave Encashment
- Other Benefits - Higher Education Assistance Car Lease Salary Advance Policy
Our inclusive culture promotes individual expression creativity innovation and achievement and in turn helps us better understand and serve our customers. We see ourselves as a place for intellectual curiosity ideas and debates where diverse perspectives lead to deeper understanding and better quality results. PhonePe is an equal opportunity employer and is committed to treating all its employees and job applicants equally; regardless of gender sexual preference religion race color or disability. If you have a disability or special need that requires assistance or reasonable accommodation during the application and hiring process including support for the interview or onboarding process please fill out this form.
Read more about PhonePe on our blog.
Life at PhonePe
PhonePe in the news
Required Experience:
Staff IC
About Company
PhonePe is a Digital Wallet & Online Payment App that allows you to make instant Money Transfers with UPI. Recharge Mobile, DTH, Pay Utility Bills, Buy/Invest in Gold, Mutual Funds, Insurance & much more.