Data Engineering Technical Lead
About Us: Paytm is Indias leading digital payments and financial services company which is focused on driving consumers and merchants to its platform by offering them a variety of payment use cases. Paytm provides consumers with services like utility payments and money transfers while empowering them to pay via Paytm Payment Instruments (PPI) like Paytm Wallet Paytm UPI Paytm Payments Bank Netbanking Paytm FASTag and Paytm Postpaid - Buy Now Pay Later. To merchants Paytm offers acquiring devices like Soundbox EDC QR and Payment Gateway where payment aggregation is done through PPI and also other banks financial instruments. To further enhance merchants business Paytm offers merchants commerce services through advertising and Paytm Mini app on this platform leverage the company then offers credit services such as merchant loans personal loans and BNPL sourced by its financial partners.
About the Role:
This position requiressomeone to work on complex technical projects and closely work with peers in an innovative andfast-paced environment. For this role we require someone with a strong product design sense & specialized in Hadoop and Spark technologies.
Requirements:
Minimum 6 years of experience in Big Data technologies.
The position Grow our analytics capabilities with faster more reliabletools handling petabytes ofdataevery day.
Brainstorm and create new platforms that can help in our quest to makeavailable to cluster users in all shapes and forms with low latency and horizontalscalability.
Make changes to ourdiagnosing any problems across the entire technical stack.
Design and develop a real-time events pipeline forDataingestion for real-time complex and efficient functions to transform rawdatasources into powerfulreliable components of ourdatalake.
Design & implement new components and various emerging technologies in HadoopEco- System and successful execution of various projects.
Be a brand ambassador for Paytm Stay Hungry Stay Humble Stay Relevant!
Skills that will help you succeed in this role:
Fluent withStrong hands-on experience with Hadoop MapReduce Hive Spark PySpark programming/debugging skills in Python/Java/Scala.
Experience with any scripting language such as Python Bash etc.
Good to have experience of working with noSQL databases like Hbase -on programming experience with multithreaded to have experience in Database SQL messaging queues like Kafka.
Good to have experience in developing streaming applications e.g. Spark StreamingFlink Storm to have experience with AWS and cloud technologies such as S3
Experience with caching architectures like Redis etc.
Why join us:
Because you get an opportunity to make a difference and have a great time doing are challenged and encouraged here to do stuff that is meaningful for you and for those we should work with us if you think seriously about what technology can do for are successful and our successes are rooted in our peoples collective energy and unwavering focus on the customer and thats how it will always be.
Compensation:
If you are the right fit we believe in creating wealth for you with enviable 500 mn registered users 21 mn merchants and depth of data in our ecosystem we are in a unique position to democratize credit for deserving consumers & merchants and we are committed to it. Indias largest digital lending story is brewing here. Its your opportunity to be a part of the story!