Lead Data Engineer
Lead Data Engineer
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
About YUBI
Yubi formerly known as CredAvenue is redefining global debt markets by freeing the flow of finance between borrowers lenders and investors. We are the worlds possibility platform for the discovery investment fulfilment and collection of any debt solution. At Yubi opportunities are plenty and we equip you with tools to seize it.
In March 2022 we became India s fastest fintech and most impactful startup to join the unicorn club with a Series B fundraising round of $137 million.
In 2020 we began our journey with a vision of transforming and deepening the global institutional debt market through technology. Our twosided debt marketplace helps institutional and HNI investors find the widest network of corporate borrowers and debt products on one side and helps corporates to discover investors and access debt capital efficiently on the other side. Switching between platforms is easy which means investors can lend invest and trade bonds all in one place. All 5 of our platforms shake up the traditional debt ecosystem and offer new ways of digital finance.
Yubi Loans Term loans and working capital solutions for enterprises.
Yubi Invest Bond issuance and investments for institutional and retail participants.
Yubi Pool Endtoend securitisations and portfolio buyouts.
Yubi Flow A supply chain platform that offers trade financing solutions.
Yubi Co.Lend For banks and NBFCs for colending partnerships.
Currently we have boarded over 4000 corporates 350 investors and have facilitated debt volumes of over INR 40000 crore.
Backed by marquee investors like Insight Partners B Capital Group Dragoneer Sequoia Capital LightSpeed and Lightrock we are the onlyofitskind debt platform globally revolutionizing the segment.
At Yubi People are at the core of the business and our most valuable assets. Yubi is constantly growing with 650 likeminded individuals today who are changing the way people perceive debt. We are a fun bunch who are highly motivated and driven to create a purposeful impact. Come join the club to be a part of our epic growth story.
About the Role
We are looking for a highly skilled Lead Data Engineer to design develop and optimize our data infrastructure while driving business and stakeholder engagement. The ideal candidate will have strong experience in system design data modelling and warehouse design Python SQL Apache Spark and realtime streaming technologies. They will play a crucial role in defining data strategies building scalable pipelines and data modelling for OLTP & OLAP systems.
Key Responsibilities
Data Engineering & System Design
Architect build and optimize scalable highperformance data pipelines for batch and realtime processing.
Design and maintain data lakes warehouses and lakehouses to support business intelligence and analytics.
Implement best practices in data modeling governance and security.
Work with distributed computing frameworks (Apache Spark Kafka Flink) to ensure efficient data processing.
Improve query performance and cost optimization in cloudbased environments (AWS GCP Azure).
Stakeholder & Business Management
Collaborate with business leaders product managers and analysts to understand data needs and translate them into engineering solutions.
Drive data strategy and roadmap aligning engineering initiatives with business goals.
Communicate technical concepts to nontechnical stakeholders influencing decisionmaking.
Ensure data quality availability and compliance with regulatory and business requirements.
Technical Leadership & Mentorship
Lead and mentor a team of data engineers fostering a culture of innovation and excellence.
Define best practices for data engineering including coding standards documentation and automation.
Drive adoption of emerging technologies and tools to improve data infrastructure.
Conduct code reviews performance tuning and optimization for existing pipelines.
Requirements
Required Skills & Experience
8 years of experience in data engineering system design and largescale data processing.
Strong programming skills in Python and SQL for data transformation and analysis.
Expertise in Apache Spark (PySpark/Scala) Kafka Flink or similar realtime data processing frameworks.
Handson experience with cloudbased data platforms (AWS GCP Azure) and tools like Redshift Athena Snowflake BigQuery.
Handson experience in data ecosystem like dbt Airflow
Proficiency in data modeling ETL processes and performance optimization.
Experience with data governance security and compliance standards.
Strong business acumen with the ability to drive datadriven decisions.
Excellent communication stakeholder management and leadership skills.
Nice to Have
Experience with Gen AI
Knowledge of CI/CD pipelines and DevOps practices for data engineering.
Required Skills & Experience 8+ years of experience in data engineering, system design, and large-scale data processing. Strong programming skills in Python and SQL for data transformation and analysis. Expertise in Apache Spark (PySpark/Scala), Kafka, Flink, or similar real-time data processing frameworks. Hands-on experience with cloud-based data platforms (AWS, GCP, Azure) and tools like Redshift, Athena, Snowflake, BigQuery. Hands-on experience in data ecosystem like dbt, Airflow Proficiency in data modeling, ETL processes, and performance optimization. Experience with data governance, security, and compliance standards. Strong business acumen with the ability to drive data-driven decisions. Excellent communication, stakeholder management, and leadership skills. Nice to Have Experience with Gen AI Knowledge of CI/CD pipelines and DevOps practices for data engineering.
Employment Type
Full Time
