Senior Data Engineer - Lending
Senior Data Engineer - Lending
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
As the Data engineer in the Lending Data Engineering team you will work closely with data modelers product analytics product managers software engineers and business stakeholders across the SEA in understanding the business and data requirements. You will be responsible for building and managing the data asset including acquisition storage processing and consumption channels and using some of the most scalable and resilient open source big data technologies like Flink Airflow Spark Kafka Trino and more on cloud infrastructure. You are encouraged to think out of the box and have fun exploring the latest patterns and designs.
The Day-to-Day Activities
Developing and maintaining scalable and reliable ETL pipelines and processes to ingest data from a large number and variety of data sources
Developing a deep understanding of real-time data productions availability to inform on the real time metric definitions
Develop data quality checks and establish best practices for data governance quality assurance data cleansing and ETL-related activities
Develop familiarity with the existing inbuilt data platform tools and utilize them efficiently to set up the data pipelines.
Maintaining and optimizing the performance of our data analytics infrastructure to ensure accurate reliable and timely delivery of key insights for decision making
Design and deliver the next-gen data lifecycle management suite of tools/frameworks including ingestion and consumption on the top of the data lake to support real-time API-based and serverless use-cases along with batch as relevant.
Build solutions leveraging AWS services such as Glue Redshift Athena Lambda S3 Step Functions EMR and Kinesis to enable efficient data processing and analytics.
Develop a deep understanding of real-time data production availability to inform real-time metric definitions using tools like Amazon MSK or Kinesis Data Streams.
Implement and monitor data quality checks and establish best practices for data governance quality assurance data cleansing and ETL-related activities using AWS Glue DataBrew or similar tools.
Qualifications :
At least 5 years of relevant experience in developing scalable secured distributed fault tolerant resilient & mission-critical data pipelines.
Proficiency in at least one of the programming languages Python Scala or Java.
Strong understanding of big data technologies like Flink Spark Trino Airflow Kafka and familiarity with AWS services like EMR Glue Redshift Kinesis and Athena.
Experience with SQL schema design and data modeling.
Hands-on experience with AWS storage solutions (S3 DynamoDB) and query engines (Athena Redshift Spectrum).
Experience with different databases NoSQL Columnar Relational.
You have a hunger for consuming data new data technologies and discovering new and innovative solutions to the companys data needs.
Develop familiarity with in-house and AWS-native data platform tools to efficiently set up data pipelines.
Ability to design event-driven architectures using SNS SQS Lambda or similar AWS serverless technologies.
You are organized insightful and can communicate your observations well both written and verbally to your stakeholders to share updates and coordinate the development of data pipelines
Additional Information :
Life at Grab
We care about your well-being at Grab here are some of the global benefits we offer:
- We have your back with Term Life Insurance and comprehensive Medical Insurance.
- With GrabFlex create a benefits package that suits your needs and aspirations.
- Celebrate moments that matter in life with loved ones through Parental and Birthday leave and give back to your communities through Love-all-Serve-all (LASA) volunteering leave
- We have a confidential Grabber Assistance Programme to guide and uplift you and your loved ones through lifes challenges.
What We Stand For at Grab
We are committed to building an inclusive and equitable workplace that enables diverse Grabbers to grow and perform at their best. As an equal opportunity employer we consider all candidates fairly and equally regardless of nationality ethnicity religion age gender identity sexual orientation family commitments physical and mental impairments or disabilities and other attributes that make them unique.
Remote Work :
No
Employment Type :
Full-time
Employment Type
Full-time
