Data Engineer
Data Engineer
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
We are seeking a highly skilled SeniorDataEngineer with expertise in PySpark ETLpipelinedevelopment and Kubernetes to join our data engineering team. You will be responsible for designing building and maintaining large-scale distributed data processing systems and ensuring data quality and reliability for analytics and business intelligence initiatives.
Mandatory Skills
- Hands on experience in design development and managing big data technologies
- Technologies : Spark Trino Kafka
- ETL Pipelines
- Data Modelling
- Exp of Databases - SQL Oracle MongoDB MinIO S3
Responsibilities
Design implement and optimize scalable ETL/ELT data pipelines using PySpark.
Workwithbigdatatechnologiestoingesttransformandservelargevolumesofstructuredandsemi-structureddata.
Orchestrate and deploy data workflows on Kubernetes-basedinfrastructure.
Collaboratewithdatascientistsanalystsandotherengineerstodeliverhigh-qualitydataproducts.
Ensuredataintegrityconsistencysecurityandgovernance.
TroubleshootperformancebottlenecksinSparkjobsanddistributedsystems.
ImplementmonitoringalertingandloggingfordatapipelinesusingmodernDevOpspractices.
Lead code reviews and mentor junior engineers on best practices.
Required Experience:
Senior IC
Employment Type
Full-Time
