Data Engineer-Databricks- 45381
Share
Job Location:
Monthly Salary:
Posted on:
20 hours ago
Vacancies:
1 Vacancy
Job Summary
Technical Experience:
Must Have
Hands-on experience with Databricks Delta Lake Data Factory.
Proficiency in Python PySpark and SQL with strong query optimization skills.
Deep understanding of Lakehouse architecture and Medallion design patterns.
Experience building scalable ETL/ELT pipelines and data transformations.
Experience with Git CI/CD pipelines and Agile methodologies.
Night shift Rotating night shift ie 2 weeks night shift and 2 weeks afternoon shift
Good To Have
Knowledge of data quality frameworks and monitoring practices.
Experience with data visualization tools.
Experience of working in managed services
Qualifications:
Education: Likely a degree in Computer Science Data Engineering Information Systems or a related
field.
Experience:
o Proven hands-on experience with Azure data stack (Databricks Data Factory Delta Lake).
o Experience in building scalable ETL/ELT pipelines.
o Familiarity with data governance and DevOps practices.
Must Have
Hands-on experience with Databricks Delta Lake Data Factory.
Proficiency in Python PySpark and SQL with strong query optimization skills.
Deep understanding of Lakehouse architecture and Medallion design patterns.
Experience building scalable ETL/ELT pipelines and data transformations.
Experience with Git CI/CD pipelines and Agile methodologies.
Night shift Rotating night shift ie 2 weeks night shift and 2 weeks afternoon shift
Good To Have
Knowledge of data quality frameworks and monitoring practices.
Experience with data visualization tools.
Experience of working in managed services
Qualifications:
Education: Likely a degree in Computer Science Data Engineering Information Systems or a related
field.
Experience:
o Proven hands-on experience with Azure data stack (Databricks Data Factory Delta Lake).
o Experience in building scalable ETL/ELT pipelines.
o Familiarity with data governance and DevOps practices.
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
