Senior Data Engineer Azure Databricks
Senior Data Engineer Azure Databricks
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
Job Description
- Responsible for ingestion of data sources and feature engineering to support creation of modelling data layers integrate data into models / workflows.
- Representation at Architecture Review Boards.
- Solution design implement and maintain data pipelines for data ingestion processing and transformation using could services and other technologies
- Create and maintain data solutions IN Azure using any of the following: Data Factory Synapse Databricks Fabric
- Implementing data validation and cleansing procedures will ensure the quality integrity and dependability of the data.
- Improve the scalability efficiency and costeffectiveness of data pipelines.
- Monitoring and resolving data pipeline problems ensuring consistency and availability of the data.
Qualifications
- Proficient in Python
- Knowledge of good data design principles (concepts such as Kimball and Star Schema) data warehousing concepts and data modelling.
- Strong experience with Relational and ideally NoSQL databases.
- Strong understanding of ETL/ELT processes.
- Exposure to data monitoring and observability tools.
- Relevant experience with EventDriven Architecture
- Good understanding of Agile ways of working
Additional Information :
Our diversity makes us stronger it drives meaningful change and enables us to build innovative technology solutions. We are committed to creating an inclusive community where all of us regardless of background identity or personal characteristics feels valued respected and free from discrimination. As an equal opportunity employer we welcome applications from all individuals and base hiring decisions on merit skills qualifications and potential.
Remote Work :
No
Employment Type :
Fulltime
Employment Type
Full-time
