Key roles and responsibilities:
- Design and develop data models ETL processes and pipelines to support data ingestion transformation and analysis.
- Work with crossfunctional teams to identify data requirements prioritize data initiatives and drive solutions that enable datadriven decision making.
- Develop and maintain dashboards reports and visualizations that provide insights into key business metrics and trends.
- Design and implement data quality and data validation processes to ensure accuracy and consistency of data.
- Develop and maintain documentation for data models data lineage and data flow.
- Lead technical delivery within squads and provide oversight of solutions.
- Share knowledge and practical experience with community.
- Challenge and contribute to development of architectural principals and patterns.
- Mentor and coach junior data engineers to develop their skills and expertise
Academic qualifications and certifications:
- A Bachelors Degree in Computer Science Information Technology or Equivalent Qualification
- Technology Certifications in Databricks Azure Data Engineering and other technologies highly advantageous)
- Minimum 5 years experience as a Data Engineer
- Proficiency in SQL Python and other programming languages commonly used in data engineering.
- Experience with data visualization tools such as Paginated reports (SSRS) Power BI Tableau or QlikView.
- Experience in developing solutions in cloud technologies including but not limited to Azure Databricks SQL and Data Lake
- Experience with distributed computing systems such as Hadoop and Spark.
- Experience in Dimensional Modeling
Technical Skills Required;
Languages:
- Transact SQL
- Python
- Spark
- Scala
Technologies:
- Azure Data Factory
- Azure Synapse Analytics
- Azure DevOps
- Data Lake
- Power BI
- SQL Server
- Databricks