Lead Data Engineer
Lead Data Engineer
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
Job Description
Seeking a Lead Data Engineer with strong experience in ETL and ELT
Job details
The Department is looking for Data Engineers to join its Enterprise Analytics section to work across several data and analytics platforms. We are seeking candidates with strong experience in developing Extract Transform Load (ETL) and Extract Load Transform (ELT) processes and /or the development of data products and complex data visualisations.
The role will be responsible for design development and unit testing activities across several data movement data transformation and data visualisation processes. The data movement and transformation processes focus on the preparation of data for use in decision making processes across the department utilising modern cloud technology (Azure) to enable operational analytics use cases.
To be successful in the role you must have a strong work ethic including taking ownership providing leadership having a high level of productivity and working with a multi-disciplinary team in an Agile development environment. You must have suitable qualifications or training in data engineering techniques and at least 5 years experience working as a data engineer.
Key duties and responsibilities
Responsibilitiesinclude but not limited to:
- Designing building and testing various Extract Transform Load (ETL) and Extract Load Transform (ELT) processes on the departments Azure data and analytics platform.
- Designing building and testing data storage solutions to meet current and emerging needs.
- Utilising expert level knowledge of best practices to uplift capability maturity and governance practices.
- Be responsive flexible and work collaboratively as part of an agile team.
- Creating and maintaining frameworks and strategies.
- Sharing outcomes knowledge and experience with other data engineers in the section.
- Acting as technical escalation point.
- Providing technical support in the development of deliverables.
- Assisting project teams achieve objectives that align with departmental divisional and sectional priorities.
- Strong relationship building communication and negotiation skills.
- Strong written and oral communication skills.
- Training and mentoring junior data engineers through regular quality reviews and constructive feedback on industry best practices.
Technical skills
MS Azure Stack o Data Integration - Data Factory SQL Server Integration Services and/or Databricks o Data Store - SQL Server and/or Data Lake Storage o Analytics - Azure Databricks Azure Machine Learning ArcGIS Enterprise Development tools DevOps Visual Studio VS Code Data technology solutions sourcing (Oracle Ingres Azure SQL Server) collecting ingesting and storing Data Preparation o Transformation of data into formats tailored to analytics use cases Parquet and/or Delta
Essential criteria
1. Demonstrated experience developing ETL/ELT processes for complex and/or large data movement transformation and/or visualisations particularly in a cloud environment. - 50%
2. Experience preparing data optimised for query performance in cloud computed engines. E.g. Distributed computing engines (Spark) Graph Databases Azure SQL - 25%
3. Experience working with Engineering Storage and Analytics services in cloud infrastructure. - 25%
Desirable criteria
1. Experience working with Azure Data Factory and Databricks.
2. Experience/Knowledge of working with Data Lake and Lakehouses
Contract: 12 Month with 2 x 12 months extension
Security Required: Baseline Security Clearance required
Location - Canberra & Hybrid -Required to be in the office a minimum of 3 days a week. Standard hours should be completed between 8am and 6pm each day.
How to Apply - Please upload your resume to apply. Candidates will need to be willing to undergo pre-employment screening checks which may include ID and work rights security clearance verification and any other client requested checks
Closing date: Tuesday 19 August 2025
Call Joanne Finchett on or email for any further information
Employment Type
Full-Time
