Data Engineer
Data Engineer
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
About us:
We are proudly owned by Auto & General Insurance Company. The A&G group is made up of trusted and well-known brands such as iSelect Compare the Market and Budget Direct. In late 2024 iSelect and Compare the Market formed a new Aggregation business within the A&G group and now support millions of Australians to compare and buy their personal finance and household products such as insurance energy and loans.
iSelect
At iSelect were passionate about making Australians lives easier by saving them time money and effort. With over 20 years experience we are a one-stop destination for comparison and purchasing across insurance utilities and personal finance products. We compare a wide range of brands and our trained comparison experts help customers to compare select and save more putting them in control.
Compare the Market
At CTM our Noble Purpose is to make a difference in the lives of Australians by simplifying the process of making sound financial decisions. This Noble Purpose is our cultural north star guiding our direction prioritisation and decision making.
How you fit:
Asa Data Engineer working on the data platform and in collaboration across CTMs business and technology stakeholders you will use your experience to build data pipelines enhance frameworks and build utilities on the Cloud Data Platform in a manner that aligns to metadata driven automation-based frameworks and highly scalable systems.
What you do:
- Align build of data engineering solutions in accordance with data architecture and component designs.
- Development of robust end to end data pipelines
- Develop test and deploy code to a high standard.
- Release planning implementation and code reviews.
- Managing delivery risks & meeting deadlines.
- Work with Architect to support planned data architecture data governance data quality master data and metadata management.
- Work with BI developers and reporting team to optimise the DWH for reporting and analysis.
- Monitor data quality and build jobs to log and report on issues.
- Develop data integration between production systems
- Gain domain knowledge of Compare the Markets business and data.
What you need:
Qualifications:
- Minimum Bachelors Degree qualified in Computer Science IT or a relevant discipline
Experience & Skills:
- Experience with Cloud EDWs (AWS and/or GCP) Data Lakes Information Governance Suites (Lineage Glossary Reference Data).
- Proven development experience in Python and ETL tools in addition to data modelling skills.
- Experience with deployment of data workloads using CI/CD tooling.
- Experience building metadata driven highly automated solutions very well regarded.
- Experience with Databricks well regarded.
- Additional experience in traditional on prem EDW / ETL environments well regarded.
- Minimum 3 years experience in a similar role a minimum of 5 years experience in IT/data
- Understanding of end-to-end Data & Insights life cycle is a must
- Good communication and business engagement
- Previous experience working in an Agile environment using tools such as Jira and Confluence.
Whats in it for you:
- Career Opportunities
- A competitive salary plus generous uncapped commission scheme
- The opportunity to work with a well-known household brand and public listed company
- Work with a team of highly energised motivated and driven professionals
- 3 recharge days per year (yes in addition to your annual leave!)
- A free coffee each day a funky caf and a state of the art work space
- An impressive Employee Benefits Programs
If you are someone who fosters team spirit has resilience and aspires to continue learning and developing their skills to drive commercial outcomes you will have tremendous success in helping us achieve our progressive growth agendas. High energy levels and a love of having fun are also important to working in this energetic business.
Employment Type
Full-Time
