Data Platform Engineer

As a Data Platform Engineer youll be at the heart of building and evolving our modern data platform powered by Azure Data Factory Azure SQL Databricks Synapse Analytics and AI Foundry. This platform is critical to how we deliver analytics insights and AI capability across the organisation.

Youll ensure the platform is reliable scalable and high-performing enabling trusted data delivery at pace while playing a key role in supporting AFCAs growing data and AI ambitions.

Staying ahead of cloud-native innovation youll continuously look for ways to enhance architecture drive automation and improve efficiency helping future-proof our platform and keep us aligned to our enterprise vision.

What youll be doing:

• Design build and maintain scalable data pipelines lake and lakehouse architectures across Azure (ADF Databricks Synapse Azure SQL)
• Develop robust batch and streaming pipelines to deliver reliable high-quality data across the organisation
• Drive best practice through CI/CD infrastructure as code automated testing and observability
• Monitor and optimise performance cost and reliability (clusters jobs queries and governance)
• Contribute to data models and architectures that enable analytics and AI/ML use cases
• Ensure solutions align with security privacy and data governance standards
• Partner closely with data analysts engineers scientists and AI teams to improve platform capability and developer experience

Qualifications :

To be successful in this role you will need:

• Strong experience in data engineering or data platform roles with demonstrated hands-on expertise in Azure Data Factory Azure SQL Databricks Synapse Analytics and the broader Azure data ecosystem or similar (e.g. Fabric).  
• A Bachelor degree in Computer Science Information Systems or relevant field
• Proficiency in SQL Python PySpark and Spark SQL with experience building and optimising data pipelines at scale.  
• Experience with lakehouse Delta Lake and medallion architecture patterns. Familiarity with infrastructure-as-code tools (e.g. Terraform ARM) and Azure DevOps CI/CD practices for data platform deployments.  
• Understanding of data modelling concepts data warehousing principles and modern data platform architectures.  
• Exposure to supporting AI/ML workloads on Databricks (e.g. MLflow model serving feature engineering) highly regarded.  
• Experience with or exposure to Azure AI Foundry highly regarded.  
• Experience in financial services digitalfirst organisations or highly regulated environments highly regarded. 
• Excellent stakeholder management skills with the ability to clearly communicate end elicit requirements from non-technical audiences. 
• Growth mindset with a practical outcomefocused approach. 
• Customercentred pragmatic and deliveryoriented. 

Additional Information :

• Silver AWEI Accreditation 2025 Recognised for LGBTQ workplace inclusion.
• Accredited Family Friendly Workplace Supporting work-life balance and inclusivity.
• Hybrid working Flexible arrangements with two days a week in our modern offices designed for collaboration and wellbeing.
• Additional and inclusive leave options Flexible public holidays gender affirmation leave womens health leave and bonus paid time off over the end of year holiday period.

To apply

If youre passionate about fairness and believe your skills align with this role we encourage you to apply even if you dont meet every single criterion.

We welcome applications from people of all backgrounds cultures abilities sexual orientations and gender identities. If you require any accessibility support during the recruitment process please reach out to our team at

We believe fairness starts with people. Thats why we dont use AI or automated tools to screen candidates. As a result our processes may take a little longer and we thank you for your patience.

About AFCA

The Australian Financial Complaints Authority (AFCA) was established in 2018 as a private not-for-profit ombudsman service providing free fair and independent help with financial disputes. The original team has grown to over 1600 dedicated professionals. Since 2018 AFCA has received more than 634000 complaints helping to secure $2.1 billion in compensation for consumers. 

AFCA is a 2026 Circle Back Initiative Employer - we are committed to responding to every applicant.

Remote Work :

No

Employment Type :

Full-time