Senior Data Engineer, Python, Spark, DevOps

ASX


Job Location:

Sydney - Australia

Monthly Salary: Not Disclosed
Posted on: 6 hours ago
Vacancies: 1 Vacancy

Job Summary

ASX: Powering Australias financial markets

Why join the ASX

When you join ASX youre joining a company with a strong purpose to power a stronger economic future by enabling a fair and dynamic marketplace for all.

In your new role youll be part of a leading global securities exchange with a strong brand. We are known for being a trusted market operator and an exciting data hub.

Want to know why we are a great place to work click on the link to learn more.

are more than a securities exchange!

The ASX team brings together talented people from a diverse range of disciplines.

We run critical market infrastructure with 1 in 3 people employed within technology. Yet we have a unique complexity of roles across a range of disciplines such as operations program delivery financial products investor engagement risk and compliance.

Were proud to foster a workplace where diversity is celebrated and inclusion is part of our everyday culture. Our employee-led networks champion LGBTIQ inclusion promote gender equality accessibility and wellbeing inspire giving and volunteering and celebrate cultural and religious events creating a sense of belonging for all. As an AWEI Bronze employer and member of the Champions of Change Coalition for gender equality were committed to a fair and inclusive workplace where everyone can thrive.

This is an exciting opportunity for a strong Senior Data Engineer to work on a project that will integrate with all major systems in the ASX. Youll join a highperforming Data & Reporting team working on a major program that integrates with multiple core ASX systems. This role provides the opportunity to design and deliver highquality engineering solutions with real impact on missioncritical enterprise platforms.

Youll be hands-on in shaping the nextgeneration data platform applying modern engineering practices automation and cloudnative tooling. This is a highly collaborative role where youll contribute directly to the uplift of data engineering capabilities and work with some of the most contemporary technologies in the industry.

At ASX you will:

  • Live the ASX Values.

  • Adhere to ASX processes methodologies standards and policies in relation to delivery from a governance perspective.

What youll do in this role:

  • Build and maintain highquality scalable data pipelines that align with enterprise engineering standards.

  • Ensure data solution designs adhere to CI/CD governance quality and security best practices.

  • Work with engineers across the program to uplift automation and modernise data engineering capabilities including CI/CD pipeline templating and infrastructureascode.

  • Support accelerated delivery by implementing automation standardised configuration management and streamlined pipeline execution across environments.

  • Become a subject matter expert in D&R engineering tools frameworks and practices influencing improvements across the SDLC.

  • Collaborate with platform and infrastructure teams to uplift data delivery quality monitoring and environment readiness.

  • Work closely with test and release teams to embed automated testing and validation into data pipelines.

  • Support the development of logging monitoring and observability practices across D&R data assets.

  • Communicate effectively across engineering and business teams to ensure alignment and clarity.

  • Actively contribute to engineering strategy process improvement and technical decisionmaking.

  • Be an engaged member of the Solution Engineering Community of Practice (CoP).

Your skills and experience:

  • 10 years as a Data Engineer working within high performing teams including product delivery data designers architects and testers.

  • Proven experience building and operating largescale data pipelines and analytics solutions.

  • Strong Data Engineering background in a cloudbased environment (preferably AWS).

  • Expertise in building robust ETL/ELT pipelines data ingestion frameworks and enterprise data models.

  • Handson experience with AWS Data Analytics ecosystem including Glue Athena LakeFormation Redshift MWAA and DMS

  • Strong Python skills and experience developing automated data workflows quality checks and reporting pipelines.

  • Solid understanding of conceptual logical and physical data modelling techniques.

  • Experience working with datasets.

  • Prior experience working in cloudnative engineering environments ideally AWS.

  • Hands-on devops experience using Terraform or CloudFormation

  • Experience working in Agile delivery environments.

  • Strong collaboration and communication skills.

  • Demonstrated ability to work both independently and as part of a high-functioning team with a continuous improvement mindset

  • Demonstrated strong communication facilitation and analysis skills with the ability to view and explain technology from a customer perspective

  • Experience in performing complex data migrations within large scale transformation projects

And if youve got some of this even better:

  • Experience in the execution of high impact enterprise-wide strategic programs or initiatives.

  • Working knowledge of a fully integrated Exchange environment would be beneficial particularly equities markets.

What you need to enjoy and be good at for this role:

  • Results orientated understands what is needed to deliver in a tightly regulated but changing project-based environment

  • Naturally inquisitive asks questions to ensure understanding

  • Great communicator able to get the message across in the best way

  • Analytical thinker can evaluate information and seek a solution

  • Team player support other team members to achieve desired goals working cross-functionally if required

  • Collaboration can work with multiple stakeholders to deliver a common goal

  • Enjoy working in a fast-paced challenging and often changing environment

  • View ability to look at the big picture and at the same time ensure attention to detail and quality

We make hiring decisions based on your skills capabilities and experience and how youll help us to live our values. We encourage you to apply even if you dont meet all the criteria of this role.

If you need any adjustments during the application or interview process to help you present your best self please let us know at

At ASX Group our diverse workforce is essential to build and maintain a fair and dynamic marketplace. We support flexible working and offer hybrid working options. Even if our roles are advertised as full-time we encourage you to apply if you are interested in part-time or other flexible working arrangements.

We will arrange for successful candidates to have background checks including reference and police checks completed as part of the on-boarding process.

To be considered for this position candidates must be legally authorised to work in Australia on a permanent basis without any restrictions.


Required Experience:

Senior IC

ASX: Powering Australias financial marketsWhy join the ASXWhen you join ASX youre joining a company with a strong purpose to power a stronger economic future by enabling a fair and dynamic marketplace for all.In your new role youll be part of a leading global securities exchange with a strong brand...