Senior Data Engineer
Share
Job Location:
Monthly Salary:
Posted on:
2 hours ago
Vacancies:
1 Vacancy
Job Summary
ASX: Powering Australias financial markets
Why join the ASX
When you join ASX youre joining a company with a strong purpose to power a stronger economic future by enabling a fair and dynamic marketplace for all.
In your new role youll be part of a leading global securities exchange with a strong brand. We are known for being a trusted market operator and an exciting data hub.
Want to know why we are a great place to work click on the link to learn more.
are more than a securities exchange!
The ASX team brings together talented people from a diverse range of disciplines.
We run critical market infrastructure with 1 in 3 people employed within technology. Yet we have a unique complexity of roles across a range of disciplines such as operations program delivery financial products investor engagement risk and compliance.
Were proud to foster a workplace where diversity is celebrated and inclusion is part of our everyday culture. Our employee-led networks champion LGBTIQ inclusion promote gender equality accessibility and wellbeing inspire giving and volunteering and celebrate cultural and religious events creating a sense of belonging for all. As an AWEI Bronze employer and member of the Champions of Change Coalition for gender equality were committed to a fair and inclusive workplace where everyone can thrive.
About The Team:
The Digital and Technology team is part of the Engineering division within ASX Technology. We are a trusted partner and platform operator empowering our customers to safely access understand and share data and create sustainable solutions in an agile way.
About The Role:
The Senior AWS Data Engineer will lead the design development and integration of advanced data solutions built on AWS. This role will drive the architecture and optimisation of scalable data pipelines ensuring seamless integration of diverse data sources across the enterprise.
As a senior member of the team this role will mentor junior engineers collaborate closely with business and tech stakeholders and enable secure high performance and future ready data on AWS.
What Youll Do:
Embedded within one of our line-of-business data and reporting teams you will collaborate with stakeholders to understand their data objectives and champion the use and evolution of the central data platform.
You will work within a domain-aligned data product team consisting of line-of-business data owners and SMEs working alongside engineering resources provided by Technology.
You will be hands-on in the ingestion of ASXs core data assets by the product teams their curation into source-aligned data products and the creation of consumable products in the form of files reports dashboards and APIs.
You will form part of a data engineering practice and community that will design and drive the adoption of standards frameworks and best practices.
You will ensure data pipelines and products are designed and built to be run within a critical market infrastructure environment by the persistent product teams who build them.
What Youll Need:
Must have
A hands-on engineer with deep experience working with a variety of AWS services for ingestion curation storage orchestration data management analytics and distribution.
Good knowledge of data modelling and how to structure data within a data warehousing environment while following best practice data management standards.
Solid data product architecture and solution design experience with a good working knowledge of DevSecOps practices to achieve high levels of automation across complex data pipelines.
Experience in real time streaming using Confluence Kafka and AWS services.
Experience with Airflow AWS Glue Apache Iceberg Athena RedShift and DataZone.
Experience in Data visualization tools such as Tableau/Power BI/QuickSight.
Solid experience in Python Spark and Terraform/Terragrunt.
Nice to have:
Experience with Google BigQuery DataFlow and DataForm services.
A working knowledge of data mesh/data product concepts with federated data ownership at the domain-level but operating on centralised platforms and governance.
Experience working in Capital Markets domain and understanding of derivative products.
We make hiring decisions based on your skills capabilities and experience and how youll help us to live our values. We encourage you to apply even if you dont meet all the criteria of this role.
If you need any adjustments during the application or interview process to help you present your best self please let us know at
At ASX Group our diverse workforce is essential to build and maintain a fair and dynamic marketplace. We support flexible working and offer hybrid working options. Even if our roles are advertised as full-time we encourage you to apply if you are interested in part-time or other flexible working arrangements.
We will arrange for successful candidates to have background checks including reference and police checks completed as part of the on-boarding process.
Required Experience:
Senior IC
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
