Data Engineer
Share
Job Location:
Monthly Salary:
Posted on:
19 hours ago
Vacancies:
1 Vacancy
Job Summary
The Game Changers:
Australian Payments Plus (AP) is here to shape the future of payments for Australia. We aim to deliver more innovation to Australias payments ecosystem for the collective benefit of Australian businesses government and consumers.
Our solutions include Australias domestic debit network real-time data rich payments infrastructure secure bill payments digital identity verification QR payments and experiences and open wallet solutions. Its a new chapter with more possibilities.
Life @ AP:
We are one connected team in pursuit of one inspiring purpose to unite people and technology to power better experiences. Each of us has a part to play in making that happen. Youll be encouraged to bring your big ideas forward and make a difference through your work. Taking steps forward in your career whilst still having room for fun friendships and flexibility in your daily life.
Were driven by our core values: lead with heart learn for tomorrow and live our legacy. A purpose like ours takes the inspired impact of an incredible team. Ready to change the game Were ready to help you do it.
The Purpose:
This highly technical role will lead the development of data projects and solutions across large and complex data sets. This role will design build and productionise the data pipelines and data assets that underpin multiple AP products and analytical projects.
The core accountabilities of the role will include:
- Build and develop data pipelines to ingest and transform data. Make data available for business use as per project and operational requirements.
- Ensure data integrity (accuracy consistency and completeness) of the data available on the modern data platform (Snowflake).
- Work with data analysts and business users to build and maintain the master data catalogue and system documentation.
- Build and maintain integrations between data lake data warehouse real-time streaming platforms databases ETL tools governance and BI tools.
- Write python scripts to manipulate and transform complex datasets merge different data sets together reformat data.
- Create and Publish data flow diagrams and data models.
- Secure data at rest and in Transit through encryption.
- Deploy automated machine learning data models that meet the desired business outcomes.
- Support platform enhancements capacity management performance monitoring troubleshooting and resolution of technical issues.
- Work closely with the team to ensure deliverables and targets are being met.
- Provide second level support on a rotational roster.
The capabilities needed to be successful for this role are:
- Tertiary qualification in engineering mathematics computer science or a related discipline.
- 2 years of experience in building and maintaining bank grade data infrastructure.
- Experience in transforming and manipulating large and complex datasets.
- Experienced with SQL and NoSQL modern data stores able to write complex queries and transformations.
- Experienced in implementing data warehousing (snowflake) solutions in large commercial environments and transforming and manipulating large and complex data sets.
- Enjoys working in an agile team and can work on user stories autonomously.
- Demonstrable track record of dealing well with ambiguity prioritizing needs and delivering results in a dynamic environment.
Nice to have:
- Good knowledge in using cloud infrastructure services such as Amazon Web Services SQL and NoSQL modern data stores.
- knowledge of one or more data processing technologies and a solid understanding of data modelling concepts.
- Familiarity with data reconciliation PII and PCI concepts for working with payment card and transaction data.
- Extensive knowledge of cloud scripting (Python) in one or more data processing technologies
- Familiar with APIs to pull data from various systems/platforms.
- Knowledge of cloud infrastructure services like Amazon Web Services.
What happens next:
At AP we believe in the power of passion pride and purpose. Our team is driven by a shared mission to make a difference in the world of payments and were proud to work together towards this common goal.
If youre ready to be a game changer please submit your application. The Talent Acquisition team will endeavour to review your application and notify you of the outcome within the next two weeks.
We want to remove all barriers to inclusion so if you need advice or support with your application were here to help. Please reach out to . We also encourage you to let us know your pronouns at any point during the recruitment process.
AP are not partnering with Recruitment agencies this role.
Required Experience:
IC
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
About Company
At AP+ we're changing the game! We're doing big things, and we can't do it alone. We're part of a big ecosystem, and we know teamwork and passion for our purpose is what will make us successful. We value the unique talents, perspectives, of all our employees. This includes people of a ... View more
