Streaming Engineer
Streaming Engineer
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
Job Description
Streaming Engineer Payments Kafka Pyspark
About our client:
Our client is a renowned multinational consultancy who is working with a Big 4 Banking end client.
They offer access to cutting-edge resources continuous learning and development programs and a collaborative environment that fosters creativity and career growth. Their commitment to diversity and inclusion ensures a welcoming workplace for all. Additionally the companys focus on sustainability and social responsibility allows employees to contribute to meaningful global initiatives.
About the Role:
We are seeking a Streaming Engineer with over 10 years of IT experience including at least 3 years in hands-on development testing and administration of Big Data/Data Lake services both in the cloud and on-premise. The role involves applying industry best practices design patterns and technical solutions for various platforms and applications.
Key Skills Required:
Pyspark Kafka & Dynamo (with AWS as preferable)
- AWS Glue for cataloging and batch job runs
- AWSApache Icerberg for long-term batch data storage
- Dynamo DB on AWS for real-time data storage
- PySpark for data ingestion
- Kafka for Event and Schema reading
- Devops tools Jenkin Bitbucket Hashicorp vault Artifactory AWS pipelines
Key Responsibilities:
- Develop test and support future-ready data solutions for customers across industry verticals
- Develop test and support end-to-end batch and near real-time data flows/pipelines
- Demonstrate understanding in data architectures modern data platforms big data ML/AI analytics cloud platforms data governance and information management and associated technologies
- Develop and demonstrate Proof of Concepts and Working Demos
- Lead or collaborate with other internal/external consultants in consulting workshops and delivery engagements
- Mentor junior consultants in practice and delivery engagements
Whats on offer
- This contract is available for an initial 6-month term with extensions.
- Located in Sydney CBD this role offers a hybrid working arrangement.
How to Apply
Please upload your resume to apply. We will be in touch with further instructions for suitably skilled candidates. Please note that you will be required to complete selection criteria to complete your application for this role.
Call Katrina Gabriel onor email for any further information.
Candidates will need to be willing to undergo pre-employment screening checks which may include ID and work rights security clearance verification and any other client requested checks.
Employment Type
Full-Time
