Data Engineer
Share
Job Location:
Monthly Salary:
Posted on:
Yesterday
Vacancies:
1 Vacancy
Job Summary
The Data Engineer will work within a crossfunctional squad to design build and maintain highquality data assets that support reporting analytics and operational workflows.
Owning the endtoend lifecycle of data pipelines the role focuses on designing and maintaining Databricks (Spark/Delta) pipelines for batch and near realtime ingestion as well as implementing transformations conformance logic and curated datasets for reporting and analytics. It involves establishing robust data quality processessuch as validation checks and reconciliationsaddressing data integrity and performance issues and supporting release validation production readiness monitoring and incident response. The position also maintains accurate lineage sourcetotarget mappings secure role-based access controls aligned access patterns and documentation while driving automation of manual loads snapshots scheduling and CI/CD workflows.
Qualifications :
- Experience building and maintaining data pipelines in Databricks using Spark and Delta Lake
- Strong proficiency in SQL data transformations and optimisation techniques
- Solid understanding of data modelling ELT/ETL patterns and data architecture principles
- Experience implementing data quality checks validation routines and reconciliation processes
- Familiarity with CI/CD pipelines orchestration tools and automated deployment processes
- Experience working in agile crossfunctional squads
Additional Information :
Why join us:
NCS Australia is where you can feel at home nurturing your talents and skills as we make tomorrow together one day at a time. Our benefits include paid parental leave initiatives focused on your well-being and discounted health insurance. You will also enjoy discounts on various products and services and be regularly recognised and rewarded for high performance. We are committed to your career development through our Capability Fingerprint industry and partner training programs special interest groups and an AI-driven learning platform. No matter where you are in your career we offer meaningful work and opportunities for growth.
NCS Australia is an equal-opportunity employer and we take pride in our commitment to valuing and supporting our people and the communities we are dedicated to attracting retaining and developing our people regardless of gender identity ethnicity sexual orientation disability and age. Applications are encouraged from all sectors of the community and we strongly encourage applications from the Veterans Aboriginal and/or Torres Strait Islander community.
At NCS Australia we are committed to supporting adjustments throughout the recruitment and selection process as well as during employment. We actively support and encourage people with disability to apply.
Agencies:
Weve got this. We request that you do not contact NCS employees outside of the Talent Acquisition team. NCS exclusively accepts resumes from agencies on our preferred supplier panel through the NCS Agency Portal. Agencies that submit resumes must have a valid fee agreement and be assigned to the particular requisition by the Talent Acquisition team. Any resumes that are submitted outside of this process will become the sole property of NCS. If a candidate is hired outside of this process no fee or payment will be given.
Work rights and background checks:
To be eligible for a position with us applicants will need to have valid work rights for Australia and be willing to undergo a comprehensive background checking process including probity and police checks
Remote Work :
No
Employment Type :
Full-time
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
About Company
At NCS Australia, we believe in doing technology services better. Our commitment to quality, focus on people, and willingness to challenge traditional thinking set us apart. Our team brings this belief to life by partnering with our clients and communities to make tomorrow together. ... View more
