Databricks Engineer (Contract role)
Share
Job Location:
Monthly Salary:
Posted on:
3 hours ago
Vacancies:
1 Vacancy
Job Summary
We are looking for an experienced Databricks Engineer to support in building enhancing and maintaining its modern data platform. This role is responsible for designing and delivering scalable data pipelines optimising data processing workloads and ensuring the reliability and performance of Databricks-based solutions.
The ideal candidate will have strong handson experience across Azure Databricks PySpark Delta Lake and modern data engineering best practices. Experience working in large enterprise environments will be highly regarded.
In this role you will design develop and maintain scalable data pipelines using Azure Databricks PySpark and Delta Lake to support the analytics and reporting needs. You will collaborate closely with stakeholders architects and crossfunctional teams to translate business requirements into effective technical solutions while optimising Databricks clusters workflows and runtime configurations for performance and cost efficiency. You will also ensure strong data quality governance and security practices across the platform troubleshoot and resolve pipeline and performance issues and support CI/CD processes version control and DevOps practices for deploying data solutions. Additionally you will contribute to continuous improvement of the data platform and work jointly with the teams to deliver enhancements and maintain a reliable modern data ecosystem.
Qualifications :
- Strong handson experience with Azure Databricks (or Databricks on AWS/GCP).
- Proficiency in PySpark SQL and distributed data processing.
- Experience building and managing Delta Lake solutions.
- Strong understanding of data modelling ETL/ELT frameworks and data warehousing concepts.
- Experience with Azure Data Factory Azure Data Lake Storage (ADLS) or related Azure data services.
- Good understanding of CI/CD Git DevOps pipelines and environment management.
- Experience working in agile enterprise environments.
- Exposure to Databricks Unity Catalog and advanced security features.
- Experience with streaming technologies (e.g. Structured Streaming Kafka).
Additional Information :
Why join us:
NCS Australia is where you can feel at home nurturing your talents and skills as we make tomorrow together one day at a time. Our benefits include paid parental leave initiatives focused on your well-being and discounted health insurance. You will also enjoy discounts on various products and services and be regularly recognised and rewarded for high performance. We are committed to your career development through our Capability Fingerprint industry and partner training programs special interest groups and an AI-driven learning platform. No matter where you are in your career we offer meaningful work and opportunities for growth.
NCS Australia is an equal-opportunity employer and we take pride in our commitment to valuing and supporting our people and the communities we are dedicated to attracting retaining and developing our people regardless of gender identity ethnicity sexual orientation disability and age. Applications are encouraged from all sectors of the community and we strongly encourage applications from the Veterans Aboriginal and/or Torres Strait Islander community.
At NCS Australia we are committed to supporting adjustments throughout the recruitment and selection process as well as during employment. We actively support and encourage people with disability to apply.
Agencies:
Weve got this. We request that you do not contact NCS employees outside of the Talent Acquisition team. NCS exclusively accepts resumes from agencies on our preferred supplier panel through the NCS Agency Portal. Agencies that submit resumes must have a valid fee agreement and be assigned to the particular requisition by the Talent Acquisition team. Any resumes that are submitted outside of this process will become the sole property of NCS. If a candidate is hired outside of this process no fee or payment will be given.
Work rights and background checks:
To be eligible for a position with us applicants will need to have valid work rights for Australia and be willing to undergo a comprehensive background checking process including probity and police checks
Remote Work :
No
Employment Type :
Full-time
Key Skills
- IVR
- SOAP
- Avaya
- Solaris
- Cost Accounting Standards
- Database Design
- Hibernate
- ITIL
- Weblogic
- Express.js
- Contracts
- ASP
About Company
At NCS Australia, we believe in doing technology services better. Our commitment to quality, focus on people, and willingness to challenge traditional thinking set us apart. Our team brings this belief to life by partnering with our clients and communities to make tomorrow together. ... View more
