Lead Data Engineer
Share
Job Location:
Monthly Salary:
Posted on:
30+ days ago
Vacancies:
1 Vacancy
Job Summary
The Team
The AI & Analytics Data Products team builds high-quality data assets that empower teams across SEEK Group to gain valuable insights and enhance experiences for both individuals and organisations.
This position will report to the Engineering Manager and be part of a team made up of senior and mid-level data engineers. The team collaborates closely with internal peers including staff senior and mid-level data engineers; analytics engineers; data solution designers; and data tracking specialists.
About the role
A Lead Data Engineer is a hands-on technical role contributing to the build and operation of technical solutions but has additional leadership responsibility for people management and delivery outcomes.
Responsibilities
Technology
- Hands-on development and operational support duties alongside other data engineers.
- Ongoing ownership of solutions you build to ensure they remain fit for purpose meet customer needs meet technology health metrics and align with architectural guidelines.
Delivery
- Driving customer focus and engagement to ensure we are delivering outcomes for our customers.
- Setting goals prioritising planning as well as contributing to budgeting and resourcing
- Lead delivery and operation of data products along with the data processing pipelines and orchestration to deliver them.
People
- Direct line management of a small team of engineers
- Performance review and management of individuals.
- Professional growth via coaching and mentoring.
Qualifications :
Skills and experience
- Proven years of experience in Data Engineering delivering scalable reliable and production-grade data solutions on cloud platforms
- Deep expertise in big data processing frameworks ideally Apache Spark on Databricks or AWS EMR. Solid experience of both batch and streaming data pipelines
- Strong software engineering background with solid practices in CI/CD automated testing and version control
- Advanced proficiency in SQL and database design with a strong focus on performance optimisation and data modelling
- Proven track record in infrastructure ownership including deployment system administration monitoring and operations (with a DevOps mindset)
- Strong experience in coding with Python. Good experience with Scala is a bonus.
- Solid experience with Cloud Data Warehouse like Databricks Snowflake or Big Query
- Deep understanding of AWS services with a focus on Big Data technologies such as EMR Athena Glue and S3 as well as experience with IAM Cloudformation CDK Lambda SNS SQS SSM
- Extensive background in supporting BI Analytics Data Science and AI/ML initiatives
- With at least 3 years of experience in leading and mentoring team members contributing to their technical growth and fostering a collaborative team culture
- Demonstrated ability to own and deliver end-to-end solutions using Agile methodologies driving initiative planning iterative solution design and stakeholder engagement to ensure alignment and value delivery
Additional Information :
Permanent Perks
At SEEK we offer:
- Annual Performance Bonus Plan
- Support of flexible working including a mix of office and work from home days depending on your role.
- Paid and unpaid leave benefits including Personal Flexi Days and Volunteer Days as well as the opportunity to purchase additional leave
- Support for parents with 14 weeks paid primary carers leave and 2 weeks paid leave for partners
- SEEK is committed to operating sustainably and is preparing for the impacts of climate change and the transition to a low-carbon future and is working to minimise its environmental impacts which includes a long-term emissions reduction target of net zero by FY2050
- The opportunity to work from anywhere for up to 4 weeks per financial year
At SEEK we are passionate about fostering a culture of inclusion and wellbeing that embraces and values the diversity of our people. We are a purpose driven business that works with heart.
We know teams with diverse ideas experiences and perspectives are more creative and are critical to ensuring effective delivery and innovating to enable our future success. As such we welcome applications from people with diverse backgrounds and life experiences especially as they relate to gender sexual identity culture faith disability and life stages. If you have the skills curiosity and an adaptable mindset but dont meet every responsibility or qualification listed in this advertisement please still get in touch with us.
Should you require any specific support or adjustments throughout the recruitment process and beyond please advise us and we will be happy to assist.
For this role only those candidates with the eligible right to work will be considered.
SEEK kindly requests no unsolicited resumes or approaches from recruitment agencies and will not be responsible for any associated fees.
Remote Work :
No
Employment Type :
Full-time
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
About Company
At SEEK, we work with heart. Our purpose is to help people live more fulfilling and productive working lives and help organisations succeed. We make a positive impact on a truly global scale and our world-class technology solutions connect more people to relevant employment and educat ... View more
