Senior Data Engineer Data Platform
Share
Job Location:
Monthly Salary:
Posted on:
7 hours ago
Vacancies:
1 Vacancy
Job Summary
The Role
The Senior Data Engineer is a vital part of the Data Platform Team who provide a self-service platform and building blocks that enable teams across SEEK Asia Pacific to collaborate and work with data.
Senior Data Engineers are accountable for implementing the platform and tools collaborating with Principal Data Engineers to analyse problems and design solutions owning and operating the systems in production and mentoring and supporting more junior engineers.
What You Will Do
- Design development testing and operation of:
- Frameworks for creating testing deploying and orchestrating data processing pipelines
- Tools for querying managing and monitoring data including quality security lifecycle
- Tools for managing and monitoring data systems and processes
- Deploy operate and support data infrastructure and services on AWS
- Maintaining platform health ensuring that our systems are secure reliable resilient and cost effective.
- Growing the technical capabilities of more junior engineers through coaching and mentoring.
Qualifications :
Essential Qualifications Skills and Experience
- Building and operating cloud-based data processing and warehousing solutions
- Big data processing experience preferably Spark & Hadoop
- Strong software engineering coding & scripting
- Advanced SQL and database skills
- Logical and physical data modelling
- Ownership of deployments infrastructure system administration monitoring and operations (ie. DevOps)
Desirable Qualifications Skills and Experience
- Data pipeline / ETL / workflow orchestration with Airflow
- AWS services particularly EMR & S3 but also IAM Cloudformation Glue Catalog Athena Lambda Kinesis SNS SQS SSM RDS
- Experience in Databricks (new data platform)
- Develop clean code using good practices like CI/CD TDD pair programming code review
- Strong understanding of database and SQL performance optimisation
- Coding in Python Spark Scala
- Advanced Linux and bash scripting
- Containerisation with Docker
- Splunk and/or Datadog
- Git & Github
- Mentoring and coaching junior developers
Additional Information :
The Team
- Reporting to the Engineering Manager Data Platform APAC
- Team members: Principal senior and mid-level data engineers
- Key internal stakeholders include: Data Engineering teams Analytics teams Product Delivery teams AI and Platform Services teams Architecture and Practice teams Security teams Data Infrastructure team
At SEEK we offer:
- Tailored career development planning
- Professional development sessions with industry leading guest speakers
- Support of flexible working including a mix of office and work from home days depending on your role
- Annual Performance Bonus Plan
At SEEK we are passionate about fostering a culture of inclusion and wellbeing that embraces and values the diversity of our people. We are a purpose driven business that works with heart.
We know teams with diverse ideas experiences and perspectives are more creative and are critical to ensuring effective delivery and innovating to enable our future success. As such we welcome applications from people with diverse backgrounds and life experiences especially as they relate to gender sexual identity culture faith disability and life stages. If you have the skills curiosity and an adaptable mindset but dont meet every responsibility or qualification listed in this advertisement please still get in touch with us. Should you require any specific support or adjustments throughout the recruitment process and beyond please advise us and we will be happy to assist.
For this role only those with eligible right to work will be considered.
SEEK kindly requests no unsolicited resumes or approaches from recruitment agencies and will not be responsible for any associated fees.
Remote Work :
No
Employment Type :
Full-time
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
About Company
At SEEK, we work with heart. Our purpose is to help people live more fulfilling and productive working lives and help organisations succeed. We make a positive impact on a truly global scale and our world-class technology solutions connect more people to relevant employment and educat ... View more
