Senior Data Engineer
Job Location:
Salary:
Experience Required:
Posted:
Application Deadline:
Vacancies:
Job Summary
Role purpose: Were hiring a Senior Data Engineer to deliver high-quality data solutions across a range of business demands building and maintaining pipelines datasets and data services that are reliable secure and easy to consume. This is a hands-on engineering role.
Key responsibilities:
- Build and maintain batch and/or streaming data pipelines end-to-end: ingest transform validate and publish.
- Develop reusable data transformation patterns and curated datasets for analytics and operational use cases.
- Work from requirements through to production delivery: design build test deploy and support.
- Implement data quality checks reconciliations and monitoring/alerting to keep data trustworthy.
- Optimize performance and cost through query tuning partitioning and efficient computer usage.
- Maintain clear documentation data definitions and runbook for supported pipelines.
- Troubleshoot production issues perform root cause analysis and implement permanent fixes.
- Collaborate with upstream/downstream teams to resolve data issues and improve interfaces/contracts.
- Follow security and governance expectations for sensitive data access controls and audibility.
Required skills and experience:
- Minimum 8 years of strong hands-on experience delivering data engineering solutions.
- Strong programming skills in Python and/or Java experience with advanced SQL and solid data modelling skills.
- Experience with distributed processing e.g. Spark and orchestration e.g. Airflow or equivalent.
- Experience with streaming/event platforms e.g. Kafka/PubSub is beneficial; ability to learn quickly if not.
- Strong engineering discipline: Git code reviews automated testing CI/CD and observability.
- Experience working with cloud data platforms: Azure/AWS/GCP and lake/lake-house/warehouse patterns.
- Proven ability to manage multiple data requests and priorities effectively and deliver at pace.
Required Skills:
Role purpose: Were hiring a Senior Data Engineer to deliver high-quality data solutions across a range of business demands building and maintaining pipelines datasets and data services that are reliable secure and easy to consume. This is a hands-on engineering role. Key responsibilities: Required skills and experience:
