Data Engineer
Data Engineer
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Not Disclosed
Salary Not Disclosed
1 Vacancy
Job Description
We are seeking a skilled and analytical Data Engineer to join our team in this role you will be responsible for designing implementing and maintaining robust data infrastructure to support our organizations data-driven decision-making processes.
- Design develop and maintain scalable data pipelines to extract transform and load data from various sources.
- Collaborate with data scientists and analysts to understand data requirements and implement efficient data models.
- Optimize data storage and retrieval systems to ensure high performance and reliability.
- Implement and maintain data quality checks and monitoring systems.
- Develop and maintain documentation for data processes and architectures.
- Stay up-to-date with emerging technologies and best practices in data engineering.
- Troubleshoot and resolve data-related issues in a timely manner.
- Ensure data security and compliance with relevant regulations and company policies.
Qualifications :
- 7 years of experience in data engineering or a related role.
- Programming Languages: Python (pySpark) SQL
- Big Data Frameworks: Apache Spark Databricks (including Delta Lake and Delta Tables) or equivalent
- Cloud Platforms & Services: AWS (main) Azure or GCP
- Data Engineering: Data pipelines ETL/ELT design batch and streaming data processing
- Data Storage & Management: Delta Tables Azure Data Lake Azure Blob Storage
- Orchestration & Integration: Azure Data Factory (ADF) Azure Functions Event-driven architecture
- Workflow & Automation Tools: CI/CD pipelines version control (Git) DevOps practices
- Data Modeling & Warehousing: Dimensional modeling data lakes lakehouse architectures
- Monitoring & Optimization: Performance tuning in Spark job monitoring
- Collaboration Tools: Jira Confluence Agile/Scrum methodologies
Additional Information :
Discover some of the global benefits that empower our people to become the best version of themselves:
- Finance: Competitive salary package share plan company performance bonuses value-based recognition awards referral bonus;
- Career Development: Career coaching global career opportunities non-linear career paths internal development programmes for management and technical leadership;
- Learning Opportunities: Complex projects rotations internal tech communities training certifications coaching online learning platforms subscriptions pass-it-on sessions workshops conferences;
- Work-Life Balance: Hybrid work and flexible working hours employee assistance programme;
- Health: Global internal wellbeing programme access to wellbeing apps;
- Community: Global internal tech communities hobby clubs and interest groups inclusion and diversity programmes events and celebrations.
At Endava were committed to creating an open inclusive and respectful environment where everyone feels safe valued and empowered to be their best. We welcome applications from people of all backgrounds experiences and perspectivesbecause we know that inclusive teams help us deliver smarter more innovative solutions for our customers. Hiring decisions are based on merit skills qualifications and potential. If you need adjustments or support during the recruitment process please let us know.
At Endava were committed to creating an open inclusive and respectful environment where everyone feels safe valued and empowered to be their best. We welcome applications from people of all backgrounds experiences and perspectivesbecause we know that inclusive teams help us deliver smarter more innovative solutions for our customers. Hiring decisions are based on merit skills qualifications and potential. If you need adjustments or support during the recruitment process please let us know.
Remote Work :
No
Employment Type :
Full-time
Employment Type
Full-time
