Senior Data Engineer
Senior Data Engineer
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
Our data team has expertise across engineering analysis architecture modeling machine learning artificial intelligence and data science. This discipline is responsible for transforming raw data into actionable insights building robust data infrastructures and enabling data-driven decision-making and innovation through advanced analytics and predictive modeling.
Responsibilities:
- Develop the architecture for the data pipelines and implement it using Python
- Actively involved in onboarding data sources through data pipelines - ingestion transformations data storing and orchestration of the pipelines
- Identify document and develop measures to visualize and record source data and data pipeline quality objectives
- Experience with data migration projects between systems hosted in different hosting environments (on-premises AWS Azure etc.)
- Work closely with technical leads PM BA testing and reporting team on data requirements
- Contribute to agile ceremonies size tasks and deliverables.
Qualifications :
- 5 years of experience designing and developing data pipelines and managing data infrastructure
- Proficiency in Python (pandas PySpark)
- Background and experience with tools and technologies like Databricks Data Lake Storage Snowflake Synapse Redshift Apache Spark Kimball Data Mart Azure Key Vault
- Experience with various Azure services for data processing and storage data integration and analytics with Azure Synapse Workspaces
- Understanding of Extract Transform Load (ETL) processes as well as platform monitoring and CI/CD processes
- Knowledge of one or more RDBMS (SQL Server Oracle DB2)
- Experience with reporting and dashboard creation with Power BI and similar tools will be a plus
- Open to working in an agile environment as part of a scrum team
- Advanced English speaking and writing abilities are required.
Additional Information :
Discover some of the global benefits that empower our people to become the best version of themselves:
- Finance: Competitive salary package share plan company performance bonuses value-based recognition awards referral bonus;
- Career Development: Career coaching global career opportunities non-linear career paths internal development programmes for management and technical leadership;
- Learning Opportunities: Complex projects rotations internal tech communities training certifications coaching online learning platforms subscriptions pass-it-on sessions workshops conferences;
- Work-Life Balance: Hybrid work and flexible working hours employee assistance programme;
- Health: Global internal wellbeing programme access to wellbeing apps;
- Community: Global internal tech communities hobby clubs and interest groups inclusion and diversity programmes events and celebrations.
At Endava were committed to creating an open inclusive and respectful environment where everyone feels safe valued and empowered to be their best. We welcome applications from people of all backgrounds experiences and perspectivesbecause we know that inclusive teams help us deliver smarter more innovative solutions for our customers. Hiring decisions are based on merit skills qualifications and potential. If you need adjustments or support during the recruitment process please let us know.
Remote Work :
No
Employment Type :
Full-time
Employment Type
Full-time
