Our data team has expertise across engineering analysis architecture modeling machine learning artificial intelligence and data science. This discipline is responsible for transforming raw data into actionable insights building robust data infrastructures and enabling data-driven decision-making and innovation through advanced analytics and predictive modeling.
Responsibilities:
- Develop the architecture for the data pipelines and implement it using Python
- Actively involved in onboarding data sources through data pipelines - ingestion transformations data storing and orchestration of the pipelines
- Leads and mentors a team of data professionals by providing guidance and support in their day-to-day tasks and overall professional development
- Identify document and develop measures to visualize and record source data and data pipeline quality objectives
- Experience with data migration projects between systems hosted in different hosting environments (on-premises AWS Azure etc.)
- Contribute to agile ceremonies size tasks and deliverables.
Qualifications :
- Hands on experience in designing and developing data pipelines and managing data infrastructure
- Proficiency in Python (pandas PySpark)
- Proven experience in leading and mentoring teams
- Background and experience with tools and technologies like Databricks Glue Athena Snowflake Synapse Redshift BigQuery Apache Spark Kimball Data Mart etc
- Experience with various Azure services for data processing and storage
- Understanding of Extract Transform Load (ETL) processes as well as platform monitoring and CI/CD processes
- Knowledge of one or more RDBMS (SQL Server Oracle DB2)
- Experience with IaC tools will be an advantage
- Experience working in an Agile environment
- Excellent communication skills and the ability to take part in both team debates as well as client discussions
- Advanced English speaking and writing abilities are required.
Additional Information :
Discover some of the global benefits that empower our people to become the best version of themselves:
- Finance: Competitive salary package share plan company performance bonuses value-based recognition awards referral bonus;
- Career Development: Career coaching global career opportunities non-linear career paths internal development programmes for management and technical leadership;
- Learning Opportunities: Complex projects rotations internal tech communities training certifications coaching online learning platforms subscriptions pass-it-on sessions workshops conferences;
- Work-Life Balance: Hybrid work and flexible working hours employee assistance programme;
- Health: Global internal wellbeing programme access to wellbeing apps;
- Community: Global internal tech communities hobby clubs and interest groups inclusion and diversity programmes events and celebrations.
At Endava were committed to creating an open inclusive and respectful environment where everyone feels safe valued and empowered to be their best. We welcome applications from people of all backgrounds experiences and perspectivesbecause we know that inclusive teams help us deliver smarter more innovative solutions for our customers. Hiring decisions are based on merit skills qualifications and potential. If you need adjustments or support during the recruitment process please let us know.
Remote Work :
No
Employment Type :
Full-time