Lead Data Engineer
Share
Job Location:
Nottingham - UK
Monthly Salary:
Not Disclosed
Posted on:
17 hours ago
Vacancies:
1 Vacancy
Department:
Job Summary
We are looking for a Lead Engineer to join our established agile team that supports innovation learning and collaboration.
Reporting into our Engineering Director you will ensure that the team follows the highest technical standards abd support Agile methods to deliver high value outcomes.
Main responsibilities:
- Work in an outstanding Agile technical team
- Build data pipelines and data lake
- Deliver quality software
- Collaborate with the risk security and compliance teams to ensure adherence to regulatory requirements (e.g. GDPR PCI DSS) and industry standards related to data privacy and security
- Understand where there are overlapping technical requirements in your team and other teams and help build out technology roadmaps
- Codebase ownership
- Technical Application ownership
Qualifications :
- Lead Engineering experience at a large organisation
- DevOps & IaC tooling - Terraform CI/CD pipelines Git Jenkins
- Strong experience of developing on Apache Spark/Hadoop
- Significant knowledge of AWS cloud services including (but not limited to) AWS Glue S3 StepStrong
- Experience building data pipelines and Data Lake
- Significant experience of programming using Scala or Python.
- Configuration as code principles and API integration
- Ability to analyse investigate and compare large data sets when required
- Experience with automated testing methodologies
Additional Information :
Benefits package includes:
- Hybrid and flexible working
- Great compensation package and discretionary bonus plan
- Core benefits include pension bupa healthcare sharesave scheme and more
- 25 days annual leave with 8 bank holidays and 3 volunteering days. You can purchase additional annual leave.
Our uniqueness is that we celebrate yours. Experians culture and people are important differentiators. We take our people agenda very seriously and focus on what matters; DEI work/life balance development authenticity collaboration wellness reward & recognition volunteering... the list goes on. Experians people first approach is award-winning; Worlds Best Workplaces 2024 (Fortune Top 25) Great Place To Work in 24 countries and Glassdoor Best Places to Work 2024 to name a few. Check out Experian Life on social or our Careers Site to understand why.
Experian is proud to be an Equal Opportunity and Affirmative Action employer. Innovation is an important part of Experians DNA and practices and our diverse workforce drives our success. Everyone can succeed at Experian and bring their whole self to work irrespective of their gender ethnicity religion colour sexuality physical ability or age. If you have a disability or special need that requires accommodation please let us know at the earliest opportunity.
Experian Careers - Creating a better tomorrow together
Find out what its like to work for Experian by clicking here
#LI-Hybrid
Experian Careers - Creating a better tomorrow together
Find out what its like to work for Experian by clicking here
Remote Work :
No
Employment Type :
Full-time
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
About Company
Experian is a global data and technology company, powering opportunities for people and businesses around the world. We help to redefine lending practices, uncover and prevent fraud, simplify healthcare, create marketing solutions, and gain deeper insights into the automotive market, ... View more
