Senior Data Engineer
Share
Job Location:
Monthly Salary:
Posted on:
30+ days ago
Vacancies:
1 Vacancy
Department:
Job Summary
Job description
Job Description
Experian UK&I Business information division is looking for an accomplished Senior Data Engineer to join our dynamic team. You will develop data engineering applications and scalable data platforms. You will collaborate closely with teams to implement solutions that create value.
Key Responsibilities:
- Design build and maintain scalable cloud-native data pipelines using AWS.
- Develop ETL/ELT workflows using Glue Pyspark and Python
- Improve data modeling partitioning and querying strategies
- Experience reading and developing Terraform-based infrastructure code
Qualifications
- Bachelors degree in computer science Engineering
- 5 to 7 years of experience in data engineering.
- Strong expertise in cloud development particularly with AWS services such as Aurora PostgreSQL RDS Glue S3 IAM EC2 Lambda.
- Hands-on experience and implementing best practices with AWS Glue Glue data catalog and pyspark
- Proficient in PySpark and Python and expertise in SQL.
- Experience in AWS Data lake Apache Iceberg and Lake Formation.
- Understanding of data modelling.
- Experience working in agile multi-project environments.
- Experience with CI/CD pipelines and DevOps practices.
Qualifications :
Qualifications
- Bachelors degree in computer science Engineering 5 to 7 years of experience in data engineering. Expertise in cloud development with AWS services such as Aurora PostgreSQL RDS Glue S3 IAM EC2 and Lambda.
Additional Information :
Our uniqueness is that we celebrate yours. Experians culture and people are important differentiators. We take our people agenda very seriously and focus on what matters; DEI work/life balance development authenticity collaboration wellness reward and recognition volunteering... the list goes on. Experians people first approach is award-winning; Worlds Best Workplaces 2024 (Fortune Top 25) Great Place To Work in 24 countries and Glassdoor Best Places to Work 2024 to name a few. Check out Experian Life on social or our Careers Site to understand why.
Experian is proud to be an Equal Opportunity and Affirmative Action employer. Innovation is an important part of Experians DNA and practices and our diverse workforce drives our success. Everyone can succeed at Experian and bring their whole self to work irrespective of their gender ethnicity religion colour sexuality physical ability or age. If you have a disability or special need that requires accommodation please let us know at the earliest opportunity.
Experian Careers - Creating a better tomorrow together
Find out what its like to work for Experian by clicking here
Remote Work :
No
Employment Type :
Full-time
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
About Company
Experian is a global data and technology company, powering opportunities for people and businesses around the world. We help to redefine lending practices, uncover and prevent fraud, simplify healthcare, create marketing solutions, and gain deeper insights into the automotive market, ... View more
