Senior Data Engineer
Share
Job Location:
Monthly Salary:
Posted on:
8 hours ago
Vacancies:
1 Vacancy
Job Summary
We are looking for a Senior Data Engineer to join our eCommerce Data team at NEXT. Based from NEXT Head Office in Leicestershire with a competitive salary range with great benefits!
Lets talk numbers. When it comes to UK retail its hard to find a bigger name. We sell thousands of items an hour and are expanding our e-commerce business by the second. For anyone in Tech this is the place to learn. To grow. And to thrive.
eCommerce Data provides the department and the business the means to see what is working and what is not by drawing data and analysing patterns of shopping on our site and in general.
About The Role:
As a Senior Data Engineer at Next you will be instrumental in developing and maintaining scalable data solutions within our Azure environment. You will be responsible for building robust data pipelines ensuring data quality and supporting our data science and analytics teams. This is a hands-on role where you will be expected to not only develop but also mentor junior engineers and trainees and contribute to the overall technical strategy of our data platform. You will primarily work with PySpark SQL on Databricks to deliver high-performance data solutions.
What else is involved
- Design develop and maintain scalable data pipelines and ETL processes using Azure services (e.g. Azure Data Factory Azure Databricks)
- Ensure data quality integrity and security across all data platforms implementing best practices for data governance.
- Collaborate with data scientists business analysts and other stakeholders to understand data requirements and provide necessary data infrastructure and solutions.
- Manage and optimize processes for performance scalability and cost-efficiency.
- Mentor and guide juniors fostering a culture of technical excellence and continuous learning.
- Troubleshoot and resolve complex data-related issues ensuring high availability and reliability of data systems.
Youll be doing all this from our Leicestershire Head Office. Our offices are inspiring yes. But we understand that life happens. So were big on making sure your work works for you which is why we offer flexible working.
About You:
- Strong knowledge of Python PySpark and SQL with extensive experience in developing and optimising data pipelines.
- In-depth knowledge and hands-on experience with Azure data services including Azure Databricks Azure Data Factory and Azure Data Lake Storage.
- Strong understanding and working experience of building CI/CD pipelines using relevant tools (e.g. Azure DevOps Git) for data solutions.
- Hands on experience of working with third party APIs for data transfers.
- Excellent problem-solving skills and attention to detail.
- Strong communication and interpersonal skills with the ability to collaborate effectively with cross-functional teams.
Desirable Skills:
- Experience with building streaming data pipelines and Delta Live Tables using Pyspark/Databricks.
- Experience with working in Google Cloud Platform is desirable.
So if you have experience within Data Engineering with great communication skills and the ability to translate business needs to technical requirements for building data engineering solutions this is the place for you - and your career.
Required Experience:
Senior IC
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
About Company
You know Next, but did you know we’re a FTSE-100 retail company employing over 35,000 people across the UK and Ireland. We’re the UK’s 2nd largest fashion retailer and for Kidswear we’re the market leader. At the last count we have over 500 stores, plus the Next Online and it’s now po ... View more
