Data Engineer

Technopride Ltd

Not Interested
Bookmark
Report This Job

profile Job Location:

London - UK

profile Monthly Salary: Not Disclosed
Posted on: 2 hours ago
Vacancies: 1 Vacancy

Job Summary

We are looking to hire Data Engineer- Advanced Analytics role for one of our renowned IT client in UK. This is a contract role and remote interestedplease share your CV at

Skill in SF - SME - Logical DBA MySQL

A strong Data Engineer is required to work on the Data Transformation workstream within Clients Digital Screening. The core focus of this role is to build secure repeatable data ingestion and transformation pipelines to implement data cleansing rules and to produce auditable reproducible outputs.

Establish Import/export patterns handling data extracts schema discovery incremental loads handling multiple source instances

Capability in data transformation-heavy pipelines from data-profiling to cleansing to standardization conformance and publishing Advanced knowledge of SQL for profiling joins/merges deduplication anomaly detection and performance tuning

Scripting knowledge in Python for automation parsing rules engines and data quality checks ability to write maintainable code. Experience using Python packages for data wrangling (e.g. Pandas Polars) modelling (e.g. scikit-learn) and visualization (e.g. matplotlib) Experience with modern data tooling (for example Spark Azure Data Factory) or ability to implement equivalents with code.

Proven experience working with geospatial data including handling spatial formats (e.g. vector raster GeoJSON shapefiles) coordinate reference systems and spatial analysis workflows Strong ability to interpret and apply geographical context in data processing pipelines with demonstrated capability to aggregate upscale or translate local/regional geospatial insights into broader national or regional-level datasets and analytical outputs

Experience working with publicly available official datasets particularly Office for National Statistics (ONS) open data products ( boundaries geographic lookups deprivation indices or mid-year population estimates)

Able to build rules for completeness/validity/consistency implement exception handling"

Work location: London / Remote

Eligible for BPSS



We are looking to hire Data Engineer- Advanced Analytics role for one of our renowned IT client in UK. This is a contract role and remote interestedplease share your CV at Skill in SF - SME - Logical DBA MySQLA strong Data Engineer is required to work on the Data Transformation workstream within Cl...
View more view more

Company Industry

IT Services and IT Consulting

Key Skills

  • Apache Hive
  • S3
  • Hadoop
  • Redshift
  • Spark
  • AWS
  • Apache Pig
  • NoSQL
  • Big Data
  • Data Warehouse
  • Kafka
  • Scala