Shelley Currie

Shelley Currie

Data Engineer with over 25 years of experience
United Kingdom
English

About Me

Experienced Independent Data Engineer , since 2014.

Building data pipelines in the Cloud. Data Warehousing, design and creation.
Azure Synapse Analytics, Data Factory, Data Bricks.
GCP, BigQuery, Snowflake, Airflow, DB…

Experience

Data Engineer

Champions Software
May 2022 - Present · 4 years 6 months

Data Engineer - working as a contractor at John Lewis, building ETL Pipelines using Airflow and DBT to migrate and transform data from Google Cloud into Snowflake.

As a contractor I have worked on many other technologies.

GCP Data Engineer

Self Employed Contractor
Jul 2022 - Nov 2023 · 1 year 4 months

<p>Using Python, Airflow ver 2.72, DBT, Snowflake, Data Vault<br>
Migrating data from BigQuery into Snowflake using Airflow and DBT<br>
Working with complex queries and large amounts of data for delivery of data for Machine Learning models<br>
Providing Waitrose with £4 million in annual savings</p>

AWS Data Engineer

HMRC
Jun 2021 - Jun 2022 · 1 year

<p>Working with AWS, Spark, HDFS, Cloudera, HUE, Impala, ETL pipelines, Python, Pandas and PySpark<br>
Using Azure Synapse Analytics and Data Factory<br>
Working on big data solutions for HMRC<br>
Working with a large team with a diverse skill set including Java Spring, Elastic Search, HDFS, Spark on Cloudera and Unix Shell Scripting<br>
Interfacing with an existing Java Spring application that delivered search requests to Border Force via an Angular front end and Elastic Search<br>
Creating data extracts running on Spark, written in Spark SQL and PySpark<br>
Working alongside Java developers to implement data changes to meet business needs<br>
Refactoring existing applications and data delivery pipelines<br>
Using Unix Shell Scripting</p>

Data Stages (Canada)
Apr 2021 - Jun 2021 · 2 months

<p>Working on an Azure solution collecting telemetry information on forklift battery usage across 12 sites in the USA<br>
Using Azure Synapse Analytics, Data Factory and SQL Server on premise</p>

Snr ETL Developer

Laborie (Canada)
Mar 2020 - Nov 2020 · 8 months

<p>Building an ETL migration process running on SQL Server to export data from source databases into Data Cube<br>
Providing remote support of the ETL process</p>

Snr ETL Developer

WaterLogic
Jun 2019 - Aug 2019 · 2 months

<p>Building an ETL migration process along with data quality and master data management processes<br>
Using the SQL Server stack</p>

ETL Developer

The Law Society
Nov 2017 - Jun 2018 · 7 months

<p>Developing an ETL process migrating legacy databases into Microsoft Dynamics<br>
Using SQL Server 2016 and SSIS<br>
Working alongside the consultancy company Net Company</p>

BI Developer

LineView Solutions
Apr 2017 - Sep 2017 · 5 months

<p>Developing a BI reporting database using Azure Data Lake, U-SQL, Azure Analysis Services and Power BI<br>
Using Mongo Db</p>

Developer

Lily Software Limited
Jan 2017 - Mar 2017 · 2 months

<p>Doing Alexa Skills development<br>
Using Azure Cosmos Db SQL API with Python<br>
Building manufacturing BI software solutions</p>

SQL BI Developer

Briggs Equipment U.K. Ltd.
Apr 2016 - Dec 2016 · 8 months

<p>Providing BAU support of an existing Enterprise Data Warehouse and ETL system<br>
Delivering data to the Customer Portal and Parts Portal<br>
Using SQL Server 2008 R2</p>

SQL BI Developer

Central Midlands Cooperative
Jun 2015 - Nov 2015 · 5 months

<p>Visiting various Funeral homes to understand their working practice<br>
Designing and developing the initial ETL process and data warehouse for funeral business reporting<br>
Designing and developing an ETL process for promotions<br>
Providing back end data services for the front end Qlik View developers<br>
Using Netezza, SQL Server 2012, SSIS and Power BI for business reports development for Funeral and Retail</p>

SQL BI Developer

PDSA
Sep 2014 - May 2015 · 8 months

<p>Designing and developing ETL for the extraction of veterinary data from the central database hosting VetSpace on a SQL Server 2012 platform<br>
Designing the staging environment and data warehouse using Bill Inmon methodology<br>
Developing reporting databases for the Finance and Management Information departments<br>
Producing data extracts for import into Sage 200<br>
Using VetSpace and Sage 200<br>
Using SQL Server 2012, T-SQL, Stored Procedures, Database Design, SSIS and Excel</p>

SQL BI Developer

RAC
May 2014 - Aug 2014 · 3 months

<p>Designing and developing a marketing database and related SSIS packages for extraction, validation and loading of marketing data<br>
Developing a series of MI and financial reports for senior management<br>
Identifying the business impact of migrating applications and databases from SQL Server 2008 R2 to SQL Server 2014</p>

SQL Server Developer

Central Midlands CSU (NHS, Service provider)
Apr 2009 - Apr 2014 · 5 years

<p>Working on projects including Long Term Condition Risk Stratification, Mental Health, Life Style Services and SUS<br>
Designing OLTP and OLAP databases<br>
Using SQL Server Integration Services for ETL processes loading and processing GP and Secondary Care data<br>
Designing and developing SQL Server Analysis Services cubes<br>
Developing some reports using SQL Reporting Services and mainly using Excel<br>
Processing very large data sets for the 17 PCTs within the West Midlands<br>
Managing the design and development of the Risk Stratification project<br>
Ensuring required components were delivered according to specification<br>
Managing project delivery while negotiating a reduced project scope to deliver within the required time frame<br>
Designing and developing validation rules for GP data<br>
Producing reports to enable checking of data input, output and error counts<br>
Identifying where problems occurred and resolving them<br>
Providing operational support of the process</p>

Technical database specialist

Tesco plc
May 2007 - Apr 2009 · 1 year 11 months

<p>Designing and developing a SSAS cube for the analysis of sales information<br>
Developing SSIS packages for extraction, cleansing and loading of data into the Data Warehouse<br>
Managing the software deployment process through the development lifecycle from develop to test to production<br>
Working on the Loyalty Club Card Scheme with a team of front end developers to develop a database to support the scheme<br>
Using SQL Server 2005, SQL Server Analysis Services, TSQL, Stored Procedures, SQL Server Integration Services and Excel reporting</p>

Snr Analyst Programmer

Prima Consulting, Melbourne
May 2006 - Jan 2007 · 8 months

<p>Working on high level requirements and documentation<br>
Doing database normalisation<br>
Designing and developing a data migration process<br>
Using SQL 2000, TSQL, SQL 2005, Stored Procedures, Test Case preparation and SQL Injection<br>
Meeting and discussing requirements with the bank’s management team<br>
Designing and developing the reporting database according to the bank’s business standards<br>
Analyzing reporting requirements for a data warehouse<br>
Gathering customer requirements for the shipping and logistics department and producing high level business requirements for development by the reporting team<br>
Analyzing and recommending optimization solutions for a poorly performing sales database<br>
Reviewing the performance and design of a poorly performing production database and recommending areas for improvement</p>

Technical Consultant

Steria Ltd.
Jul 2005 - Mar 2006 · 8 months

<p>Working on pre-sales projects and bids for joint partnerships with companies like BT and an e-Business project for Kent County Council<br>
Producing documentation for bids for potential new business<br>
Meeting with customers and advising them on how Steria can work with them to improve their business process<br>
Working with the Steria Sales team to produce reports to help sales managers understand the effectiveness of their sales teams</p>

SQL Server DBA

Various AON Customer sites, Royal Bank of Scotland
Aug 2004 - Jun 2005 · 10 months

<p>Serving as SQL Server Team Leader<br>
Providing day to day DBA support for a number of customers<br>
Resolving SQL Server problems<br>
Working with the AON management team to define and document the process and procedures required to manage alterations to the schema and reference data due to usage of a bespoke application</p>

Development Consultant, SQL Server Team Leader

EDS
Oct 2000 - Jul 2004 · 3 years 9 months

<p>Converting Enterprise Java Beans from EJB Version 1.1 to 2.0<br>
Migrating EJBs from Bea Weblogic Version 5 to 7<br>
Developing the Genesis application using EJB 2.0, JSPs and JUnit test cases<br>
Creating test plans to ensure development work was in accordance with requirements documentation<br>
Testing components using JUnit</p>

Senior Analyst Programmer

Lysander Systems Ltd
Jan 1999 - Sep 2000 · 1 year 8 months

<p>Designing and creating data warehouse solutions for large insurance organisations using SQL Server 7<br>
Designing and creating data transformation and migration packages for extraction and loading of warehouses using SQL Server 7 DTS and VB Script<br>
Doing web development for the Lysander E Commerce portal using HTML, client side JavaScript, Active Server Pages and COM objects<br>
Using SQL Server 7, SQL Server DTS, Visual Basic 6, HTML 4.0, ASP 2, Windows NT 4 and JavaScript 1.2</p>

Analyst Programmer, Project Leader

Dr Solomon’s (Anti-Virus Company)
Sep 1995 - Aug 1998 · 2 years 11 months

<p>Doing business process analysis<br>
Doing business process modelling and walkthroughs<br>
Designing and building data warehouses<br>
Evaluating and selecting business intelligence tools for Dr Solomon’s within the UK and Germany<br>
Gathering user requirements<br>
Reverse engineering databases using ErWin<br>
Gathering sales and marketing user requirements<br>
Doing unit and system testing<br>
Developing a sales and marketing analysis cube using Impromptu and PowerPlay<br>
Doing Visual Basic Version 5 user interface development for Informix applications<br>
Doing Unix Shell Scripting<br>
Doing cube and report generation using Cognos Impromptu and PowerPlay</p>

Analyst Programmer

The Zomba Group of Companies
Sep 1993 - Sep 1995 · 2 years

<p>Doing UNIX systems administration<br>
Providing UNIX support<br>
Doing UNIX Bourne Shell scripting<br>
Writing an extensive shell script to archive historical files<br>
Writing administrative backup maintenance scripts<br>
Working as an Informix DBA managing disk space allocation, data fragmentation, data integrity and data migration within the UK and USA<br>
Doing Informix application development<br>
Developing a customer contact management application<br>
Developing a legal action diary</p>

Analyst Programmer

Strategy Computers
Jan 1991 - Nov 1991 · 10 months

<p>Doing database design<br>
Doing application development using Informix 4GL and C<br>
Working on goods received, stock control, goods returned and point of sale</p>

Programmer, Analyst Programmer

Datalink Information Systems
Mar 1989

<p>Doing applications development using Informix 4GL and SQL<br>
Working on doctor surgery claim processing<br>
Working on bureau claim processing<br>
Doing entity, attribute and relationship modelling based on requirements documents<br>
Doing process flow documentation<br>
Doing application development using Informix<br>
Doing unit and system testing<br>
Doing training<br>
Doing user documentation<br>
Doing implementation<br>
Working as an Informix Online DBA handling transaction log management and backup<br>
Doing disk space calculations for Online implementation<br>
Doing user resource management<br>
Doing database optimisation<br>
Doing UNIX Bourne Shell scripting and C programs for upload scripts for data transferral to the mainframe<br>
Doing flat file data manipulation into suitable format for data transferral using sed and awk<br>
Doing UNIX administration and support for sites in central Johannesburg, Durban, Cape Town and Port Elizabeth<br>
Installing software such as Informix SE and Informix Online<br>
Doing systems administration and trouble shooting<br>
Doing systems performance monitoring</p>

Champion Software Limited

<p>SQL BI Developer with over 21 years of experience working in the retail, manufacturing, consulting and government sectors<br>
Comprehensive SQL Server knowledge including T-SQL, Stored Procedures, ETL data migration and SSIS<br>
Building end to end data solutions including ETL, Data Warehousing and Business Intelligence<br>
Working for clients such as EDS, Steria and The Law Society<br>
Using GCP BigQuery for data warehousing, DataFlow and Beam SDK, and AWS<br>
Designing BI reporting interfaces and delivering ETL data sets used for reporting<br>
Working for companies such as the Co Op, Tesco, Steria, EDS and the NHS providing customized reports and data warehousing<br>
Doing database development, team leadership, business analysis and reporting within a sales and marketing environment<br>
Using Netezza<br>
Doing data modelling<br>
Using Python for OpenAI text classification, image to text extraction and chatbot work<br>
Building a Flutter mobile application for an ambulance responder using Google Maps<br>
Using BigQuery and PostgreSQL<br>
Using GCP Cloud Healthcare API<br>
Using Azure Synapse Analytics, Azure Data Lake Gen2 and Data Factory<br>
Using T-SQL<br>
Using Stored Procedures<br>
Using ETL<br>
Using SSIS<br>
Using SSRS and Power BI<br>
Doing requirements analysis and project scope work<br>
Using Agile development<br>
Working with large data sets for the NHS including General Practice, Secondary Care data, Patient Demographics, Mortality and Mental Health datasets<br>
Working on Long Term Condition Risk Stratification</p>

BP, Breakspear Park, Hemel Hempstead

<p>Gathering and documenting customer requirements for the development of a technical support database<br>
Enabling technical support staff to manage and support BP hardware equipment across various sites<br>
Analyzing requirements for both the servers on support and technical information repository<br>
Developing a project prototype using HTML and ASP<br>
Designing and creating databases using SQL Server 2000<br>
Designing middle tier components<br>
Developing COM components using Visual Basic 6<br>
Using SQL Server stored procedures<br>
Using Microsoft Visual Modeler, Visual Basic 6, SQL Server 2000 and Internet Information Server<br>
Recording and managing support requests on BP Infrastructure</p>

Atlantic Telecomm

<p>Integrating a number of packages into a single solution<br>
Developing interfaces to integrate the Clarify CRM package with an Arbor Billing System and external information centres such as BACS<br>
Analyzing the Direct Debit Interface<br>
Creating data migration scripts using Oracle PL/SQL, Unix Shell scripting, sed and awk<br>
Creating test plans for middle tier components<br>
Training in Enterprise Java Beans and Java Version 1.3<br>
Using Oracle Version 8i, EJB Version 1.1 and Java Version 1.3</p>

Skills

Azure Synapse Analytics Azure Data Factory Azure Databricks GCP BigQuery Snowflake Airflow dbt Python SSIS T-SQL SQL Server Management Studio AWS Spark HDFS Cloudera HUE Impala Pandas PySpark Java Spring Elastic Search Unix Shell Scripting Data Vault Data Warehousing DataFlow Beam SDK PostgreSQL Azure Data Lake Gen2 SQL Server Stored Procedures ETL SSRS Power BI Requirements Analysis Project Scope Agile development Netezza Business Intelligence Database Design Data Mart Design OpenAI Text Classification Image to Text extraction ChatBot Flutter Google Maps GCP Cloud Healthcare API Azure Analysis Services Mongo Db
Report this Profile?