Shelley Currie

Shelley Currie

Data Engineer with over 25 years of experience
United Kingdom
English

نبذة عني

Experienced Independent Data Engineer , since 2014.

Building data pipelines in the Cloud. Data Warehousing, design and creation.
Azure Synapse Analytics, Data Factory, Data Bricks.
GCP, BigQuery, Snowflake, Airflow, DB…

الخبرة

Data Engineer

Champions Software
May 2022 - حتى الآن · 4 سنوات 2 أشهر

Data Engineer - working as a contractor at John Lewis, building ETL Pipelines using Airflow and DBT to migrate and transform data from Google Cloud into Snowflake.

As a contractor I have worked on many other technologies.

GCP Data Engineer

Self Employed Contractor
Jul 2022 - Nov 2023 · 1 سنة 4 أشهر

Using Python, Airflow ver 2.72, DBT, Snowflake, Data Vault
Migrating data from BigQuery into Snowflake using Airflow and DBT
Working with complex queries and large amounts of data for delivery of data for Machine Learning models
Providing Waitrose with £4 million in annual savings

AWS Data Engineer

HMRC
Jun 2021 - Jun 2022 · 1 سنة

Working with AWS, Spark, HDFS, Cloudera, HUE, Impala, ETL pipelines, Python, Pandas and PySpark
Using Azure Synapse Analytics and Data Factory
Working on big data solutions for HMRC
Working with a large team with a diverse skill set including Java Spring, Elastic Search, HDFS, Spark on Cloudera and Unix Shell Scripting
Interfacing with an existing Java Spring application that delivered search requests to Border Force via an Angular front end and Elastic Search
Creating data extracts running on Spark, written in Spark SQL and PySpark
Working alongside Java developers to implement data changes to meet business needs
Refactoring existing applications and data delivery pipelines
Using Unix Shell Scripting

Data Stages (Canada)
Apr 2021 - Jun 2021 · 2 أشهر

Working on an Azure solution collecting telemetry information on forklift battery usage across 12 sites in the USA
Using Azure Synapse Analytics, Data Factory and SQL Server on premise

Snr ETL Developer

Laborie (Canada)
Mar 2020 - Nov 2020 · 8 أشهر

Building an ETL migration process running on SQL Server to export data from source databases into Data Cube
Providing remote support of the ETL process

Snr ETL Developer

WaterLogic
Jun 2019 - Aug 2019 · 2 أشهر

Building an ETL migration process along with data quality and master data management processes
Using the SQL Server stack

ETL Developer

The Law Society
Nov 2017 - Jun 2018 · 7 أشهر

Developing an ETL process migrating legacy databases into Microsoft Dynamics
Using SQL Server 2016 and SSIS
Working alongside the consultancy company Net Company

BI Developer

LineView Solutions
Apr 2017 - Sep 2017 · 5 أشهر

Developing a BI reporting database using Azure Data Lake, U-SQL, Azure Analysis Services and Power BI
Using Mongo Db

Developer

Lily Software Limited
Jan 2017 - Mar 2017 · 2 أشهر

Doing Alexa Skills development
Using Azure Cosmos Db SQL API with Python
Building manufacturing BI software solutions

SQL BI Developer

Briggs Equipment U.K. Ltd.
Apr 2016 - Dec 2016 · 8 أشهر

Providing BAU support of an existing Enterprise Data Warehouse and ETL system
Delivering data to the Customer Portal and Parts Portal
Using SQL Server 2008 R2

SQL BI Developer

Central Midlands Cooperative
Jun 2015 - Nov 2015 · 5 أشهر

Visiting various Funeral homes to understand their working practice
Designing and developing the initial ETL process and data warehouse for funeral business reporting
Designing and developing an ETL process for promotions
Providing back end data services for the front end Qlik View developers
Using Netezza, SQL Server 2012, SSIS and Power BI for business reports development for Funeral and Retail

SQL BI Developer

PDSA
Sep 2014 - May 2015 · 8 أشهر

Designing and developing ETL for the extraction of veterinary data from the central database hosting VetSpace on a SQL Server 2012 platform
Designing the staging environment and data warehouse using Bill Inmon methodology
Developing reporting databases for the Finance and Management Information departments
Producing data extracts for import into Sage 200
Using VetSpace and Sage 200
Using SQL Server 2012, T-SQL, Stored Procedures, Database Design, SSIS and Excel

SQL BI Developer

RAC
May 2014 - Aug 2014 · 3 أشهر

Designing and developing a marketing database and related SSIS packages for extraction, validation and loading of marketing data
Developing a series of MI and financial reports for senior management
Identifying the business impact of migrating applications and databases from SQL Server 2008 R2 to SQL Server 2014

SQL Server Developer

Central Midlands CSU (NHS, Service provider)
Apr 2009 - Apr 2014 · 5 سنوات

Working on projects including Long Term Condition Risk Stratification, Mental Health, Life Style Services and SUS
Designing OLTP and OLAP databases
Using SQL Server Integration Services for ETL processes loading and processing GP and Secondary Care data
Designing and developing SQL Server Analysis Services cubes
Developing some reports using SQL Reporting Services and mainly using Excel
Processing very large data sets for the 17 PCTs within the West Midlands
Managing the design and development of the Risk Stratification project
Ensuring required components were delivered according to specification
Managing project delivery while negotiating a reduced project scope to deliver within the required time frame
Designing and developing validation rules for GP data
Producing reports to enable checking of data input, output and error counts
Identifying where problems occurred and resolving them
Providing operational support of the process

Technical database specialist

Tesco plc
May 2007 - Apr 2009 · 1 سنة 11 أشهر

Designing and developing a SSAS cube for the analysis of sales information
Developing SSIS packages for extraction, cleansing and loading of data into the Data Warehouse
Managing the software deployment process through the development lifecycle from develop to test to production
Working on the Loyalty Club Card Scheme with a team of front end developers to develop a database to support the scheme
Using SQL Server 2005, SQL Server Analysis Services, TSQL, Stored Procedures, SQL Server Integration Services and Excel reporting

Snr Analyst Programmer

Prima Consulting, Melbourne
May 2006 - Jan 2007 · 8 أشهر

Working on high level requirements and documentation
Doing database normalisation
Designing and developing a data migration process
Using SQL 2000, TSQL, SQL 2005, Stored Procedures, Test Case preparation and SQL Injection
Meeting and discussing requirements with the bank’s management team
Designing and developing the reporting database according to the bank’s business standards
Analyzing reporting requirements for a data warehouse
Gathering customer requirements for the shipping and logistics department and producing high level business requirements for development by the reporting team
Analyzing and recommending optimization solutions for a poorly performing sales database
Reviewing the performance and design of a poorly performing production database and recommending areas for improvement

Technical Consultant

Steria Ltd.
Jul 2005 - Mar 2006 · 8 أشهر

Working on pre-sales projects and bids for joint partnerships with companies like BT and an e-Business project for Kent County Council
Producing documentation for bids for potential new business
Meeting with customers and advising them on how Steria can work with them to improve their business process
Working with the Steria Sales team to produce reports to help sales managers understand the effectiveness of their sales teams

SQL Server DBA

Various AON Customer sites, Royal Bank of Scotland
Aug 2004 - Jun 2005 · 10 أشهر

Serving as SQL Server Team Leader
Providing day to day DBA support for a number of customers
Resolving SQL Server problems
Working with the AON management team to define and document the process and procedures required to manage alterations to the schema and reference data due to usage of a bespoke application

Development Consultant, SQL Server Team Leader

EDS
Oct 2000 - Jul 2004 · 3 سنوات 9 أشهر

Converting Enterprise Java Beans from EJB Version 1.1 to 2.0
Migrating EJBs from Bea Weblogic Version 5 to 7
Developing the Genesis application using EJB 2.0, JSPs and JUnit test cases
Creating test plans to ensure development work was in accordance with requirements documentation
Testing components using JUnit

Senior Analyst Programmer

Lysander Systems Ltd
Jan 1999 - Sep 2000 · 1 سنة 8 أشهر

Designing and creating data warehouse solutions for large insurance organisations using SQL Server 7
Designing and creating data transformation and migration packages for extraction and loading of warehouses using SQL Server 7 DTS and VB Script
Doing web development for the Lysander E Commerce portal using HTML, client side JavaScript, Active Server Pages and COM objects
Using SQL Server 7, SQL Server DTS, Visual Basic 6, HTML 4.0, ASP 2, Windows NT 4 and JavaScript 1.2

Analyst Programmer, Project Leader

Dr Solomon’s (Anti-Virus Company)
Sep 1995 - Aug 1998 · 2 سنوات 11 أشهر

Doing business process analysis
Doing business process modelling and walkthroughs
Designing and building data warehouses
Evaluating and selecting business intelligence tools for Dr Solomon’s within the UK and Germany
Gathering user requirements
Reverse engineering databases using ErWin
Gathering sales and marketing user requirements
Doing unit and system testing
Developing a sales and marketing analysis cube using Impromptu and PowerPlay
Doing Visual Basic Version 5 user interface development for Informix applications
Doing Unix Shell Scripting
Doing cube and report generation using Cognos Impromptu and PowerPlay

Analyst Programmer

The Zomba Group of Companies
Sep 1993 - Sep 1995 · 2 سنوات

Doing UNIX systems administration
Providing UNIX support
Doing UNIX Bourne Shell scripting
Writing an extensive shell script to archive historical files
Writing administrative backup maintenance scripts
Working as an Informix DBA managing disk space allocation, data fragmentation, data integrity and data migration within the UK and USA
Doing Informix application development
Developing a customer contact management application
Developing a legal action diary

Analyst Programmer

Strategy Computers
Jan 1991 - Nov 1991 · 10 أشهر

Doing database design
Doing application development using Informix 4GL and C
Working on goods received, stock control, goods returned and point of sale

Programmer, Analyst Programmer

Datalink Information Systems
Mar 1989

Doing applications development using Informix 4GL and SQL
Working on doctor surgery claim processing
Working on bureau claim processing
Doing entity, attribute and relationship modelling based on requirements documents
Doing process flow documentation
Doing application development using Informix
Doing unit and system testing
Doing training
Doing user documentation
Doing implementation
Working as an Informix Online DBA handling transaction log management and backup
Doing disk space calculations for Online implementation
Doing user resource management
Doing database optimisation
Doing UNIX Bourne Shell scripting and C programs for upload scripts for data transferral to the mainframe
Doing flat file data manipulation into suitable format for data transferral using sed and awk
Doing UNIX administration and support for sites in central Johannesburg, Durban, Cape Town and Port Elizabeth
Installing software such as Informix SE and Informix Online
Doing systems administration and trouble shooting
Doing systems performance monitoring

Champion Software Limited

SQL BI Developer with over 21 years of experience working in the retail, manufacturing, consulting and government sectors
Comprehensive SQL Server knowledge including T-SQL, Stored Procedures, ETL data migration and SSIS
Building end to end data solutions including ETL, Data Warehousing and Business Intelligence
Working for clients such as EDS, Steria and The Law Society
Using GCP BigQuery for data warehousing, DataFlow and Beam SDK, and AWS
Designing BI reporting interfaces and delivering ETL data sets used for reporting
Working for companies such as the Co Op, Tesco, Steria, EDS and the NHS providing customized reports and data warehousing
Doing database development, team leadership, business analysis and reporting within a sales and marketing environment
Using Netezza
Doing data modelling
Using Python for OpenAI text classification, image to text extraction and chatbot work
Building a Flutter mobile application for an ambulance responder using Google Maps
Using BigQuery and PostgreSQL
Using GCP Cloud Healthcare API
Using Azure Synapse Analytics, Azure Data Lake Gen2 and Data Factory
Using T-SQL
Using Stored Procedures
Using ETL
Using SSIS
Using SSRS and Power BI
Doing requirements analysis and project scope work
Using Agile development
Working with large data sets for the NHS including General Practice, Secondary Care data, Patient Demographics, Mortality and Mental Health datasets
Working on Long Term Condition Risk Stratification

BP, Breakspear Park, Hemel Hempstead

Gathering and documenting customer requirements for the development of a technical support database
Enabling technical support staff to manage and support BP hardware equipment across various sites
Analyzing requirements for both the servers on support and technical information repository
Developing a project prototype using HTML and ASP
Designing and creating databases using SQL Server 2000
Designing middle tier components
Developing COM components using Visual Basic 6
Using SQL Server stored procedures
Using Microsoft Visual Modeler, Visual Basic 6, SQL Server 2000 and Internet Information Server
Recording and managing support requests on BP Infrastructure

Atlantic Telecomm

Integrating a number of packages into a single solution
Developing interfaces to integrate the Clarify CRM package with an Arbor Billing System and external information centres such as BACS
Analyzing the Direct Debit Interface
Creating data migration scripts using Oracle PL/SQL, Unix Shell scripting, sed and awk
Creating test plans for middle tier components
Training in Enterprise Java Beans and Java Version 1.3
Using Oracle Version 8i, EJB Version 1.1 and Java Version 1.3

المهارات

Azure Synapse Analytics Azure Data Factory Azure Databricks GCP BigQuery Snowflake Airflow dbt Python SSIS T-SQL SQL Server Management Studio AWS Spark HDFS Cloudera HUE Impala Pandas PySpark Java Spring Elastic Search Unix Shell Scripting Data Vault Data Warehousing DataFlow Beam SDK PostgreSQL Azure Data Lake Gen2 SQL Server Stored Procedures ETL SSRS Power BI Requirements Analysis Project Scope Agile development Netezza Business Intelligence Database Design Data Mart Design OpenAI Text Classification Image to Text extraction ChatBot Flutter Google Maps GCP Cloud Healthcare API Azure Analysis Services Mongo Db
الإبلاغ عن هذا الملف الشخصي؟