About Me
Experienced Independent Data Engineer , since 2014.
Building data pipelines in the Cloud. Data Warehousing, design and creation.
Azure Synapse Analytics, Data Factory, Data Bricks.
GCP, BigQuery, Snowflake, Airflow, DB…
Experienced Independent Data Engineer , since 2014.
Building data pipelines in the Cloud. Data Warehousing, design and creation.
Azure Synapse Analytics, Data Factory, Data Bricks.
GCP, BigQuery, Snowflake, Airflow, DBT with Python.
SC Security Clearance.
On Premise – Microsoft Stack – SSIS, TSQL and SQL Server Management Services.
Experience
Data Engineer
Data Engineer - working as a contractor at John Lewis, building ETL Pipelines using Airflow and DBT to migrate and transform data from Google Cloud into Snowflake.
As a contractor I have worked on many other technologies.
GCP Data Engineer
Using Python, Airflow ver 2.72, DBT, Snowflake, Data Vault
Migrating data from BigQuery into Snowflake using Airflow and DBT
Working with complex queries and large amounts of data for delivery of data for Machine Learning models
Providing Waitrose with £4 million in annual savings
AWS Data Engineer
Working with AWS, Spark, HDFS, Cloudera, HUE, Impala, ETL pipelines, Python, Pandas and PySpark
Using Azure Synapse Analytics and Data Factory
Working on big data solutions for HMRC
Working with a large team with a diverse skill set including Java Spring, Elastic Search, HDFS, Spark on Cloudera and Unix Shell Scripting
Interfacing with an existing Java Spring application that delivered search requests to Border Force via an Angular front end and Elastic Search
Creating data extracts running on Spark, written in Spark SQL and PySpark
Working alongside Java developers to implement data changes to meet business needs
Refactoring existing applications and data delivery pipelines
Using Unix Shell Scripting
Working on an Azure solution collecting telemetry information on forklift battery usage across 12 sites in the USA
Using Azure Synapse Analytics, Data Factory and SQL Server on premise
Snr ETL Developer
Building an ETL migration process running on SQL Server to export data from source databases into Data Cube
Providing remote support of the ETL process
Snr ETL Developer
Building an ETL migration process along with data quality and master data management processes
Using the SQL Server stack
ETL Developer
Developing an ETL process migrating legacy databases into Microsoft Dynamics
Using SQL Server 2016 and SSIS
Working alongside the consultancy company Net Company
BI Developer
Developing a BI reporting database using Azure Data Lake, U-SQL, Azure Analysis Services and Power BI
Using Mongo Db
Developer
Doing Alexa Skills development
Using Azure Cosmos Db SQL API with Python
Building manufacturing BI software solutions
SQL BI Developer
Providing BAU support of an existing Enterprise Data Warehouse and ETL system
Delivering data to the Customer Portal and Parts Portal
Using SQL Server 2008 R2
SQL BI Developer
Visiting various Funeral homes to understand their working practice
Designing and developing the initial ETL process and data warehouse for funeral business reporting
Designing and developing an ETL process for promotions
Providing back end data services for the front end Qlik View developers
Using Netezza, SQL Server 2012, SSIS and Power BI for business reports development for Funeral and Retail
SQL BI Developer
Designing and developing ETL for the extraction of veterinary data from the central database hosting VetSpace on a SQL Server 2012 platform
Designing the staging environment and data warehouse using Bill Inmon methodology
Developing reporting databases for the Finance and Management Information departments
Producing data extracts for import into Sage 200
Using VetSpace and Sage 200
Using SQL Server 2012, T-SQL, Stored Procedures, Database Design, SSIS and Excel
SQL BI Developer
Designing and developing a marketing database and related SSIS packages for extraction, validation and loading of marketing data
Developing a series of MI and financial reports for senior management
Identifying the business impact of migrating applications and databases from SQL Server 2008 R2 to SQL Server 2014
SQL Server Developer
Working on projects including Long Term Condition Risk Stratification, Mental Health, Life Style Services and SUS
Designing OLTP and OLAP databases
Using SQL Server Integration Services for ETL processes loading and processing GP and Secondary Care data
Designing and developing SQL Server Analysis Services cubes
Developing some reports using SQL Reporting Services and mainly using Excel
Processing very large data sets for the 17 PCTs within the West Midlands
Managing the design and development of the Risk Stratification project
Ensuring required components were delivered according to specification
Managing project delivery while negotiating a reduced project scope to deliver within the required time frame
Designing and developing validation rules for GP data
Producing reports to enable checking of data input, output and error counts
Identifying where problems occurred and resolving them
Providing operational support of the process
Technical database specialist
Designing and developing a SSAS cube for the analysis of sales information
Developing SSIS packages for extraction, cleansing and loading of data into the Data Warehouse
Managing the software deployment process through the development lifecycle from develop to test to production
Working on the Loyalty Club Card Scheme with a team of front end developers to develop a database to support the scheme
Using SQL Server 2005, SQL Server Analysis Services, TSQL, Stored Procedures, SQL Server Integration Services and Excel reporting
Snr Analyst Programmer
Working on high level requirements and documentation
Doing database normalisation
Designing and developing a data migration process
Using SQL 2000, TSQL, SQL 2005, Stored Procedures, Test Case preparation and SQL Injection
Meeting and discussing requirements with the bank’s management team
Designing and developing the reporting database according to the bank’s business standards
Analyzing reporting requirements for a data warehouse
Gathering customer requirements for the shipping and logistics department and producing high level business requirements for development by the reporting team
Analyzing and recommending optimization solutions for a poorly performing sales database
Reviewing the performance and design of a poorly performing production database and recommending areas for improvement
Technical Consultant
Working on pre-sales projects and bids for joint partnerships with companies like BT and an e-Business project for Kent County Council
Producing documentation for bids for potential new business
Meeting with customers and advising them on how Steria can work with them to improve their business process
Working with the Steria Sales team to produce reports to help sales managers understand the effectiveness of their sales teams
SQL Server DBA
Serving as SQL Server Team Leader
Providing day to day DBA support for a number of customers
Resolving SQL Server problems
Working with the AON management team to define and document the process and procedures required to manage alterations to the schema and reference data due to usage of a bespoke application
Development Consultant, SQL Server Team Leader
Converting Enterprise Java Beans from EJB Version 1.1 to 2.0
Migrating EJBs from Bea Weblogic Version 5 to 7
Developing the Genesis application using EJB 2.0, JSPs and JUnit test cases
Creating test plans to ensure development work was in accordance with requirements documentation
Testing components using JUnit
Senior Analyst Programmer
Designing and creating data warehouse solutions for large insurance organisations using SQL Server 7
Designing and creating data transformation and migration packages for extraction and loading of warehouses using SQL Server 7 DTS and VB Script
Doing web development for the Lysander E Commerce portal using HTML, client side JavaScript, Active Server Pages and COM objects
Using SQL Server 7, SQL Server DTS, Visual Basic 6, HTML 4.0, ASP 2, Windows NT 4 and JavaScript 1.2
Analyst Programmer, Project Leader
Doing business process analysis
Doing business process modelling and walkthroughs
Designing and building data warehouses
Evaluating and selecting business intelligence tools for Dr Solomon’s within the UK and Germany
Gathering user requirements
Reverse engineering databases using ErWin
Gathering sales and marketing user requirements
Doing unit and system testing
Developing a sales and marketing analysis cube using Impromptu and PowerPlay
Doing Visual Basic Version 5 user interface development for Informix applications
Doing Unix Shell Scripting
Doing cube and report generation using Cognos Impromptu and PowerPlay
Analyst Programmer
Doing UNIX systems administration
Providing UNIX support
Doing UNIX Bourne Shell scripting
Writing an extensive shell script to archive historical files
Writing administrative backup maintenance scripts
Working as an Informix DBA managing disk space allocation, data fragmentation, data integrity and data migration within the UK and USA
Doing Informix application development
Developing a customer contact management application
Developing a legal action diary
Analyst Programmer
Doing database design
Doing application development using Informix 4GL and C
Working on goods received, stock control, goods returned and point of sale
Programmer, Analyst Programmer
Doing applications development using Informix 4GL and SQL
Working on doctor surgery claim processing
Working on bureau claim processing
Doing entity, attribute and relationship modelling based on requirements documents
Doing process flow documentation
Doing application development using Informix
Doing unit and system testing
Doing training
Doing user documentation
Doing implementation
Working as an Informix Online DBA handling transaction log management and backup
Doing disk space calculations for Online implementation
Doing user resource management
Doing database optimisation
Doing UNIX Bourne Shell scripting and C programs for upload scripts for data transferral to the mainframe
Doing flat file data manipulation into suitable format for data transferral using sed and awk
Doing UNIX administration and support for sites in central Johannesburg, Durban, Cape Town and Port Elizabeth
Installing software such as Informix SE and Informix Online
Doing systems administration and trouble shooting
Doing systems performance monitoring
SQL BI Developer with over 21 years of experience working in the retail, manufacturing, consulting and government sectors
Comprehensive SQL Server knowledge including T-SQL, Stored Procedures, ETL data migration and SSIS
Building end to end data solutions including ETL, Data Warehousing and Business Intelligence
Working for clients such as EDS, Steria and The Law Society
Using GCP BigQuery for data warehousing, DataFlow and Beam SDK, and AWS
Designing BI reporting interfaces and delivering ETL data sets used for reporting
Working for companies such as the Co Op, Tesco, Steria, EDS and the NHS providing customized reports and data warehousing
Doing database development, team leadership, business analysis and reporting within a sales and marketing environment
Using Netezza
Doing data modelling
Using Python for OpenAI text classification, image to text extraction and chatbot work
Building a Flutter mobile application for an ambulance responder using Google Maps
Using BigQuery and PostgreSQL
Using GCP Cloud Healthcare API
Using Azure Synapse Analytics, Azure Data Lake Gen2 and Data Factory
Using T-SQL
Using Stored Procedures
Using ETL
Using SSIS
Using SSRS and Power BI
Doing requirements analysis and project scope work
Using Agile development
Working with large data sets for the NHS including General Practice, Secondary Care data, Patient Demographics, Mortality and Mental Health datasets
Working on Long Term Condition Risk Stratification
Gathering and documenting customer requirements for the development of a technical support database
Enabling technical support staff to manage and support BP hardware equipment across various sites
Analyzing requirements for both the servers on support and technical information repository
Developing a project prototype using HTML and ASP
Designing and creating databases using SQL Server 2000
Designing middle tier components
Developing COM components using Visual Basic 6
Using SQL Server stored procedures
Using Microsoft Visual Modeler, Visual Basic 6, SQL Server 2000 and Internet Information Server
Recording and managing support requests on BP Infrastructure
Integrating a number of packages into a single solution
Developing interfaces to integrate the Clarify CRM package with an Arbor Billing System and external information centres such as BACS
Analyzing the Direct Debit Interface
Creating data migration scripts using Oracle PL/SQL, Unix Shell scripting, sed and awk
Creating test plans for middle tier components
Training in Enterprise Java Beans and Java Version 1.3
Using Oracle Version 8i, EJB Version 1.1 and Java Version 1.3