Consultant data engineer with experience in data pipeline development, data processing, and cloud-based data engineering across healthcare and research environments. Experienced with Azure, AWS, Databricks, PySpark, Pala…
Consultant data engineer with experience in data pipeline development, data processing, and cloud-based data engineering across healthcare and research environments. Experienced with Azure, AWS, Databricks, PySpark, Palantir Foundry, Docker, Kubernetes, Dagster, Airflow, React, NodeJS, and database design, with a background in computer science and software engineering.
The organization provides the largest health data in the country for researchers around the world to protect, treat and prevent disease. I have built a data pipeline to upload and receive data to/from National Health Services in England and process the data to be sent to the trusted research environment. I have designed complex data schema and I communicate with different stakeholders to achieve the final product. I have contributed to the linkage rules between different data sets and currently working on de-identifying the data to protect users’ data privacy and prevent identifiable data from reaching not authorized users. Technologies used are Azure cloud, Databricks, Kubernetes, Docker Dagster, Airflow. PySpark, data lakes.
Wrote and prepared high standards extracts for GP data for planning and research and Direct Care projects.
Met with customers such as BioBank and Genomics England to collect requirements for their extracts.
Contributed to building and testing pipelines to extract and process pseudonymized data sets.
Used Databricks, PySpark, AWS services such as DynamoDB, Lambda, and S3 buckets.
Worked as a technical architect on designing the architecture of the Type 1 opt out project.
Contributed to NHS forms collections project using React, NodeJS, and AWS.
Contributed to the design and implementation of a high-throughput automated primary DNA sequencing analysis software.
Supported the migration of current analytical pipelines processing NGS data to robust, scalable software architecture.
Tested the COVID survey project.
Worked on the UK Government COVID 19 dashboard data pipeline development.
Provided support for improvement and architecture solutions.
Performed data parsing, cleaning, and transformation.
Fixed bugs in the data pipeline.
Delivered data in critical times.
Liaised with different senior managers of the project.
Improved the performance and optimization for data delivery and data analysis.
Worked on SQL and NoSQL and big data optimization and transformation.
Performed Palantir Foundry ETL.
Used Palantir Foundry, PySpark, GitHub, GitLab, Ontology, and Foundry Contour.
Built data pipelines for COVID 19 data on the UK government dashboard including vaccination data, death data, and PCR tests for England, Scotland, and Wales.
Developed automation tools and software to process and analyse DNA sequencing data.
Worked as a visiting lecturer teaching software engineering modules for third year undergraduate and postgraduate students.
Supervised projects for Master students.
Designed, implemented, and maintained new features of the BlueJ and Greenfoot systems.
Contributed to research using BlueJ and Greenfoot from software engineering, learning and teaching, and user usage behaviour perspectives.
Helped maintain and develop websites for BlueJ and Greenfoot.
Used Ruby on Rails, MySql, JavaScript, HTML, CSS, and other back-end and front-end technologies to maintain websites.
Organized workshops and materials to be delivered about Greenfoot and BlueJ in education sector.
Embedded portable high-performance real-time Java Virtual Machine expertise in embedded environments suitable for hosting future satellite terminals based on Software Defined Radio.
Installed an open-source real time Java virtual machine for a proof of concept.
Learned Ada and used it for the new concepts of the Safety critical Java.
Implemented the system and understood the memory management layout and multithreading requirements.
Developed the interpreter for the safety critical java in Ada.
Managed the KTP project and its resources for two and half years.
Delivered the project including coding, system design, and implementation documentation.
Built a data pipeline to upload and receive data to/from NHS England.
Processed data to be sent to the trusted research environment.
Designed complex data schema.
Communicated with different stakeholders to achieve the final product.
Contributed to the linkage rules between different data sets.
Worked on de-identifying the data to protect users’ data privacy and prevent identifiable data from reaching unauthorized users.
Used Azure cloud, Databricks, Kubernetes, Docker, Dagster, Airflow, PySpark, and data lakes.
The AI-first Recruitment Operating System that unifies and automates the entire hiring lifecycle for modern enterprises worldwide.
Dr Job FZ LLC. 2026 © All Rights Reserved
