Omar Elshehy

Omar Elshehy

Data Scientist
Germany
German, Arabic, English

About Me

I am a Data scientist working at the Stepstone group with specialization in AI in NLP

Experience

Data Scientist

The Stepstone Group
Sep 2022 - Present · 4 years 1 month

<p>Extensive research and analysis on job listings and their feature extraction to help recruiters generate listings that satisfy job requirements.<br>
Continued pretraining, fine-tuning and evaluation of LLMs (mT5, Llama2 (german continued pretrained)) for automatic (job-)listing creation in different downstream tasks (data-to-text generation, RAG).<br>
Optimization of training process of LLMs using PEFT methods (LoRa, QLoRa) to save time, cost and prevent over-fitting of models.<br>
Development of RLHF-pipelines to create RLHF datasets to improve LLMs performance using text-edit events (Kafka) and monthly manual evaluation of generated texts.<br>
Improvement of job title search by developing semantic search pipelines with Vector DBs on AWS (Milvus) to support recruiters write better job titles.<br>
Training of semantic models.<br>
Deployment on Sagemaker with custom docker images.<br>
Deployment of Milvus DB on EC2 cluster.<br>
Optimization of performance of LLMs with distributed training and inference of LLMs (DP, DDP, MP) using Pytorch, Deepspeed.<br>
Testing and benchmarking of quantization techniques (BnB, GPTQ, AWQ) in deployment and inference of LLMs.<br>
Building of custom inference docker images for LLMs on AWS ECR for deployment in production (AWS ECS).<br>
AWS cloud-infrastructure design and testing using Terraform with Bamboo CI/CD tool for the purposes of RLHF (s3, AWS lambda, Dynamodb and cloud watch) and sagemaker endpoint deployment with Huggingface’s models and docker images (Text-generation-inference and Text-embedding-inference on ECR).</p>

Data scientist

The stepstone Group
Sep 2022 - Present · 4 years 1 month

LLMs development including data preparation, analysis, training and testing / NLP products development / advanced analytics of Big data/ cloud deployment of machine learning models and infrastructure for cloud services

Student Research Assistant

Chair of Electronics
Apr 2016 - Jul 2018 · 2 years 3 months

<p>Simulation of dielectric relaxation, ferroelectric switching and imprint in PVDF copolymers (c++).<br>
Solving non-linear differential equations to predict the behaviour of PVDF copolymers under electric fields (c++).<br>
Experimental data visualization (Matlab).</p>

Data Scientist / Data Engineer

Seerreal.com
Sep 2021

<p>Design of ETL pipelines to clean and populate databases (RDS) with millions of users textual data on AWS-Cloud (Pyspark, Pandas, AWS-lambda, AWS-fargate).<br>
Implementation of merging pipelines to merge users data from different platforms (Linked-in, Stack-overflow,etc) into one single database (Dynamo-Db).<br>
Development of an English and German model for NER (named entity recognition) to extract software skills from users information (bio,CV,etc).<br>
Development of a matching model using BERT’s embeddings to appropriately match candidates to jobs.<br>
Exploratory Data Analysis on hundreds of Gigabytes of scraped user’s data (numerical and textual).<br>
Analysis of github-users’ repositories to track history and development of software skills and provide visual representation of those to recruiters.</p>

Data Scientist / Data Engineer

Seereal.com
Jun 2021

Research Assistant - Quantum Engineering

Universität des Saarlandes
Nov 2018

<p>Research in the field of Quantum Repeaters.<br>
Design of the first Quantum Repeater with trapped ions based on single atom-photon entanglement.<br>
Optical setup design for single ions imaging, laser beam addressing and florescence collection.<br>
Optical and optomechanical modelling (Zeemax).<br>
Design of digital and analog control systems to stabilize laser frequency, intensity and phase.<br>
Experimental sequence design (Verilog(FPGA), Labview, Matlab).<br>
Data Analysis and statistical modelling (Python (pandas), Matlab).<br>
FEM simulations of RF Paul traps (Comsol Multiphysics).<br>
Monte-Carlo simulation of long-distance quantum communication (C++).</p>

Skills

Python Amazon Web Services Artificial Intelligence Data Science Pytorch TensorFlow C++ Java SQL Git Docker Quantitative Research Communication Quantum optics Monte-Carlo simulations Data Analysis Pandas AWS PySpark AWS Lambda AWS Fargate DynamoDB PyTorch spaCy scikit-learn NumPy Plotly Seaborn Matlab Zeemax Verilog LabVIEW COMSOL Multiphysics Terraform Bamboo CI/CD Kafka Milvus SageMaker Deepspeed LoRA QLoRA BERT LLM fine-tuning RAG Data-to-text generation Distributed training Quantization AWS ECS AWS ECR AWS EC2 AWS S3 AWS CloudWatch Hugging Face Text Generation Inference Text Embedding Inference
Report this Profile?