About Me
I am a Data scientist working at the Stepstone group with specialization in AI in NLP
Experience
Data Scientist
<p>Extensive research and analysis on job listings and their feature extraction to help recruiters generate listings that satisfy job requirements.<br>
Continued pretraining, fine-tuning and evaluation of LLMs (mT5, Llama2 (german continued pretrained)) for automatic (job-)listing creation in different downstream tasks (data-to-text generation, RAG).<br>
Optimization of training process of LLMs using PEFT methods (LoRa, QLoRa) to save time, cost and prevent over-fitting of models.<br>
Development of RLHF-pipelines to create RLHF datasets to improve LLMs performance using text-edit events (Kafka) and monthly manual evaluation of generated texts.<br>
Improvement of job title search by developing semantic search pipelines with Vector DBs on AWS (Milvus) to support recruiters write better job titles.<br>
Training of semantic models.<br>
Deployment on Sagemaker with custom docker images.<br>
Deployment of Milvus DB on EC2 cluster.<br>
Optimization of performance of LLMs with distributed training and inference of LLMs (DP, DDP, MP) using Pytorch, Deepspeed.<br>
Testing and benchmarking of quantization techniques (BnB, GPTQ, AWQ) in deployment and inference of LLMs.<br>
Building of custom inference docker images for LLMs on AWS ECR for deployment in production (AWS ECS).<br>
AWS cloud-infrastructure design and testing using Terraform with Bamboo CI/CD tool for the purposes of RLHF (s3, AWS lambda, Dynamodb and cloud watch) and sagemaker endpoint deployment with Huggingface’s models and docker images (Text-generation-inference and Text-embedding-inference on ECR).</p>
Data scientist
LLMs development including data preparation, analysis, training and testing / NLP products development / advanced analytics of Big data/ cloud deployment of machine learning models and infrastructure for cloud services
Student Research Assistant
<p>Simulation of dielectric relaxation, ferroelectric switching and imprint in PVDF copolymers (c++).<br>
Solving non-linear differential equations to predict the behaviour of PVDF copolymers under electric fields (c++).<br>
Experimental data visualization (Matlab).</p>
Data Scientist / Data Engineer
<p>Design of ETL pipelines to clean and populate databases (RDS) with millions of users textual data on AWS-Cloud (Pyspark, Pandas, AWS-lambda, AWS-fargate).<br>
Implementation of merging pipelines to merge users data from different platforms (Linked-in, Stack-overflow,etc) into one single database (Dynamo-Db).<br>
Development of an English and German model for NER (named entity recognition) to extract software skills from users information (bio,CV,etc).<br>
Development of a matching model using BERT’s embeddings to appropriately match candidates to jobs.<br>
Exploratory Data Analysis on hundreds of Gigabytes of scraped user’s data (numerical and textual).<br>
Analysis of github-users’ repositories to track history and development of software skills and provide visual representation of those to recruiters.</p>
Data Scientist / Data Engineer
Research Assistant - Quantum Engineering
<p>Research in the field of Quantum Repeaters.<br>
Design of the first Quantum Repeater with trapped ions based on single atom-photon entanglement.<br>
Optical setup design for single ions imaging, laser beam addressing and florescence collection.<br>
Optical and optomechanical modelling (Zeemax).<br>
Design of digital and analog control systems to stabilize laser frequency, intensity and phase.<br>
Experimental sequence design (Verilog(FPGA), Labview, Matlab).<br>
Data Analysis and statistical modelling (Python (pandas), Matlab).<br>
FEM simulations of RF Paul traps (Comsol Multiphysics).<br>
Monte-Carlo simulation of long-distance quantum communication (C++).</p>