kavya

kavya

Data Engineer
Egypt

About Me

Skilled data engineer with a track record in building, constructing, and managing reliable infrastructure and data pipelines. Adept at utilizing Flask, SQL, and Pandas to create scalable ETL procedures and data processin…

Experience

Big Data Engineer

Saturam Infosystem
Aug 2022 - Present · 4 years 2 months

I have been working as a big data engineer for 2 years the responsibilities I handle are creating ADF pipelines , Using Pandas to manipulate data and also I have a good amount of experience in working as backend developer in creating web apps for Retail brands ,The tech I have used for this is Flask Apis

Spend Analysis

Saturam Infosystem

<p>Established data pipelines using Azure ADF<br>
Built multiple data transformation pipelines with Airflow in PostgreSQL<br>
Implemented back-end to front-end integration with Flask and JavaScript<br>
Designed a role-based access system for the data platform</p>

RM Demand Planning

Saturam Infosystem

<p>Automated Excel sheets with complex formulas<br>
Wrote well-structured and maintainable code to handle formula calculations, data retrieval, and sheet dependencies<br>
Ensured high performance and error-free execution<br>
Used ADF pipelines to push data from DB2 to Postgres<br>
Collaborated with the UI/UX team to design intuitive user interfaces<br>
Integrated various data sources into the automation system for real-time data updates and dynamic reporting</p>

Service Classification

Saturam Infosystem

<p>Worked on text classification using SpaCy<br>
Classified services based on the given classifications<br>
Generated codes after classification of services</p>

Web Application

Saturam Infosystem

<p>Developed and deployed a web application for major retail brands<br>
Implemented secure login with OTP verification<br>
Created RESTful APIs using Flask for session management, authentication, and user data storage<br>
Integrated a dynamic coupon management system<br>
Designed a rewards system to track and display user points and benefits<br>
Utilized SQLAlchemy for database interactions</p>

Skills

Python Flask Microsoft Azure Airflow Azure data factory DB2 Flask APIs Pandas Postgres Snowflake Spacy Sql SQLAlchemy Azure Azure Data Factory ETL Excel SpaCy SQL JavaScript RESTful APIs OAuth OTP verification Role-Based Access Control
Report this Profile?