About Me
Skilled data engineer with a track record in building, constructing, and managing reliable infrastructure and data pipelines. Adept at utilizing Flask, SQL, and Pandas to create scalable ETL procedures and data processin…
Skilled data engineer with a track record in building, constructing, and managing reliable infrastructure and data pipelines. Adept at utilizing Flask, SQL, and Pandas to create scalable ETL procedures and data processing apps. Competent in communicating with clients, having a track record of returning calls, going to clients offices, and offering technical advice to efficiently complete projects. Capable of overseeing autonomous projects from start to finish while maintaining adherence to deadlines and quality requirements. Adept at working with cross-functional teams to smoothly incorporate data solutions into apps and systems that are already in place. A lifelong student who is passionate about keeping up with the latest developments in data engineering trends and technology. Outstanding ability to solve problems, pay close attention to details, and effectively communicate.
Experience
Big Data Engineer
I have been working as a big data engineer for 2 years the responsibilities I handle are creating ADF pipelines , Using Pandas to manipulate data and also I have a good amount of experience in working as backend developer in creating web apps for Retail brands ,The tech I have used for this is Flask Apis
Spend Analysis
<p>Established data pipelines using Azure ADF<br>
Built multiple data transformation pipelines with Airflow in PostgreSQL<br>
Implemented back-end to front-end integration with Flask and JavaScript<br>
Designed a role-based access system for the data platform</p>
RM Demand Planning
<p>Automated Excel sheets with complex formulas<br>
Wrote well-structured and maintainable code to handle formula calculations, data retrieval, and sheet dependencies<br>
Ensured high performance and error-free execution<br>
Used ADF pipelines to push data from DB2 to Postgres<br>
Collaborated with the UI/UX team to design intuitive user interfaces<br>
Integrated various data sources into the automation system for real-time data updates and dynamic reporting</p>
Service Classification
<p>Worked on text classification using SpaCy<br>
Classified services based on the given classifications<br>
Generated codes after classification of services</p>
Web Application
<p>Developed and deployed a web application for major retail brands<br>
Implemented secure login with OTP verification<br>
Created RESTful APIs using Flask for session management, authentication, and user data storage<br>
Integrated a dynamic coupon management system<br>
Designed a rewards system to track and display user points and benefits<br>
Utilized SQLAlchemy for database interactions</p>