Karan Milan Thevar

Karan Milan Thevar

Data Engineer | Driving Scalable and Efficient Data Solutions
United Arab Emirates
Hindi, English

About Me

• Results-driven Data Engineer with over 5 years of experience in designing and implementing high-performance and scalable data solutions/pipelines aimed at expediting data ingestion processes.
• Proficient in ETL, data …

Experience

Technical Lead

IntegraConnect, Mumbai, INDIA
Feb 2025 - Present · 1 year 5 months

Led a cross-functional Data Operations team of 4 developers and 2 Network Operations Center (NOC) members to optimize data management processes and enhance operational efficiency.
Designed and implemented a DataOps Studio platform, reducing client onboarding time from 6 weeks to 2 weeks and cutting company costs by 75% through optimized data workflows.

Technical Lead

IntegraConnect
Feb 2025 - Present · 1 year 5 months

• Team Lead: Led a cross-functional Data Operations team of 4 developers and 2 Network Operations Center (NOC) members to optimize data management processes and enhance operational efficiency.
• Platform Architecture: Designed and implemented a DataOps Studio platform, reducing client onboarding time from 6 weeks to 2 weeks and cutting company costs by 75% through optimized data workflows

Data Engineer

Egen Solutions
Feb 2021 - Feb 2025 · 3 years 11 months

• Data Pipeline Optimization: Engineered automated ingestion pipelines handling over 100GB of weekly raw data across 40+ clients, embedding robust fail-recovery mechanisms for seamless operations using Azure Data Factory
• Lead Cloud Migration: Spearheaded migration of data from MS SQL to Snowflake, reducing processing time by 50% and enabling scalable data solutions for 40+ oncology care customers with more than 20 different data sources.
• ETL Automation: Developed SQL Agent jobs to automate extraction, transformation, and loading processes, leveraging the Azure Data Factory for efficient pipeline deployment.
• Data Integrity & Transformation: Designed PowerShell scripts to streamline data scrubbing, reducing erroneous data by 70%, and implemented Snowflake stored procedures for incremental data loads.
• Data Modeling: Created and enhanced Common Data Models (CDM) using DBT & Snowflake, achieving a 40% runtime efficiency improvement.
• Collaboration & Problem-Solving: Partnered with downstream teams to resolve P1 issues, ensuring uninterrupted data system stability and less than 5% downtime
• Documentation & Agile Practices: Utilized Confluence for documenting processes and actively contributed to Scrum/Kanban workflows for iterative project delivery.

Data Engineer

Egen Solutions, Mumbai, INDIA
Oct 2024 - Feb 2025 · 4 months

Engineered automated ingestion pipelines handling over 100GB of weekly raw data across 40+ clients, embedding robust fail-recovery mechanisms for seamless operations using Azure Data Factory.
Spearheaded migration of data from MS SQL to Snowflake, reducing processing time by 50% and enabling scalable data solutions for 40+ oncology care customers with more than 20 different data sources.
Developed SQL Agent jobs to automate extraction, transformation, and loading processes, leveraging the Azure Data Factory for efficient pipeline deployment.
Designed PowerShell scripts to streamline data scrubbing, reducing erroneous data by 70%, and implemented Snowflake stored procedures for incremental data loads.
Created and enhanced Common Data Models (CDM) using DBT & Snowflake, achieving a 40% runtime efficiency improvement.
Partnered with downstream teams to resolve P1 issues, ensuring uninterrupted data system stability and less than 5% downtime.
Utilized Confluence for documenting processes and actively contributed to Scrum/Kanban workflows for iterative project delivery.

Data Engineer

Egen Solutions, Naperville, IL, USA
Feb 2021 - Sep 2024 · 3 years 7 months

Engineered automated ingestion pipelines handling over 100GB of weekly raw data across 40+ clients, embedding robust fail-recovery mechanisms for seamless operations using Azure Data Factory.
Spearheaded migration of data from MS SQL to Snowflake, reducing processing time by 50% and enabling scalable data solutions for 40+ oncology care customers with more than 20 different data sources.
Developed SQL Agent jobs to automate extraction, transformation, and loading processes, leveraging the Azure Data Factory for efficient pipeline deployment.
Designed PowerShell scripts to streamline data scrubbing, reducing erroneous data by 70%, and implemented Snowflake stored procedures for incremental data loads.
Created and enhanced Common Data Models (CDM) using DBT & Snowflake, achieving a 40% runtime efficiency improvement.
Partnered with downstream teams to resolve P1 issues, ensuring uninterrupted data system stability and less than 5% downtime.
Utilized Confluence for documenting processes and actively contributed to Scrum/Kanban workflows for iterative project delivery.

Data Analyst II

Granite Telecommunications, Boston, MA, USA
Mar 2019 - Feb 2021 · 1 year 11 months

Generated and modified stored procedures in SSMS & Oracle to design dashboards and reports using SSRS.
Delivered interactive dashboards to track key metrics like customer attrition rate and reasons for leaving, which helped in driving informed decision-making for stakeholders and reduced the attrition rate by 30%.
Develop and enforce data models to ensure accuracy, consistency, and reliability across all systems.
Build and optimize ETL workflows to seamlessly extract, transform, and load data from multiple sources into the central data warehouse using SSIS.

Data Analyst II

Granite Telecommunications
Mar 2019 - Feb 2021 · 1 year 11 months

• Data Pipeline Optimization: Engineered automated ingestion pipelines handling over 100GB of weekly raw data across 40+ clients, embedding robust fail-recovery mechanisms for seamless operations using Azure Data Factory
• Lead Cloud Migration: Spearheaded migration of data from MS SQL to Snowflake, reducing processing time by 50% and enabling scalable data solutions for 40+ oncology care customers with more than 20 different data sources.
• ETL Automation: Developed SQL Agent jobs to automate extraction, transformation, and loading processes, leveraging the Azure Data Factory for efficient pipeline deployment.
• Data Integrity & Transformation: Designed PowerShell scripts to streamline data scrubbing, reducing erroneous data by 70%, and implemented Snowflake stored procedures for incremental data loads.
• Data Modeling: Created and enhanced Common Data Models (CDM) using DBT & Snowflake, achieving a 40% runtime efficiency improvement.
• Collaboration & Problem-Solving: Partnered with downstream teams to resolve P1 issues, ensuring uninterrupted data system stability and less than 5% downtime
• Documentation & Agile Practices: Utilized Confluence for documenting processes and actively contributed to Scrum/Kanban workflows for iterative project delivery.

Skills

Data Modeling JavaScript PySpark Power BI AWS SQL Python PowerShell MySQL Oracle PostgreSQL Git Docker Confluence DBT SSIS SSRS Microsoft Azure Google Cloud Platform Amazon S3
Report this Profile?