Madhukar

Madhukar

Data Engineer
United States of America

نبذة عني

Data Engineer With 6 years of experience in automating infrastructure management, designing efficient ETL workflows, and leading successful project deliveries. Proficient in Building and maintaining data pipelines using …

الخبرة

Data Engineer

NextEra
Feb 2022 - حتى الآن · 4 سنوات 8 أشهر

Automated infrastructure management with Terraform, reducing deployment time by 51% in AWS Environment
• Designed AWS Data Pipeline workflows for efficient ETL, which reduced data processing time by 42%.
• Utilized Tools S3, EC2, RDS, Redshift, EMR, Snowflake, dbt, ETL, MapReduce, EMR, Glue, SQL, Lambda.
• Analyzed data using Power BI to identify anomalies and limit discrepancies by 26%.
• Led a team of 1 full-time employee and 3 contractors and collaborated with Data Scientists and Data Analysts.
• Implemented scalable Snowflake data warehouses, boosting data transformation efficiency by 30% with dbt.

DATA ENGINEER

NEXTERA ENERGY INC
Feb 2022 - حتى الآن · 4 سنوات 8 أشهر

<p>Automated infrastructure management with Terraform, reducing deployment time by 51% in AWS Environment<br>
Designed AWS Data Pipeline workflows for efficient ETL, which reduced data processing time by 42%<br>
Utilized Tools S3, EC2, RDS, Redshift, EMR, Snowflake, dbt, ETL, MapReduce, EMR, Glue, SQL, Lambda<br>
Analyzed data using Power BI to identify anomalies and limit discrepancies by 26%<br>
Led a team of 1 full-time employee and 3 contractors and collaborated with Data Scientists and Data Analysts<br>
Implemented scalable Snowflake data warehouses, boosting data transformation efficiency by 30% with dbt</p>

DATA ENGINEER

TECH MAHINDRA
Mar 2021 - Nov 2021 · 8 أشهر

<p>Developed and Maintained data pipelines using Azure Services resulting 40% increase in data processing speed<br>
Created data transfer pipelines from On-prem system to Azure services, increasing 95% network throughput<br>
Deployed Apache Spark on Azure VMs for 40% more efficient data processing<br>
Automated operations with PowerShell and Azure cloud shell, Increased 30% productivity<br>
Use ADF for ETL workflows, enhancing data processing efficiency and SQL data warehouse optimizations by 50%</p>

BIG DATA ENGINEER

NOBROKER TECHNOLOGIES PVT LTD
Aug 2018 - Mar 2021 · 2 سنوات 7 أشهر

<p>Built and deployed big data solutions using Hadoop and Azure HDInsight, improving data processing efficiency by 30%<br>
Reduced migration costs of large data sets across multiple cloud providers by 50%<br>
Use C++ to develop high-performance data processing applications and systems<br>
Used Azure-based streaming services, Azure Kafka, Azure Event Hubs, Azure Stream Analytics, and Azure Databricks<br>
Proficient in Data Streaming, Elasticsearch, Flink, Hadoop, Java, Kafka, MongoDB, SQL, Spark, and Tableau</p>

DATA ENGINEER

DELOITTE
Jan 2018 - Jun 2018 · 5 أشهر

<p>Created SQL code to extract and transform data for business requirements, increasing accuracy by 95%<br>
Enhanced data processing efficiency by 30% and reduced deployment time by 20%<br>
Automated data pipeline for build, test, release, and deployment using Jenkins<br>
Developed Tableau visuals and dashboards to provide insights into key performance trends<br>
Implemented ETL process to streamline data import from various sources into GCP BigQuery warehouse</p>

المهارات

البيانات الضخمة مستودع البيانات هادوب (Hadoop) سكالا سبارك أباتشي هايف أباتشي بيغ خدمات أمازون ويب (AWS) كافكا نوسكيو إل ردشفت (خدمة قاعدة بيانات) إس 3 (خدمة تخزين البيانات على الإنترنت) Snowflake Azure Cloud Computing MySQL ETL Apache Spark SQL Power BI Terraform Python Java C++ Tableau Data Warehousing Informatica Talend Data Streaming Apache Flink MongoDB Machine Learning Pandas NumPy Scikit-Learn R Studio Keras TensorFlow Docker Kubernetes Hive SSIS SSRS Lambda DynamoDB Postgresql YAML Step Functions XML DBT Fivetran Problem-Solving Critical Thinking Effective Communication
الإبلاغ عن هذا الملف الشخصي؟