Ketan Keval

Ketan Keval

Sr. Data Engineer
Canada
Full-time Hybrid

نبذة عني

Senior Data Engineer with 6+ years of experience designing and building scalable data pipelines, ETL/ELT workflows, and cloud data platforms. Skilled in Python, SQL, PySpark, Databricks, Snowflake, Azure, AWS, dbt, Airfl…

الخبرة

Sr. Data Engineer

Amaris Consulting · Toronto
Jun 2025 - حتى الآن · 1 سنة 4 أشهر

<p>Designed and maintained scalable data pipelines using Azure, Databricks, Snowflake, PySpark, dbt, and Airflow.</p><p>Built Delta Lake medallion architecture and dimensional data models for high-volume data platforms.</p><p>Optimized PySpark and Snowflake workloads, reducing processing time and cloud costs.</p><p>Implemented data quality, monitoring, CI/CD, governance, and secure data access.</p><p>Collaborated with business and technical stakeholders to deliver production-ready data solutions.</p>

Data Engineer

Toyota Motors · Toronto
Mar 2022 - Jun 2025 · 3 سنوات 3 أشهر

<p>Built and maintained scalable data pipelines using Azure, Databricks, Snowflake, PySpark, dbt, and Airflow.</p><p>Worked with insurance claims, policy, and member data using Delta Lake and medallion architecture.</p><p>Optimized PySpark workloads, reducing claims processing time by 45% and compute costs by 38%.</p><p>Implemented data quality checks, CI/CD, monitoring, data modeling, and secure PHI controls.</p><p>Developed real-time streaming pipelines using Azure Event Hub and Structured Streaming with sub-minute latency.</p>

ETL Developer

Cognizant · India
Sep 2019 - Mar 2022 · 2 سنوات 5 أشهر

<p>Developed and maintained ETL pipelines using Informatica PowerCenter, Talend, SQL, and PostgreSQL.</p><p>Worked with shipment, carrier, and inventory data to support supply chain analytics and business KPIs.</p><p>Implemented data partitioning, parallel processing, incremental loads, and data validation/reconciliation.</p><p>Built and maintained dimensional data models and optimized Amazon Redshift data loads.</p><p>Supported production ETL workflows using Autosys and Unix Shell scripting.</p>

المشاريع

Scalable Azure Data Engineering Platform

Amaris Consulting
المدة : 02-Jun-2025 - 28-Sep-2026

<p>Built and managed scalable data pipelines using Azure, Databricks, Snowflake, PySpark, dbt, and Airflow. Implemented Delta Lake medallion architecture, data quality checks, CI/CD, streaming pipelines, and performance optimization, reducing processing time and cloud compute costs. </p>

الشهادات

Microsoft Certified: Azure Data Engineer Associate

microsoft · Toronto , Ontario , Canada · 2025

المهارات

Python Scala SQL Spark SQL Shell Scripting Bash Apache Spark PySpark Spark Streaming Hadoop HDFS YARN MapReduce Hive HBase Apache Flink Apache Storm Apache Beam Delta Lake Apache Iceberg Apache Hudi Hive Metastore Parquet ORC Informatica PowerCenter Talend Open Studio IBM DataStage SSIS Apache NiFi AWS Glue Azure Data Factory Apache Kafka Kafka Streams Confluent Platform Kafka Connect AWS Kinesis Azure Event Hub RabbitMQ ActiveMQ GCP Pub/Sub Apache Airflow AWS Glue Workflows Azure Data Factory Pipelines Cron Jobs Oracle SQL Server MySQL PostgreSQL Teradata Azure SQL Database
الإبلاغ عن هذا الملف الشخصي؟