Kevin

Kevin

Data Engineer
Canada

نبذة عني

Data Engineer with experience in Azure Data Factory, Azure Databricks, PySpark-SQL, Power BI, and SQL. Has worked on data extraction, ingestion, transformation, ETL/ELT pipelines, and reporting, with experience in data a…

الخبرة

Data Engineer

Co-operators
Jan 2024 - حتى الآن · 2 سنوات 5 أشهر

• Collaborated with business analysts to gather and analyze project requirements, resulting in a 20% improvement in
data accuracy.
• Engineered Azure Data Factory Pipelines for data extraction and ingestion from various source systems, enhancing
data processing efficiency by 40%.
• Accelerated data engineering workflows by designing and implementing customized Azure DevOps CI/CD pipelines,
enhancing data integration, transformation, and deployment efficiency across projects.
• Developed Azure Databricks notebooks utilizing PySpark-SQL for effective data transformation and aggregation,
reducing processing time by 30%.
• Maximized data management efficiency in Lakehouse Medallion architecture using modern data engineering
techniques for storage, processing, and analysis.
• Established Delta Lake Tables and orchestrated the loading of files using PySpark notebooks, resulting in a 25%
increase in data retrieval speed.
• Documented data pipelines, models, and Power BI reports, resulting in a reduction in onboarding time.
• Facilitated the PowerBI Reporting team, ensuring timely and accurate reporting for strategic decision-making.

Data Engineer

Co-operators
Jan 2024 - حتى الآن · 2 سنوات 6 أشهر

Collaborated with business analysts to gather and analyze project requirements, resulting in a 20% improvement in data accuracy.
Engineered Azure Data Factory pipelines for data extraction and ingestion from various source systems, enhancing data processing efficiency by 40%.
Accelerated data engineering workflows by designing and implementing customized Azure DevOps CI/CD pipelines, enhancing data integration, transformation, and deployment efficiency across projects.
Developed Azure Databricks notebooks utilizing PySpark-SQL for effective data transformation and aggregation, reducing processing time by 30%.
Maximized data management efficiency in Lakehouse Medallion architecture using modern data engineering techniques for storage, processing, and analysis.
Established Delta Lake Tables and orchestrated the loading of files using PySpark notebooks, resulting in a 25% increase in data retrieval speed.
Documented data pipelines, models, and Power BI reports, resulting in a reduction in onboarding time.
Facilitated the PowerBI Reporting team, ensuring timely and accurate reporting for strategic decision-making.

Data Analyst

Tryon InfoTech
Apr 2019 - May 2021 · 2 سنوات 1 شهر

Utilized SQL to proficiently extract and transform data from diverse data sources, facilitating seamless data retrieval for reporting purposes.
Developed SQL stored procedures, triggers, functions, tables, and views, including complex queries using CTE.
Successfully designed, developed, and maintained interactive reports and dashboards, primarily focusing on Power BI, and conveyed critical insights to stakeholders through visually appealing and user-friendly reports.
Applied fundamental statistical analysis techniques to dissect data, identifying trends, patterns, and anomalies which contributed valuable insights to support data-driven decision-making.
Developed, maintained, and automated ETL pipelines using Azure Data Factory and Databricks to prepare for reporting and dashboards.
Customized and designed data visualizations and charts within Power BI, enhancing the clarity and impact of reports and ensuring reports met end-users’ needs and expectations.
Implemented automated reporting solutions, significantly reducing manual effort and improving reporting efficiency.

المهارات

خدمات أمازون ويب (AWS) Python Pandas NumPy Matplotlib SQL PySpark Java MSSQL MySQL Postgres SQL MongoDB Hadoop Spark Hive HDFS Sqoop Kafka NoSQL Azure Data Factory Azure Databricks SQL Database Azure Synapse Analytics Blob Storage ADLS2 Azure DevOps Azure SQL Database Azure SQL Managed Instance ETL/ELT Data Warehousing Data Modeling Power BI Data Structures and Algorithms Tableau Git Confluence Visual Studio Jupyter Notebook Strong verbal and written communication Teamwork Collaboration Presentation Critical Thinking
الإبلاغ عن هذا الملف الشخصي؟