Kiran Khursheed

Kiran Khursheed

Senior Data Engineer
Pakistan
English, Urdu
Full-time On-site

About Me

Senior Data Engineer and Principal Consultant - Data Analytics with 7+ years of experience designing, building, optimizing, and supporting scalable data pipelines, ETL/ELT processes, cloud data platforms, and enterprise …

Experience

Principal Consultant - Data Analytics / Senior Data Engineer

Systems Limited · Lahore, Pakistan
Jul 2019 - Present · 7 years 4 months

<p>Design, build, and maintain scalable ETL/ELT pipelines using Python, SQL, PySpark/Spark, NiFi, Informatica, Airflow/MWAA, AWS Glue, EMR, Redshift, Snowflake, and Databricks.</p><p> Integrate data across relational databases, APIs, SFTP, cloud storage, enterprise applications, and structured/semi-structured file feeds, standardizing source data into governed analytical layers.</p><p> Develop and optimize Spark/PySpark and SQL transformations for large datasets, including complex joins, aggregations, mapping logic, incremental processing, reconciliation, and analytical outputs.</p><p> Build data warehouse structures across staging, integration, curated, and reporting layers, including fact/dimension models, lookup rules, reusable transformations, and reporting-ready datasets.</p><p> Implement data-quality, governance, and traceability controls including schema validation, primary-key checks, duplicate detection, missing-reference checks, count comparison, reconciliation, audit fields, and source-to-target documentation.</p><p> Optimize pipeline and warehouse performance through SQL query tuning, Spark job optimization, partition-aware processing, Parquet-based storage, transformation redesign, and removal of redundant processing.</p><p> Operate production workflows with scheduling, dependencies, retries, logging, alerting, controlled reruns, and recovery procedures; investigate incidents and resolve data-availability or correctness issues.</p><p> Collaborate with data scientists, analysts, BI teams, architects, QA, and business stakeholders to understand data requirements and translate them into maintainable pipeline and modelling solutions.</p><p> Apply Jenkins/GitHub Actions CI/CD, Git-based code review, automated testing, release coordination, and engineering documentation across DEV, QA, and PROD.</p>

PROJECTS

Cloud Data Engineering & Integration

Regeneron Pharmaceuticals
Duration : 01-Oct-2021 - 31-Dec-2025

<ul><li>Built reusable ingestion workflows using NiFi, Python, Airflow/MWAA, PySpark, AWS S3, EMR, Glue, Athena, Redshift, and PostgreSQL.</li><li>Integrated APIs, operational databases, SFTP, and cloud/file sources; transformed incoming data into standardized Parquet-based datasets for scalable downstream processing.</li><li>Implemented validation, reconciliation, monitoring, retries, and incident-support controls for regulated healthcare/pharma analytics workloads.</li></ul><p></p>

Certifications

AWS Certified Solutions Architect - Professional

University of the Punjab, Pakistan · Lahore , Punjab , Pakistan · 2025

Skills

Python SQL PySpark Apache Spark Spark SQL Pandas Bash Hadoop Hive EMR Databricks Apache NiFi Informatica PowerCenter AWS Glue Airflow MWAA APIs SFTP XML JSON Excel CSV AWS S3 Athena Redshift Lambda RDS PostgreSQL Snowflake SQL Server Azure Data Factory ADLS Data Warehousing Dimensional Modelling Fact/Dimension Structures Source-to-target mapping Schema validation Primary-key validation Duplicate detection Missing-reference checks Reconciliation Audit fields Lineage Traceability SQL tuning Spark optimization Partition-aware processing Parquet Restartable workflows Failure recovery Monitoring
Report this Profile?