Muhamamad Usman Alam Khan

Integrated Snowflake data warehouse with Databricks, establishing scalable connections for data processing and analysis
Designed and implemented data validation script using Python and PySpark to identify and reconcile missing data in Snowflake tables against client-provided CSV sources, ensuring data integrity for Novartis client
Created generic, reusable validation logic applicable across multiple tables and databases, improving data quality assurance processes
Built ETL pipelines in Databricks implementing Medallion Architecture (Bronze/Silver/Gold layers) for multiple clients, enabling efficient data transformation and organization
Converted and optimized data tables to Parquet format in Databricks for improved compression and query performance across analytical workloads
Maintained and optimized SQL views for client reporting dashboards, fixing and improving logic to support data accuracy
Supported junior engineers and interns on ETL tasks and data analysis projects, providing guidance on technical issues and best practices
Executed ETL implementations using both Informatica PowerCenter and Informatica Developer, managing data migrations for existing client projects

Integrated Snowflake data warehouse with Databricks, establishing scalable connections for data processing and analysis, Designed and implemented data validation script using Python and PySpark to identify and reconcile missing data in Snowflake tables against client-provided CSV sources, ensuring data integrity for Novartis client, Created generic, reusable validation logic applicable across multiple tables and databases, improving data quality assurance processes, Built ETL pipelines in Databricks implementing Medallion Architecture (Bronze/Silver/Gold layers) for multiple clients, enabling efficient data transformation and organization, Converted and optimized data tables to Parquet format in Databricks for improved compression and query performance across analytical workloads, Maintained and optimized SQL views for client reporting dashboards, fixing and improving logic to support data accuracy, Supported junior engineers and interns on ETL tasks and data analysis projects, providing guidance on technical issues and best practices, Executed ETL implementations using both Informatica PowerCenter and Informatica Developer, managing data migrations for existing client projects

Worked on ETL pipeline implementations for Abu Dhabi Islamic Bank (ADIB) and Talbots (US women's apparel company), creating and maintaining Informatica PowerCenter jobs through full SDLC (DEV, SIT, UAT, PROD)
Implemented new ETL logic for Talbots project, updating legacy transformations and building entirely new ones to support business requirements
Optimized SQL queries and embedded query logic directly in mappings, improving query performance across ADIB and Talbots pipelines
Developed Databricks pipelines to process data from multiple sources, implementing data layering strategy (raw, curated, landing) on AWS S3
Optimized data loading to AWS Redshift using PySpark, improving query performance and reducing infrastructure costs

Worked on ETL pipeline implementations for Abu Dhabi Islamic Bank (ADIB) and Talbots (US women's apparel company), creating and maintaining Informatica PowerCenter jobs through full SDLC (DEV, SIT, UAT, PROD) Implemented new ETL logic for Talbots project, updating legacy transformations and building entirely new ones to support business requirements, Optimized SQL queries and embedded query logic directly in mappings, improving query performance across ADIB and Talbots pipelines, Developed Databricks pipelines to process data from multiple sources, implementing data layering strategy (raw, curated, landing) on AWS S3, Optimized data loading to AWS Redshift using PySpark, improving query performance and reducing infrastructure costs

Supported Big Data Analytics Project for Habib Bank Limited (HBL), managing data pipelines across multiple streams using Informatica Developer and PowerCenter
Migrated data pipelines from Hive to Informatica, creating and maintaining 100+ mappings daily to move table logic and ETL transformations, enabling improved performance and maintainability
Created and maintained ETL scripts for data ingestion from source RDBMS to Data Lake (HDFS) using Apache Sqoop and Spark scripts
Converted Hive tables to Parquet format for columnar storage efficiency and improved query performance on large-scale datasets
Executed data recovery and reload procedures from source and historical tables, ensuring data integrity and business continuity
Executed Customer Master Data Management project, consolidating and mastering data from 3 disparate sources into single source of truth
Optimized SQL queries embedded in ETL mappings to improve query performance and data processing efficiency
Trained resources for Data Pipeline Operations team and collaborated with clients to resolve technical issues and gather new requirements

Supported Big Data Analytics Project for Habib Bank Limited (HBL), managing data pipelines across multiple streams using Informatica Developer and PowerCenter, Migrated data pipelines from Hive to Informatica, creating and maintaining 100+ mappings daily to move table logic and ETL transformations, enabling improved performance and maintainability, Created and maintained ETL scripts for data ingestion from source RDBMS to Data Lake (HDFS) using Apache Sqoop and Spark scripts, Converted Hive tables to Parquet format for columnar storage efficiency and improved query performance on large-scale datasets, Executed data recovery and reload procedures from source and historical tables, ensuring data integrity and business continuity, Executed Customer Master Data Management project, consolidating and mastering data from 3 disparate sources into single source of truth, Optimized SQL queries embedded in ETL mappings to improve query performance and data processing efficiency, Trained resources for Data Pipeline Operations team and collaborated with clients to resolve technical issues and gather new requirements