Abdul Mannan

<p>Design, develop, and optimize multiple data warehouses, data marts, and data lake(house) using Databricks and Spark.<br>
Optimize ETL performance, cost, and execution time using PySpark on Databricks (AWS, GCP, and Azure).<br>
Design cost-efficient and performant solutions, solving complex problems on AWS and Azure cloud.</p>

Design develop, and optimize multiple data warehouses, data marts, and data lake(house) using Databricks and Spark. Optimize ETL performance, cost, and execution time using PySpark on Databricks (AWS, GCP, and Azure) Design cost-efficient & performant solutions, solving complex problems on AWS & Azure cloud.

<p>Tech company focused on social media</p><ul><li>Redesign Datalake infrastructure, leveraging Databricks and Spark</li><li>Developed intricate dimensional models for various data entities including Posts, Users</li><li>Successfully overhauled the end-to-end real-time user rewards system</li></ul>

<p>Redesign Datalake infrastructure, leveraging Databricks and Spark.<br>
Developed intricate dimensional models for various data entities including Posts and Users.<br>
Successfully overhauled the end-to-end real-time user rewards system.</p>

<p>1 - Big Data Consultant – Allied Bank Limited </p><p>Designed large-scale data pipelines with ODI, Kafka, Spark, and Cloudera CDH, including real-time fraud detection for a major Pakistani bank. Automated the creation of 28,000 ETL jobs using Groovy & ODI SDK, saving 8 months of effort, and deployed predictive models that boosted campaign response by 3x and optimized ATM operations nationwide. Led stakeholder engagements, authored technical documentation, trained 20+ colleagues, and identified $2–3M in new data-driven opportunities, earning an IBM “We Deliver” 2019 nomination. </p><p>2 - Sr. Big Data Consultant - United Bank Limited </p><p>Designed Data Lake and Multiple Datamarts ETL pipelines using Informatica Big Data Suite, HDP, and IBM Watson, including a real-time fraud detection pipeline delivering end-to-end results in under 2 minutes. Built scalable solutions that overcame major product limitations, created a custom automation framework that accelerated pipeline development by 10x, and improved Teradata FSLDM integration.</p><p>Served as an associate solution architect, authored key technical/architecture documents, and conducted multiple knowledge- sharing sessions on Informatica Big Data Suite, HDP, and the Hadoop ecosystem. </p>

<p>Designed large-scale data pipelines with ODI, Kafka, Spark, and Cloudera CDH, including real-time fraud detection for a major Pakistani bank.<br>
Automated the creation of 28,000 ETL jobs using Groovy and ODI SDK, saving 8 months of effort.<br>
Deployed predictive models that boosted campaign response by 3x and optimized ATM operations nationwide.<br>
Led stakeholder engagements, authored technical documentation, trained 20+ colleagues, and identified $2–3M in new data-driven opportunities.<br>
Earned an IBM “We Deliver” 2019 nomination.</p>

<p>Redesigned MapReduce/Hive ETL pipeline to PySpark/Hive, reducing costs and saving $50K annually.<br>
Migrated legacy development platform to Docker and Kubernetes.<br>
Developed the company's 1st hybrid mobile application using React Native.</p>

<p>Software development company </p><p>Redesigned MapReduce/Hive ETL pipeline to Pyspark/Hive, reducing costs and saving $50K annually</p><p>Migrated legacy development platform to Docker and Kubernetes </p><p>Developed the company's 1st hybrid mobile application using React Native </p>

<p>Software development company </p><p>Designed & developed web projects using Django, AngularJS, and ReactJS</p><p>Overseeing and quality controlling backend and frontend development work </p><p>Practiced agile methodologies and team collaboration</p>

<p>Software development company </p><p>Developed proficiency with Laravel, Codeigniter framework, and jQuery. Conducted thorough unit testing and improved performance through automated testing.</p><p>Liaised with quality assurance to ensure professional standards</p>

<p>Developed proficiency with Laravel, CodeIgniter framework, and jQuery.<br>
Conducted thorough unit testing and improved performance through automated testing.<br>
Liaised with quality assurance to ensure professional standards.</p>

<p>Designed Data Lake and multiple datamarts ETL pipelines using Informatica Big Data Suite, HDP, and IBM Watson, including a real-time fraud detection pipeline delivering end-to-end results in under 2 minutes.<br>
Built scalable solutions that overcame major product limitations.<br>
Created a custom automation framework that accelerated pipeline development by 10x.<br>
Improved Teradata FSLDM integration.<br>
Served as an associate solution architect.<br>
Authored key technical and architecture documents.<br>
Conducted multiple knowledge-sharing sessions on Informatica Big Data Suite, HDP, and the Hadoop ecosystem.</p>