نبذة عني
Having 12 years of experience in Design and development of ETL processes based on Cloud and on-Premise systems
Experience working in Airline, Consulting, Finance, Insurance, Aviation Domains
Handled complete project life…
Having 12 years of experience in Design and development of ETL processes based on Cloud and on-Premise systems
Experience working in Airline, Consulting, Finance, Insurance, Aviation Domains
Handled complete project life cycle of reporting from requirements gathering to go live.
Collaborate with diverse agile teams to assist with the implementation of complex and innovative features
Responsible for the extraction and analysis of complex information from a variety of databases as well as transformation of extracted data from large datasets into insights suitable for presentation to various audiences.
Work collaboratively with business and analytics groups, on cross functional projects and data initiatives to solve business problems.
Ensure quality design, delivery, and adherence to corporate standards and security guidelines
Commitment to quality in deliverables
الخبرة
Lead Data Engineer
<p>Acquire, ingest, and process data from multiple sources systems into Microsoft Azure platform.</p><p> Design and build data pipelines for machine learning that are robust, modular, scalable, deployable, reproducible, and versioned.</p><p> Design and develop ETL pipelines from data warehouse to ADF, Databricks and Snowflake.</p><p> Well experienced on technologies like Apache Spark, Pyspark, Databricks, and Azure Microsoft, SQL and orchestrating pipelines.</p><p> Designed and implemented scalable Data Lake and Medallion Architecture (Bronze, Silver, Gold) solutions to ingest, cleanse, transform, and curate large-volume data, enabling reliable, governed, and analytics-ready datasets for downstream reporting and business intelligence.</p><p> Designed and implemented Data Vault and dimensional data models, including Hubs, Links, Satellites, fact/dimension tables, surrogate keys, and SCD Type 1/Type 2, supporting scalable, auditable, and analytics-ready data platforms.</p><p> Developed detailed Source-to-Target Data Mappings defining transformation rules, business logic, data types, and validation requirements, ensuring accurate data integration and consistency across source and target systems.</p><p> Responsible for analyzing and developing the full life cycle of a project including implementation/execution</p><p> Handling adhoc assignments that are moderate- to highly- complex and multi-faceted, to be performed under management guidance.</p><p> Review test plans and scripts, facilitate user acceptance testing and test strategies with developers and testers.</p><p> Perform detail data analysis, including data profiling, system source analysis and auditing under strict tolerance levels.</p><p> Effectively communicate with concise insights and/or visualizations while partnering collaboratively with colleagues (onshore/offshore model) and senior leaders.</p>
Data Engineer
<p>Ingest data from various sources such as databases, files, APIs, and streaming platforms into Azure.</p><p> Designed and orchestrated scalable end-to-end ETL/ELT pipelines using Azure Data Factory, migrating and integrating data from on-premises SQL Server to Snowflake.</p><p> Utilized Azure Databricks and PySpark for distributed data processing, complex transformations, data cleansing, and optimization across the Microsoft Azure cloud platform.</p><p> Implement new features and optimize existing ones to drive maximum performance.</p><p> Analyzing and resolving technical and applications issues in Production</p><p> Build metadata system where all available data is maintained and cataloged</p><p> Designed and implemented Data Vault models using Hubs, Links, and Satellites to support scalable data integration, historical tracking, auditability, and data lineage across multiple source systems.</p><p> Developed detailed source-to-target mappings defining source attributes, target structures, transformation rules, data types, business logic, and validation requirements to support accurate end-to-end data integration</p><p> Automating data pipelines, monitoring data processes, and managing deployments through CI/CD pipelines</p><p> Designed and implemented dimensional data models using star and snowflake schemas, fact and dimension tables, surrogate keys, and SCD Type 1/Type 2 to support scalable analytics and reporting.</p><p> Identifying and analyzing business requirements, translating requirements to technical specifications.</p><p> Documenting the solutions, the programming changes, and the problems and resolutions</p>
Business Anlayst
<p>Monitoring Jobs scheduled and troubleshooting the errors that occurred during execution.</p><p> Making enhancements in the existing design.</p><p> Effectively worked on Onsite and Offshore work model.</p><p> Reviewed and analyzed functional requirements, mapping documents, problem solving and trouble shooting.</p><p> Loading data from various data sources and legacy systems into Teradata database and develop warehouse using Bteq, multi load, fastload and Informatica</p><p> Fixed the invalid mappings and troubleshoot the technical problems of the database.</p><p> Participated in weekly status meetings, and conducting internal and external reviews as well as formal walk through among various teams and documenting the proceedings</p><p> Used Teradata utilities like BTEQ, fast load, fast export, multi load for data conversion.</p><p> Investigating and fixing the bugs occurred in the production environment and providing the on-call support.</p><p> Thoroughly tested the Sql scripts by validating the data and cross comparing the data</p><p> Used UNIX to navigate around the system and check for specific files, the files’ content, change permissions and see who the current users are.</p>
Associate Software Engineer
<p>This project was to maintain 2 years of Informatica operational data in data warehouse by using Informatica and analysis on informatica objects to find performance issues by creating following reports in Cognos.</p>