نبذة عني
Data Engineer with experience in Azure data pipelines, data modeling, BI, and analytics across financial services and telecommunications. Skilled in SQL, Python, DBT, Snowflake, Azure Data Factory, Azure Synapse Analytic…
Data Engineer with experience in Azure data pipelines, data modeling, BI, and analytics across financial services and telecommunications. Skilled in SQL, Python, DBT, Snowflake, Azure Data Factory, Azure Synapse Analytics, and cloud data warehousing, with a background in data analysis, reporting, and stakeholder collaboration.
الخبرة
Data Engineer
Developed and maintained real-time data pipelines leveraging Azure Service Bus (Queues, Topics, and Subscriptions) and Azure Functions to facilitate real-time data reporting and analysis.
Designed Azure Functions to consume and transform data payloads from applications via Service Bus, subsequently storing the processed data in analytical database and Azure Storage Account.
Implemented CI/CD pipelines using GitHub Actions for streamlined migration of ADF pipelines and Azure Function Apps across Dev, UAT, and production environments.
Developed and maintained efficient data pipelines with Azure Data Factory and Azure Synapse Analytics for ETL processes, ensuring data integrity and availability of high-quality data for reporting and dashboard needs.
Configured Azure resources such as resource groups, storage accounts, Cosmos DB, SQL databases, Microsoft Purview, Azure Synapse Analytics and Azure Data Factory, along with security and identity management tools like Azure Key Vaults and service principals.
Collaborated closely with various teams and leadership across the organization to develop and maintain data models using DBT, SQL, and GIT.
Led the creation of a detailed data catalog, including lineage and metadata definitions, to enhance data utility across business units.
Managed Azure resource configuration and allocation for data projects, aligning with project goals and financial constraints, and conducted cost analysis and optimization for Azure data services.
Executed strategies for incremental data loading in Azure Data Factory and Azure Synapse pipelines, enhancing data refresh rates and minimizing resource usage, and implemented pipeline modularity and reusability for effective data processing.
Developed data models that satisfy user requirements and provide actionable insights.
Promoted a culture of self-serve analytics among business teams by enhancing data retrieval methods.
Regularly engaged with stakeholders to understand their needs, presenting data and BI projects to keep them informed and aligned.
Data Engineer
• Developed and maintained real-time data pipelines leveraging Azure Service Bus (Queues, Topics, and Subscriptions) and Azure Functions to facilitate real-time data reporting and analysis. I designed Azure Functions to consume and transform data payloads from applications via Service Bus, subsequently storing the processed data in analytical database and Azure Storage Account.
• Implemented CI/CD pipelines using GitHub Actions for streamlined migration of ADF pipelines and Azure Function Apps across Dev, UAT, and production environments.
• Developed and maintained efficient data pipelines (with Azure Data Factory and Azure Synapse Analytics) for ETL processes, ensuring data integrity and availability of high-quality data for all reporting and dashboard needs.
• Configured Azure resources such as resource groups, storage accounts, Cosmos DB, SQL databases, Microsoft Purview, Azure Synapse Analytics and Azure Data Factory, along with security and identity management tools like Azure Key Vaults and service principals.
• Collaborated closely with various teams and leadership across the organization to develop and maintain data models using DBT, SQL, and GIT.
• Led the creation of a detailed data catalog, including lineage and metadata definitions, to enhance data utility across business units.
• Managed Azure resource configuration and allocation for data projects, aligning with project goals and financial constraints, and conducted cost analysis and optimization for Azure data services.
• Executed strategies for incremental data loading in Azure Data Factory and Azure Synapse pipelines, enhancing data refresh rates and minimizing resource usage, and implemented pipeline modularity and reusability for effective data processing.
• Developed data models that satisfy user requirements and provide actionable insights. Additionally, promoted a culture of self-serve analytics among business teams by enhancing data retrieval methods.
• Regularly engaged with stakeholders to understand their needs, presenting data and BI projects to keep them informed and aligned.
Data Engineer
Engineered data transformation and ingestion processes by developing data pipelines in Azure Data Factory and Azure Synapse Analytics for the extraction and transformation of data from applications, ensuring high data quality and effective data storage in the storage account, Azure SQL DB and Cosmos DB.
Optimized Azure resource utilization by implementing cost-effective data processing and storage solutions, achieving a 20% reduction in cost associated with Azure resources.
Implemented minimal resource configuration for Dev and UAT resources, tracking usage costs for resources and implementing cost alerts.
Developed and maintained CI/CD pipelines for Azure Data Factory using GitHub Actions for automated deployment and testing of data pipelines in Azure Data Factory, enhancing deployment efficiency and reducing downtime.
Created monitoring, alerting and logs for data pipelines, ensuring high availability and performance consistency across all Azure data services.
Maintained the data pipeline, infrastructure and databases, ensuring data is available to the Business intelligence team and analysts for reporting and dashboarding.
Implemented incremental data load in Azure Data Factory and Azure Synapse pipelines, improving data update frequency and reducing resource consumption.
Created modular data pipelines to effectively manage the data transformation workload, ensuring modularity, reusability, and maintainability.
Developed and maintained data models using DBT with integration with GitHub for the CI/CD processes for automated code deployment.
Collaborated with multiple teams including BI team, data analysts, data scientists, Finance, Technology and Risk Departments to understand their data requirements and needs.
Data Analyst, Financial & Corporate Development
Engineered complex SQL codes to analyze data, offering strategic qualitative and quantitative analysis to leadership.
Provided insights that facilitated decision-making, focusing on enhancing return on investment.
Analyzed large datasets from customer touchpoints to comprehend customer behavior.
Provided actionable insights and recommendations to leadership, product, and marketing teams to drive business success.
Oversaw the end-to-end data and reporting lifecycle, transformed raw data using DBT, built data models, stored data in a Snowflake data warehouse and created data products like reports and dashboards.
Led the Business Intelligence team in BI projects, data initiatives, OKR planning and task prioritization, and collaborated with stakeholders from Finance, Technology and Risk Departments.
Collaborated with other data teams on data governance, data quality and data management, fostering an environment of collective growth and knowledge sharing.
Mentored BI Analysts in business intelligence and risk practices, and encouraged a culture of continuous learning and professional development.
Business Intelligence Analyst
Developed and maintained data models from large datasets and managed analytical data within the Google Cloud Platform (GCP) and BigQuery data warehouse.
Built BI dashboards to provide business leaders and stakeholders with clear visibility into business issues and challenges.
Utilized advanced analytical methods to generate insights that drove client sales during peak shopping periods.
Used KPI variable optimization, time series analysis, outlier analysis and predictive modelling.
Provided data-driven recommendations to internal teams to boost business outcomes.
Built data models to test the effectiveness of optimized variables and to aid forecasting.
Queried multiple databases with SQL to extract and analyze data for investigations.
Conducted root cause analysis for incidents and recommended remedial actions.
Analyzed data from multiple sources such as network traffic, application usage and latency from application databases and software for SLA/KPI reporting.
Generated weekly and monthly dashboards to highlight business trends, encountered issues, lessons learned and potential areas for improvement.
Business Analyst
Analyzed budget allocation and utilization for Provincial Government programs in FY 2017/18, which helped evaluate budget requirements for FY 2018/19 and steer strategic direction and priorities.
During the planned transition of SaskJobs to the National Job Bank (NJB), analyzed job order data to report on job posting trends, aiding strategic planning and forecasting readiness.
Utilized Oracle BI Discoverer for ad-hoc querying and data analysis from the Ministry's One Client Service Model (OCSM) database, assisting decision making and reporting.
Extracted and analyzed the Labour Market Development Agreement (LMDA) data for monitoring and reporting.
Analyzed data on training institutions, skills training programs, and beneficiaries.
Performed ETL processes on LMDA flat files received from the Federal Government, ensuring data was efficiently transformed for subsequent analysis.
Engaged with users for requirement gathering, acting as a liaison between users and the IT department to facilitate smooth operations.
Data Analyst/IT Auditor
Provided data input for the development of business plans and customer retention strategies through methods like regression analysis, cluster analysis and predictive modelling.
Extracted and analyzed customers' data for risk analysis, audit, and revenue assurance using ACL software, SQL and MS Excel.
Detected network hacking, subsequently preventing revenue loss.
Assessed the organization's IT controls to mitigate risks concerning the confidentiality, integrity, and availability of business information, ensuring compliance with best practices.
Regularly engaged with management to discuss audit reports and provided advice on remediating audit issues.
Developed Business Intelligence reports and dashboards for monitoring IT KPI metrics.
Team Lead - IT Data Analytics
Performed monthly system income audits to analyze customers' transaction data across 19 African countries, ensuring all the bank's income lines were accurately captured.
Conducted regular reviews of customers', products' and transactions' classifications on the banking application using SQL and ACL software.
Identified and rectified misclassifications to prevent income leakages.
Developed programs to test and review controls in IT processes across all layers of the bank's IT infrastructure, including applications, databases, and data centers.
Participated in IT projects by conducting reviews of controls, quality assurance, functional and user acceptance tests.
Managed planning, performance, and delivery of IT dashboards and reports.
Analyst - Branch Data Analytics
Extracted and analyzed General Ledger (GL) transactions data for 20 branches using SQL to execute daily and monthly reviews.
Detected fraudulent transactions and provided recommendations to prevent recurrence.
Performed advanced analysis of customer transaction data to identify money laundering threats and patterns.
Successfully uncovered instances of transaction structuring and a Ponzi scheme.
Conducted risk analysis of the bank’s business processes, developing comprehensive controls to mitigate risks and protect critical business operations.
Provided Business Intelligence reporting on key performance indicators (KPIs) such as volume of cash deposits, withdrawals and other monetary instruments processed in branches, supporting monitoring and performance measurement.