نبذة عني
Over 3+ years of experience in developing, analyzing, designing, and implementing Data Engineering and Analytics solutions by Azure Data Factory, Databricks, Azure Synapse, ADL, Azure SQL, & Power BI
Highly Skilled in…
Over 3+ years of experience in developing, analyzing, designing, and implementing Data Engineering and Analytics solutions by Azure Data Factory, Databricks, Azure Synapse, ADL, Azure SQL, & Power BI
Highly Skilled in migration of on-premises SQL Server schemas to the cloud on Azure SQL Server DB and Azure VM and developed and maintained databases across both on-premises and cloud deployments
Excellent in Extracting, Transformation, and Loading (ETL) using various tools like export/import data and SQL Server Integration Services.Created, developed, evaluated, and deployed Packages into production servers by creating package configurations
Proficient in creating Pipelines in ADF using Linked Services/Datasets/Pipeline/ to Extract, Transform, and load data from various sources like Azure SQL, Blob storage, Azure SQL Data warehouse, write-back tool, and backward
Proficient in Ingestion of Large Datasets using Python, writing Python codes to automate the interaction, and downloading of data as per the data frequency from RESTful API, Azure Storage, FTP servers, or any client-side application which acts as a data source
Skilled in setting up Data Lake in Azure and setup Azure Queue Storage (AQS) messaging between Azure Data Lake and trusted third-party providers in maintaining hash tables on SQL Server
Proficient in SQL Server Integration Services (SSIS) and SQL Server Reporting Services (SSRS) with good knowledge of SQL Server Analysis Services (SSAS) & Power BI
Expertise in developing visual, interactive reports using Tableau, Power BI, and other business intelligence tools for effective prediction and understanding of data analysis trends
Proficient in importing, exporting, and cleaning databases using SQL, NumPy, and Pandas in Python
Team player with excellent interpersonal skills, self-motivated, dedicated, and understanding of the demands of 24/7 system maintenance and has good customer support experience
Worked in an Agile environment and have good insight into Agile methodologies and Lean working techniques. Participated in Agile ceremonies and Scrum Meetings
الخبرة
Azure Data Engineer
Collaborated with cross-functional team members, and with input from relevant working groups or committees, determine data requirements, and administer several annual and ad hoc data
Designed and developed components and features for the ingestion framework, based on functional and non-functional requirements in Python/PySpark within the Azure platform
Worked on full end-to-end development activities from going live for development in the Azure platform
Developed full pipeline ETL applications to move data within a corporate data management platform, with both MS Azure and MS SQL Server tools
Participated in data integration projects, and worked with other teams to ensure that data is integrated effectively across different systems and applications.
Participated with corporate data user teams, developing data validation and test plans, performing user acceptance testing, and providing feedback to development and sustainment teams
Involved in the core company data pipeline, responsible for scaling up data processing flow to meet the rapid data growth
Developed data processing pipelines in the Azure environment (receiving content, transforming data, and sending to a target)
Responsible for data collection and ingestion from external sources, and optimizing data flow between different systems and environments
Designed and build reusable data extraction, transformation, and loading processes to handle data from various sources
Created and maintained highly scalable data pipelines across Azure Data Lake Storage, and Azure Synapse using Data Factory, Data bricks
Data Engineer
Collaborated with cross-functional team
members, and with input from relevant working
groups or committees, determine data
requirements, and administer several annual and
ad hoc data
Designed and developed components and
features for the ingestion framework, based on
functional and non-functional requirements in
Python/PySpark within the Azure platform
Worked on full end-to-end development
activities from going live for development in the
Azure platform
Developed full pipeline ETL applications to move
data within a corporate data management
platform, with both MS Azure and MS SQL Server
tools
Participated in data integration projects, and
worked with other teams to ensure that data is
integrated effectively across different systems
and applications.
Participated with corporate data user teams,
developing data validation and test plans,
performing user acceptance testing, and
providing feedback to development and
sustainment teams
Involved in the core company data pipeline,
responsible for scaling up data processing flow
to meet the rapid data growth
Developed data processing pipelines in the
Azure environment (receiving content,
transforming data, and sending to a target)
Responsible for data collection and ingestion
from external sources, and optimizing data flow
between different systems and environments
Designed and build reusable data extraction,
transformation, and loading processes to handle
data from various sources
Created and maintained highly scalable data
pipelines across Azure Data Lake Storage, and
Azure Synapse using Data Factory, Data bricks
ETL Developer
Designed, created, and maintained SSIS (SQL Server Integration Services) packages to facilitate the migration of data to FNZ databases
Designed and developed Extract, Transform, Load (ETL) workflows adhering to best practices, and create reusable components to optimize the efficiency and effectiveness of data migration processes
Offered post-implementation support once the migration is complete, assisting both the project team and the service and support teams in identifying and resolving issues that may arise
Collaborated effectively with internal teams and client stakeholders to understand their data requirements, gather feedback, and ensure alignment between technical solutions and business needs
Continuously assessed and optimized the performance of ETL workflows and data migration processes to enhance efficiency, minimize processing time, and improve overall system performance
Shared expertise and knowledge with team members, providing training and guidance on data mapping solutions, ETL development best practices, and migration processes
System Administrator
Responsible for the planning, deployment, configuration, and maintenance of the university's computer systems, servers, networking devices, and other hardware components. This includes managing the university's data centers, ensuring optimal performance, and addressing any hardware failures or issues.
Involved in installing, configuring, and maintaining operating systems, such as Windows, Linux, or macOS, on university computers. This involves applying patches and updates, managing user accounts and permissions, and ensuring the systems are secure and up to date
Overseeing the university's network infrastructure, including routers, switches, firewalls, and wireless access points. Ensured the network is properly configured, secure, and functioning optimally. which involves monitoring network traffic, troubleshooting network issues, and implementing network upgrades or expansions when necessary.
Provided technical support to faculty, staff, and students, assisting them with any IT-related problems they encounter. Also worked on troubleshooting software and hardware issues, assisting with software installations, and resolving network connectivity
Played a critical role in ensuring the security of the university's data and systems. Involved in implementing security measures such as firewalls, antivirus software, and intrusion detection systems. And also monitored system logs for potential security breaches, conduct security audits, and develop and enforce IT security policies
Responsible for implementing and maintaining backup systems and procedures to protect the university's data from loss or damage.
Worked on regular backups of critical systems and data, testing the backup and recovery processes, and ensuring the availability of data in the event of a disaster.
Managed the software licenses for the university, ensuring compliance with licensing agreements and maintaining an inventory of licensed software.