About Me
Data Engineer with experience in data modeling, data pipelines, ETL systems, data visualization, and big data engineering across Azure and GCP environments. Skilled in Python, SQL, Spark, Airflow, Power BI, and a wide ra…
Data Engineer with experience in data modeling, data pipelines, ETL systems, data visualization, and big data engineering across Azure and GCP environments. Skilled in Python, SQL, Spark, Airflow, Power BI, and a wide range of data engineering, DevOps, and cloud tools.
Experience
Data Engineer
<p>Gathering business requirements and translating them into technical specifications<br>
Designing and developing data models and data visualizations using Power BI<br>
Building and managing data pipelines using Azure Data Factory<br>
Using Azure DevOps for deploying the dashboards<br>
Executing Azure VM as workspace to build the projects and installing all the tools<br>
Using Confluence, Jira and Agile methodology for projects management</p>
Data Engineer
Built an automated proposal search using Selenium, resulting in improved efficiency
and increased win ratesfor new business opportunities.
•Developed an automated ETL system to extract, transform, and load data from massive
databases with low data quality, resulting in better data visualization using Looker Studio.
•Built various Event Streaming pipelines using different GCP services to understand
user behavior, depending on data sources and client budget and goals.
•Designed and implemented multiple System Architectures to meet specific
requirements outlined in client request for proposals.
•Building and deploying WhatsAPP botsystem powered with ChatGPT
•Building a crawling system to extract contents from several Linkedin Pages in order to
train ChatGPT to obtain better contents
•Developed a Python-based migration system to migrate data from multiple EC2 into a
centralized server.
•Developed strong relationships with stakeholders throughout the entire product
development process, ensuring that projects were delivered on time and on budget.
•Documented several data team projects in Confluence, outlining best practices and
technologies used to ensure knowledge transfer and team alignment.
Data Engineer
Gathering business requirements and translating them into technical specifications
Designing and developing data models and data visualizations using Power BI
Building and managing data pipelines using Azure Data Factory
Azure DevOps for deploying the dashboards
Executing Azure VM as workspace to build the projects and installing all the tools
Using Confluence, Jira and Agile methodology for projects management
Big Data Engineer
<p>Built an automated ETL system that generated leads on LinkedIn for efficient lead acquisition, using various tools and languages<br>
Collaborated with data science to build a pattern prediction model, resulting in the generation of Salesforce contact emails and improved communication with potential leads<br>
Built Scrapy/Splash crawling system for automated data scraping from a JavaScript-based website</p>
Big Data Engineer
<p>Playing a key role in the data team for the development of a stock forecasting system using variety of tools such as Spark, Airflow, Hive, and Sqoop<br>
Building a data migration system to migrate data from local into IPFS using Ethereum Blockchain, Solidity and MetaMask<br>
Setting different Power BI dashboards after transforming data in Databricks using Spark and loading it into Azure SQL</p>
Big Data Engineer
<p>Implemented multiple system architectures<br>
Built an automated proposal search using Selenium, resulting in improved efficiency and increased win rates for new business opportunities<br>
Developed an automated ETL system to extract, transform, and load data from massive databases with low data quality, resulting in better data visualization using Looker Studio<br>
Built various event streaming pipelines using different GCP services to understand user behavior, depending on data sources and client budget and goals<br>
Designed and requirements outlined in client request for proposals<br>
Building and deploying WhatsAPP bot system powered with ChatGPT<br>
Building a crawling system to extract contents from several Linkedin Pages in order to train ChatGPT to obtain better contents<br>
Developed a Python-based migration system to migrate data from multiple EC2 into a centralized server<br>
Developed strong relationships with stakeholders throughout the entire product development process, ensuring that projects were delivered on time and on budget<br>
Documented several data team projects in Confluence, outlining best practices and technologies used to ensure knowledge transfer and team alignment</p>
Big Data Engineer
Built an automated ETL system that generated leads on LinkedIn for efficient lead acquisition, using various tools and languages.
Collaborated with data science to build a pattern prediction model, resulting in the generation of Salesforce contact emails and improved communication with potential leads.
Built Scrapy/Splash crawling system for automated data scraping from a JavaScript-based website
Big Data Engineer
Playing a key role in the data team for the development of a stock forecasting system using variety of tools such as Spark, Airflow, Hive, and Sqoop
Building a data migration system to migrate data from local into IPFS using Ethereum Blockchain, Solidity and MetaMask
Setting different Power BI dashboards after transforming data in Databricks using Spark and loading it into Azure SQL