نبذة عني
4+ YoE in devising technical solutions for business requirements by building ETL pipelines, optimizing databases, and streamlining devops processes with proficiency in data engineering, cloud platforms and CI/CD processe…
4+ YoE in devising technical solutions for business requirements by building ETL pipelines, optimizing databases, and streamlining devops processes with proficiency in data engineering, cloud platforms and CI/CD processes
الخبرة
Data Analyst
High school students’ performance analysis in STEM domain
• Wrote R scripts to perform data quality checks, data cleaning, and aggregation on students’ survey and feedback data, reducing 10-day effort per excel sheet
• Performed correlation analysis, resulting in a coefficient of 0.77 between student interest and engagement and effort
Data Analyst
High school students’ performance analysis in STEM domain
Wrote R scripts to perform data quality checks, data cleaning, and aggregation on students’ survey and feedback data, reducing 10-day effort per excel sheet
Performed correlation analysis, resulting in a coefficient of 0.77 between student interest and engagement and effort
Senior Data Engineer
Order management system migration to in-house application on Google Cloud Platform (GCP)
Designed data pipelines to extract real time trade events using Kafka, performed data transformation on GCP VMs via JAVA processes, and loaded into BigQuery database, saving $18,000 license cost per year
Set-up cloud infrastructure by creating service accounts, users, roles, and policies through IAM and wrote bash scripts to create virtual machines for running consumers and storage buckets for caching, optimizing memory management by 60%
Migrated from RDBMS to NoSQL denormalized schema, created partitions and indexes, reducing query latency by 54%
Employee performance monitoring and visualization dashboard
Led a team to create data architecture of an application that ingests data via REST API for GitHub commits, ServiceNow incidents, JIRA releases, formats data frame in python application layer, and loads data in PostgreSQL
Visualized data using Tableau to monitor KPI and increased average employee performance by 23%
CI/CD infrastructure setup and optimization
Created automatic deployment infrastructure via Jenkins on premise and cloud platforms performing build, test, and deployment of artifacts on development, test, and production environments, increasing code release frequency by 400%
Integrated test suites, vulnerability scans, and post-deployment steps to increase production data security and reduce manual intervention to 0.01%