Malik Ayyan

Malik Ayyan

Senior Data Engineer
United States of America
English

نبذة عني

I am an accomplished Data Engineer with more
than 12 years of experience driving technological
innovation across healthcare,
telecommunications, and logistics sectors. I am
an expert in Python, SQL, Java, and Scala, with…

الخبرة

SENIOR DATA WAREHOUSE ENGINEER

PATREON
Nov 2019 - حتى الآن · 6 سنوات 7 أشهر

Implemented CI/CD pipelines, utilized insights to optimize patient data integration, deploying ML models, managed code and model versions with Git, used Docker and Kubernetes for scalable integration solutions, enabled real-time patient data access without replication, created a unified data fabric for seamless access, developed new features based on data insights, implemented AWS Lambda

Senior data warehouse engineer

Patreon, San Francisco, CA
حتى الآن

Spearheaded the redesign of data warehousing solutions, improving data extraction times by 30% and accelerating analysis speed by 20%.
Managed a team of 10 data engineers, enhancing productivity by 40% through focused training and skill development.
Established real-time data processing frameworks with Apache Kafka and Spark, halving data latency.
Engineered ETL pipelines using Python and SQL to ensure seamless data integration and maintain high data quality.
Leveraged Amazon Redshift and Snowflake for scalable data warehousing, facilitating advanced analytics and reporting.
Utilized cloud platforms (AWS, Google Cloud, Azure) to deploy robust solutions, guaranteeing high availability.
Streamlined infrastructure management with Terraform and CloudFormation, reducing operational overhead and improving deployment processes.

CLOUD DATA ENGINEER

TWITCH
Oct 2015 - Dec 2019 · 4 سنوات 1 شهر

Integrated ML models into data pipelines for customer data, utilized SQL for querying and managing customer data, developed integration algorithms in Python, created dashboards using Tableau for data insights, cleaned and prepared telecommunications data, extracted relevant features to improve model accuracy, ensured compliance with telecommunications regulations

DATA ENGINEERING TRAINEE

CYBERNAS
Nov 2011 - Nov 2015 · 3 سنوات 11 أشهر

Led a team to develop inventory forecasting models, managed timelines, resources, and stakeholder communication, developed strategic plans for forecasting implementation, used Agile for iterative development, fostered a culture of innovation for forecasting techniques, regularly communicated progress to stakeholders

Data engineering trainee

Cybernas, Dubai, UAE

Created and implemented data solutions tailored for cybersecurity applications, serving diverse corporate and government clients.
Optimized ETL processes to manage and integrate large volumes of security data, ensuring high data integrity and availability.
Employed big data technologies like Hadoop and Spark for processing and analyzing security data in real-time.
Collaborated with senior engineers to enhance data pipelines and improve system performance.

Cloud data engineer

Twitch, San Francisco, CA

Crafted and maintained scalable data architectures to meet Twitch’s live streaming and user data requirements.
Constructed real-time data processing systems using Apache Kafka and Flink, reducing data latency by 50%.
Assembled and managed ETL pipelines with Python and SQL, ensuring high data quality and seamless integration.
Deployed data solutions on AWS, achieving high availability and scalability.
Enhanced deployment efficiency by automating infrastructure processes with Docker and Kubernetes.
Partnered with data scientists and engineers to support data-driven decision-making and analytics.

المهارات

إدارة نظم المعلومات تخزين البيانات حوكمة البيانات دمج البيانات نموذج البيانات هادوب (Hadoop) سبارك الأنظمة الموزعة Python SQL Java Scala Apache Kafka Flink RDBMS (PostgreSQL MySQL) NoSQL databases (MongoDB) Amazon Redshift Snowflake AWS Google Cloud Azure Terraform CloudFormation PostgreSQL MySQL MongoDB AWS Lambda S3 EC2 EMR Glue Azure Data Factory Blob Storage HDInsight Google BigQuery Azure Synapse Oracle Cassandra DynamoDB Docker Kubernetes ETL Data Visualization Data Quality MLOps Machine Learning Business Intelligence Data Security Compliance Leadership Cross-functional Collaboration
الإبلاغ عن هذا الملف الشخصي؟