A Shaw

A Shaw

A. Shaw
United States of America
English

نبذة عني

### Profile Summary

With over 9 years of intensive experience in the tech industry, I have driven technological innovation within several startups, playing pivotal roles in conceptualizing and actualizing products from …

الخبرة

Principal Data Integration Engineer

Stealth AI Startup
Aug 2021 - حتى الآن · 4 سنوات 11 أشهر

Pioneered a real-time inventory tracking system using Apache Kafka for
event streaming, ensuring live updates on stock availability.
Developed predictive models in Python to forecast demand and optimize
reordering processes, reducing stock-outs by 20%.
Utilized NoSQL databases like MongoDB for managing vast product
catalogs, ensuring swift data retrievals and updates.
Leveraged Apache Spark for processing and analyzing supply chain data,
identifying bottlenecks and areas of improvement.
Designed an integrated data warehouse using Snowflake, consolidating
data from various supply chain touchpoints for holistic analytics.
Architected a waste tracking system using Java, categorizing and
monitoring waste in real-time to streamline recycling processes.
Integrated sensors and IoT data with Apache Flink for real-time processing,
enabling dynamic route optimization for waste collection trucks.
Deployed time-series databases like InfluxDB to track waste generation
patterns over time.
Automated infrastructure scaling on AWS using Terraform, ensuring robustness
during peak data inflows.
Introduced a data lakehouse architecture, enhancing the flexibility and
scalability of waste data storage and analysis

Principal Data Integration Engineer

Stealth Al Startup (Stich Vision), New Jersey City
Aug 2021 - حتى الآن · 4 سنوات 11 أشهر

Pioneered a real-time inventory tracking system using Apache Kafka for event streaming, ensuring live updates on stock availability.
Developed predictive models in Python to forecast demand and optimize reordering processes, reducing stock-outs by 20%.
Utilized NOSQL databases like MongoDB for managing vast product catalogs, ensuring swift data retrievals and updates.
Leveraged Apache Spark for processing and analyzing supply chain data, identifying bottlenecks and areas of improvement.
Designed an integrated data warehouse using Snowflake, consolidating data from various supply chain touchpoints for holistic analytics.
Architected a waste tracking system using Java, categorizing and monitoring waste in real-time to streamline recycling processes.
Integrated sensors and loT data with Apache Flink for real-time processing, enabling dynamic route optimization for waste collection trucks.
Deployed time-series databases like InfluxDB to track waste generation patterns over time.
Automated infrastructure scaling on AWS using Terraform, ensuring robustness during peak data inflows.
Introduced a data lakehouse architecture, enhancing the flexibility and scalability of waste data storage and analysis.

Data Engineering Team Lead

Horizon Technologies (Addo Al), California
Jan 2018 - Jan 2021 · 3 سنوات

Conceptualized and developed a user health data platform, capturing fitness metrics using Apache Kafka streams.
Implemented data lakes on Google Cloud Platform, storing diverse user data like heart rates, step counts, and diet logs.
Leveraged Python scripts for ETL processes, cleaning and transforming wearable device data for analysis.
Employed Apache Spark's machine learning libraries to create personalized workout and diet plans.
Designed a responsive querying system using advanced SQL techniques, providing instant insights into user fitness trends.
Optimized CRM databases, primarily using PostgreSQL, ensuring swift data retrieval and efficient storage.
Integrated real-time customer interaction data using Apache Kafka, enhancing the responsiveness of sales and support teams.
Employed Star and Snowflake Schemas to structure customer data, facilitating faster report generation.
Streamlined customer segmentation using clustering techniques in Apache Spark, enabling targeted marketing campaigns.
Automated data integration pipelines using Apache NiFi, ensuring timely synchronization of CRM data across platforms.

Data Engineer

Mercurial Minds
Jan 2015 - Jan 2018 · 3 سنوات

Developed a comprehensive document management system, with real-time indexing and retrieval capabilities powered by Apache Kafka and Apache Flink.
Utilized columnar storage systems like Parquet for efficient storage and retrieval of large documents.
Automated document versioning and backup processes on AWS using CloudFormation templates.
Designed a robust search engine using Python, enabling users to quickly find documents based on content, metadata, and tags
Integrated OCR capabilities, transforming scanned documents into searchable and editable formats.
Led the development of a collaborative platform, allowing real-time data sharing and interaction using WebSockets and Apache Kafka.
Facilitated seamless integration of third-party tools using Python scripting for ETL tasks.
Leveraged AWS services like Lambda and EC2 for on-demand scalability during peak collaboration hours.
Engineered a data backup system on Azure Blob Storage, ensuring data integrity and availability.
Introduced real-time analytics on collaboration patterns using Apache Spark, providing insights to teams on productivity metrics.

المهارات

تحليلات البيانات SQL Python Java Scala Apache Kafka Apache Spark Apache Flink Hadoop PostgreSQL MySQL MongoDB Parquet InfluxDB Amazon Redshift Snowflake Apache NiFi Star Schema Snowflake Schema Normalization Denormalization AWS Google Cloud Platform Azure Terraform CloudFormation Pulumi Cassandra DynamoDB ORC TimescaleDB Google BigQuery Azure Synapse S3 EC2 EMR Glue Lambda Dataflow Pub/Sub Azure Data Factory Azure Blob Storage HDInsight Talend Informatica Microsoft SSIS MapReduce Hive HBase WebSockets OCR
الإبلاغ عن هذا الملف الشخصي؟