Anwar A

Anwar A

Senior Data Engineer | Big Data Specialist | Transforming Raw Data Into Actionable Insights
United Kingdom

About Me

With over 10 years in the tech industry, I am a seasoned Senior Data Engineer and Big Data Engineer committed to transforming raw data into actionable insights. Throughout my career, I've been a driving force for innovat…

Experience

Senior Data Infrastructure Specialist

Mountainise
Feb 2022 - Present · 4 years 5 months

Spearheaded a real-time inventory tracking system using Apache Kafka for dynamic stock updates
Developed predictive models in Python, resulting in a reduction in stock-outs
Utilized MongoDB for efficient management of extensive product catalogs
Leveraged Apache Spark for in-depth supply chain data analysis
Designed and implemented an integrated data warehouse using Snowflake
Architected a waste tracking system in Java, enabling real-time monitoring
Integrated sensors and IoT data with Apache Flink, optimizing waste collection routes
Deployed InfluxDB to track waste generation patterns over time
Automated AWS infrastructure scaling using Terraform for enhanced robustness
Introduced a data lakehouse architecture, improving the flexibility of waste data storage

Senior Data Infrastructure Specialist

Mountainise
Jan 2022 - Present · 4 years 6 months

Spearheaded a real-time inventory tracking
system using Apache Kafka for dynamic stock
updates
Developed predictive models in Python,
resulting in a reduction in stock-outs
Utilized MongoDB for efficient management of
extensive product catalogs
Leveraged Apache Spark for in-depth supply
chain data analysis
Designed and implemented an integrated

Data Integration Engineer

Rolustech
Feb 2018 - Jan 2022 · 3 years 11 months

Conceptualized and developed a user health data platform with Apache Kafka streams
Implemented data lakes on Google Cloud Platform for diverse user data
Leveraged Python scripts for ETL processes and Apache Spark's ML libraries
Designed a responsive querying system using advanced SQL techniques
Optimized CRM databases, primarily using PostgreSQL
Integrated real-time customer interaction data using Apache Kafka
Employed Star and Snowflake Schemas for efficient structuring of customer data
Streamlined customer segmentation using clustering techniques in Apache Spark
Automated data integration pipelines using Apache NiFi for timely synchronization

Data Engineer

Xavor
Jan 2015 - Jan 2018 · 3 years

Developed a document management system with real-time indexing powered by Apache Kafka and Apache Flink
Utilized Parquet for efficient storage and retrieval of large documents
Automated document versioning and backup processes on AWS using CloudFormation
Designed a robust search engine in Python
Integrated OCR capabilities for transforming scanned documents
Led the development of a collaborative platform using WebSockets and Apache Kafka
Facilitated seamless integration of third-party tools using Python scripting for ETL tasks
Engineered a data backup system on Azure Blob Storage
Introduced real-time analytics on collaboration patterns using Apache Spark
Utilized AWS services like Lambda and EC2 for on-demand scalability during peak hours

Skills

Linux OS Data Engineering Advanced SQL Python ETL Java Scala Apache Kafka Apache Spark Data Processing Data Analysis Apache Flink Hadoop PostgreSQL MySQL Oracle MongoDB Cassandra DynamoDB Parquet ORC InfluxDB TimescaleDB Amazon Redshift Snowflake Apache NiFi Talend Informatica Microsoft SSIS Data Modeling Star Schema Snowflake Schema Normalization Denormalization AWS Google Cloud Azure Terraform CloudFormation Pulumi
Report this Profile?