About Me
This Is abarna. I am having 2 Years of experience in this sector. My skillset includes Python, Pyspark, Sql, AWS Cloud Services As a cloud platform, And I am Having handson in snowflake as data warehouse, And terraform a…
This Is abarna. I am having 2 Years of experience in this sector. My skillset includes Python, Pyspark, Sql, AWS Cloud Services As a cloud platform, And I am Having handson in snowflake as data warehouse, And terraform also to deploy the code to the test environment .
Experience
AWS Data Engineer
Built and automated large-scale ETL pipelines using PySpark, AWS Glue, and S3 for healthcare claim data.
Performed data cleaning, schema standardization, and data validation using PySpark transformations.
Optimized storage with Parquet (Snappy compression) and reduced small file overhead using coalesce().
Implemented incremental data loading and deduplication in Snowflake via MERGE operations.
Automated workflow orchestration and monitoring using Airflow, CloudWatch, and SNS alerts.
Improved overall data accuracy, reliability, and performance for analytics and compliance reporting.
AWS Data Engineer
Analysed employee behaviour patterns, Designed and implemented ad-hoc PySpark pipelines, Applied text processing and data normalization, Built aggregated metrics for attendance, workload distribution, and team performance, Loaded processed data into Snowflake, Delivered insights that helped HR improve workforce efficiency and engagement
AWS Data Engineer
Designed and implemented ad-hoc PySpark pipelines for data cleaning, transformation, and enrichment.
Applied text processing and data normalization on HR logs and activity data.
Built aggregated metrics for attendance, workload distribution, and team performance.
Loaded processed data into Snowflake for dashboarding and reporting.
Delivered insights that helped HR improve workforce efficiency and engagement.