Pranavi S

Built ETL pipelines using Pandas and PySpark to ingest XML/CSV/Parquet data from APIs and Data Lake/Storage (AWS S3), perform data cleansing and transformations, and publish curated datasets for daily health-check dashboards.
Automated 15+ Python scripts for batch file processing (XML → JSON, CSV ingestion, audit logs) using Airflow and PowerShell.
Optimized production pipelines processing 10GB+ data volumes, improving performance by ~60% through partitioning, skew handling, and efficient Spark transformations.
Developed real-time data processing using Snowpipe, stages and Tasks in Snowflake data warehouse.
Contributed to Bronze and Silver layers of batch processing, ensuring data quality, validation, and data governance standards.

Built ETL pipelines using Pandas and PySpark to ingest XML/CSV/Parquet data from APIs and Data Lake/Storage (AWS S3), perform data cleansing and transformations, and publish curated datasets for daily health-check dashboards., Automated 15+ Python scripts for batch file processing (XML → JSON, CSV ingestion, audit logs) using Airflow and PowerShell., Optimized production pipelines processing 10GB+ data volumes, improving performance by ~60% through partitioning, skew handling, and efficient Spark Transformations., Developed real-time data processing using Snowpipe, stages and Tasks in Data Warehouse (Snowflake)., Contributed to Bronze and Silver layers of batch processing ensured data quality, validation, and data governance standards.

Built 50+ SQL and PL/SQL ETL scripts (procedures, functions, triggers and views) to support large scale retail applications handling datasets up to 150M+ records.
Developed Linux scripts and SQL Loader to orchestrate batch workflows using TWS (Tivoli Work Schedule) automating daily, hourly and weekly batches.
Automated scheduling of 10+ report generation scripts in crontab, reducing manual intervention and ensuring timely delivery.
Collaborated with DBA and cross technical team to improve performance by ~40% and reliability for batches.
Provided on-call production support for batch monitoring, troubleshooting failed and long-running jobs (including weekends), and ensuring timely recovery to maintain SLA compliance.
Designed and maintained monitoring reports and alert mechanisms to notify support teams of batch failures and SLA breaches, enabling proactive issue resolution.

Built 50+ SQL and PL/SQL (Procedures, functions, triggers and Views) ETL scripts to support large scale retail applications handling datasets up to 150M+ records., Developed Linux scripts and SQL Loader to orchestrate batch workflows using TWS (Tivoli Work Schedule) automating daily, hourly & weekly batches., Automated scheduling of 10+ report generation scripts in crontab, reducing manual intervention and ensuring timely delivery., Collaborated with DBA and cross technical team to improve performance by ~40% and reliability for batches., Provided on-call production support for batch monitoring, troubleshooting failed and long-running jobs (including weekends), and ensuring timely recovery to maintain SLA compliance., Designed and maintained monitoring reports and alert mechanisms to notify support teams of batch failures and SLA breaches, enabling proactive issue resolution.