Pravallika Thota

Pravallika Thota

Data Engineer
India
Telugu, English, Hindi
Full-time Hybrid

About Me

Data Engineer with 3+ years of experience building scalable data pipelines and cloud cost optimization solutions on Databricks, PySpark, Python, SQL and AWS. Delivered approximately $2M in infrastructure cost savings and…

Experience

Data Engineering, Management & Governance Associate

Accenture · Hyderabad, India
Oct 2023 - Present · 3 years

<p>Delivered approximately $2M in infrastructure cost savings by analyzing cluster utilization, SQL Warehouse usage and workload patterns across Databricks and AWS, and recommending right-sized clusters and warehouses.</p><p> Built a query-level cost allocation dashboard using Databricks and ThoughtSpot, enabling warehouse cost visibility through query tagging and user-level attribution.</p><p> Developed an automated DynamoDB to Delta Lake ingestion pipeline using AWS Lambda to process 10 GB+ of daily operational data via incremental timestamp-based processing, reducing execution times by 95% while maintaining strict data deduplication.</p><p> Evaluated Databricks runtime versions and Serverless vs. All-Purpose compute workloads, recommending optimal compute selection and performance improvements for cost efficiency.</p>

PROJECTS

Databricks Cost Optimization

Accenture
Duration : 18-Oct-2024 - 26-Oct-2026

<p>Delivered approximately $2M in infrastructure cost savings by analyzing cluster utilization, SQL Warehouse usage and workload patterns across Databricks and AWS, and recommending right-sized clusters and warehouses. • Built a query-level cost allocation dashboard using Databricks and ThoughtSpot, enabling warehouse cost visibility through query tagging and user-level attribution. • Developed an automated DynamoDB to Delta Lake ingestion pipeline using AWS Lambda to process 10 GB+ of daily operational data via incremental timestamp-based processing, reducing execution times by 95% while maintaining strict data deduplication. • Evaluated Databricks runtime versions and Serverless vs. All-Purpose compute workloads, recommending optimal compute selection and performance improvements for cost efficiency.</p>

Certifications

Databricks Certified Data Engineer Associate

Databricks Academy · Hyderabad , Telangana , India · 2026

Skills

Python SQL Databricks PySpark Delta Lake ETL Data Modeling Databricks Workflows Databricks Vector Search Retrieval-Augmented Generation (RAG) AI/BI Genie Databricks Foundation Models AWS S3 Lambda DynamoDB ThoughtSpot Databricks AI/BI Dashboards Streamlit REST APIs Git Pandas MySQL
Report this Profile?