Priyanka Varahagiri

Priyanka Varahagiri

Data & AI Engineer
USA
Full-time Hybrid

About Me

Software engineer with 7+ years building data pipelines, integrations, and backend services in regulated industries. I build Python and SQL ETL jobs, SFTP and API ingestion feeds, and Kafka streaming pipelines on AWS, wi…

Experience

Software Engineer, Personalized Engagement Platform (TECHE) & API Platform (VSISV)

Wells Fargo · Dallas, TX
Apr 2026 - Present · 7 months

<p>Work on data-ingestion and external-data-batch services that combine account, payment, escrow, and customer data with business rules</p><p> Designed MongoDB schemas and indexes for read-heavy queries</p><p> Migrated 7 service proxies from IBM DataPower to Apigee with SOAP audit logging</p><p> Led Business Continuity Planning for the Sept 2026 DR exercise</p>

Software Engineer, Mortgage Payment & Fulfillment (STRADA)

Wells Fargo · Dallas, TX
Oct 2024 - Mar 2026 · 1 year 4 months

<p>Migrated MongoDB databases with 50M+ documents to next-gen data centers with zero data loss</p><p> Validated the data before cutover</p><p> Built SOAP/REST integrations that pull servicing data from Black Knight MSP and ICE Mortgage Technology and map it into internal data models</p><p> Migrated fulfillment messaging from IBM MQ to Kafka</p><p> Fixed a partition and offset bug during cutover that caused duplicate processing</p><p> Supported production on-call with Splunk and AppDynamics</p><p> Built prod and non-prod dashboards</p><p> Ran root cause analysis on incidents</p>

Software Engineer, Data & Platform Engineering

AvalonBay Communities · Austin, TX
Sep 2023 - May 2024 · 7 months

<p>Built a near-real-time SFTP to S3 to Kafka pipeline with timestamp ordering and validation</p><p> Eliminated duplicate and out-of-order vendor records before they reached downstream systems</p><p> Built a scalable Kafka and Spark streaming stack to capture and analyze high-volume event data</p><p> Supported real-time issue monitoring and alerting</p><p> Built an alert system with Spark and Redis that flags issues in near real time for operations teams</p><p> Built nightly integrity checks and reconciliation pipelines in Python with Spark, Hive, and AWS Data Pipeline</p><p> Kept multiple data sources consistent and recover missing records</p><p> Built Airflow batch jobs in Python and SQL that transform vendor data and load it into Oracle</p><p> Tuned queries to cut run times</p><p> Managed AWS data infrastructure in Terraform (S3, Lambda, EMR, Step Functions, DynamoDB, SQS) with GitLab CI/CD and a production approval gate</p>

Software Engineer

Tata Consultancy Services · Austin, TX
May 2021 - Aug 2023 · 2 years 3 months

<p>Built a Java and Python service that loads, aggregates, and matches large volumes of data from external client feeds into a database and cache</p><p> Reduced manual reconciliation work</p><p> Wrote Python jobs to parse, validate, and load client files and API data into SQL Server and MySQL</p><p> Handled error handling for bad or incomplete records</p><p> Built Java/Spring Boot microservices routing high-volume requests from multiple enterprise clients over Kafka, JMS, and REST</p><p> Deployed and supported services on Azure (Data Factory, Functions, AKS) and on-prem</p><p> Provided production support and root cause analysis</p>

Software Engineer, B2B Platform (Java, Angular)

The Home Depot · Atlanta, GA
Jun 2016 - Jul 2018 · 2 years

<ul><li>Reconciliation Tool: built a Java and Python service that loads, aggregates, and matches large volumes of data from external client feeds into a database and cache, reducing manual reconciliation work. </li><li>Data Ingestion: wrote Python jobs to parse, validate, and load client files and API data into SQL Server and MySQL, with error handling for bad or incomplete records. </li><li>Built Java/Spring Boot microservices routing high-volume requests from multiple enterprise clients over Kafka, JMS, and REST. </li></ul><p></p>

Skills

Python pandas SQL Java TypeScript ETL/ELT pipelines Spark Hive Airflow Kafka AWS Data Pipeline Azure Data Factory SFTP API ingestion data validation reconciliation data modeling Snowflake dbt Oracle PostgreSQL SQL Server MySQL MongoDB DynamoDB Redis AWS S3 Lambda EMR Step Functions SQS SNS ECS Azure Terraform Docker Kubernetes Git GitLab CI/CD Jenkins LLM agents RAG MCP LangChain prompt engineering context engineering Claude Code GitHub Copilot Splunk
Report this Profile?