Data Platform Engineering Analyst with experience at Telstra since August 2020, working across data engineering, backend development, and generative AI. Experience includes building and migrating microservices, ingestion…
Data Platform Engineering Analyst with experience at Telstra since August 2020, working across data engineering, backend development, and generative AI. Experience includes building and migrating microservices, ingestion and transformation pipelines, and working with tools such as Apache Spark, Databricks, Azure Data Factory, Azure Functions, AWS services, Spring Boot, and Apigee.
الخبرة
S
Senior Data Engineer
spiro·Pune , Maharashtra , India
Mar 2026 - حتى الآن · 8 أشهر
<p>Enhanced transformation logic to include a new type of charge for invoice generation and bill reporting.</p><p> Worked on migration of a microservice from Azure VM to Azure Functions.</p><p> Built a microservice on Azure Functions to queue customer requests for 0-24 months usage details and prepared Python scripts to run on Databricks to process queued requests.</p><p> Exposed an endpoint through the internal Telstra gateway.</p><p> Built an ingestion process to onboard a new data source on the platform.</p><p> Wrote Python scripts for consuming data using API calls, preprocessing data, and storing it in Parquet format.</p><p> Worked on migrating an ingesting process of a data source from static VM-based to on-demand processing.</p><p> Modified Python scripts and processing configuration files.</p><p> Worked on AWS Batch, SQS, Redshift, and Athena.</p><p> Contributed to building a back-end application in Java Spring Boot to expose invoice data from datahub to a front-end application used by end users.</p><p> Built logic to extract data from Azure Cosmos, transform it according to business use case, trigger pipeline in Azure Data Factory, and create blobs in Azure Blob Storage from the Spring Boot app.</p><p> Wrote Swagger documentation.</p><p> Configured Apigee gateway.</p><p> Worked closely with the team to build ingestion and transformation pipelines for financial and pricing data from various Telstra applications.</p><p> Implemented business logic in SQL.</p><p> Performed orchestration of data in Azure Data Factory.</p><p> Contributed to reducing licensing cost by transforming Informatica dataflow pipeline to Spark jobs.</p><p> Built a data ingestion framework to ingest data into Salesforce Einstein Analytics.</p><p> Used external API for ingestion until the 50 GB limit was reached, then shifted to bulk API for ingestion.</p><p> Handled scheduling of concurrent processes.</p><p> Worked closely with the team to increase reliability and efficiency by adapting Azure Delta Lake storage layer.</p>
S
Senior Data Engineer
Spiro·Pune, India
حتى الآن
<p>Designed and implemented scalable data pipelines to support business intelligence initiatives.<br>
Led projects to build pipelines and frameworks for Data Reliability and Data Observability.<br>
Collaborated with cross-functional teams to integrate diverse data sources into centralized systems.<br>
Developed ETL processes to ensure high-quality data for analytical purposes.<br>
Mentored junior engineers, fostering skill development and knowledge sharing within the team.</p>
Data Engineer
Telstra·Pune, India
Aug 2020 - Feb 2026 · 5 سنوات 6 أشهر
<p>Developed data pipelines using Python and Spark, enhancing data processing efficiency and reducing latency for analytics.</p><p> Collaborated with cross-functional teams to design and implement scalable data architecture, improving data accessibility for stakeholders.</p><p> Led the migration of legacy systems to cloud-based solutions, resulting in increased data reliability and streamlined access for users.</p><p> Mentored junior data engineers, fostering skill development and enhancing team performance in data engineering projects.</p><p> Led the development of scalable RESTful APIs using Java and Spring Boot, enhancing system performance and reliability.</p><p> Implemented unit and integration testing frameworks, ensuring software quality and reducing bug rates in production environments.</p>
المهارات
جافابايثون (لغة برمجة)لغة الاستعلامات الهيكلية (SQL)جافا سكريبتالتطوير الذي يعتمد على الاختباراتData EngineeringFront & Back End DevelopmentGenerative AIApache SparkDatabricksAzure Data factoryAzure CosmosAzure FunctionsAWS RedshiftAWS SQSAWS BatchAWS LambdaSpring BootApigeeHTML/CSSFront End DevelopmentBack End DevelopmentAzure Data FactoryAzure VMAzure Blob StorageSwaggerInformaticaSalesforce Einstein AnalyticsAzure Delta LakeAthenaMicroservicesAPI DevelopmentData IngestionData TransformationParquetBulk APISchedulingConcurrent ProcessingJava Backend DevelopmentSparkAWSAzureAPI development
