Sujatha G

<p>At Sun Tech, I worked as an Analytical Engineer, where I was responsible for developing and supporting end-to-end Azure data solutions. I collaborated with business users and stakeholders to understand requirements and built scalable ETL/ELT pipelines using Azure Data Factory and Databricks for high-volume transactional and analytical data. I used Python, PySpark and Spark DataFrames for large-scale transformations and performance optimisation, while working with ADLS, Delta Lake and Azure Synapse. </p><p>I also integrated data through REST APIs, including pagination, retry mechanisms and error handling. I implemented data governance using Azure Purview and Unity Catalog, covering lineage, access controls and auditing. In addition, I developed Power BI dashboards, implemented CI/CD using Azure DevOps, ARM templates and Databricks Asset Bundles, and monitored production pipelines to troubleshoot issues and maintain reliable data delivery.</p><p>Overall, my responsibilities covered the full data-engineering lifecycle, including requirements gathering, pipeline development, data transformation, Delta Lake architecture, API integration, governance, reporting, deployment, monitoring and production support.</p>

<p>At Goldman Sachs, through Kapital Info Tech, I worked as a Data Engineer, where I was responsible for designing and developing scalable ETL/ELT pipelines using Azure Data Factory, Databricks and Airflow. I worked closely with business stakeholders and cross-functional teams to understand requirements and translate them into reliable data solutions. I developed reusable ingestion workflows to bring data from S3, CRM and on-premise systems into ADLS and Redshift, and used PySpark and Spark SQL to transform large datasets and optimise processing performance. I also designed and implemented Delta Lake architectures, working with schema evolution, time travel and ACID transactions to provide reliable storage, version tracking and efficient data retrieval. I developed Power BI dashboards by integrating data from Azure SQL Database, Cosmos DB and Delta Lake, enabling business teams to monitor KPIs and make data-driven decisions. In addition, I implemented CI/CD pipelines using Azure DevOps and Git, automated deployments and supported consistent environment management. I worked with Unity Catalog for access permissions, auditing and data lineage, and handled REST/API integrations with error handling, retry logic and monitoring to ensure reliable ingestion. I was also responsible for production support, troubleshooting pipeline failures, optimizing SQL queries and transformation logic, and maintaining technical documentation for workflows and pipeline processes. Overall, my Goldman Sachs experience strengthened my skills in ADF, Databricks, PySpark, Spark SQL, Delta Lake, ADLS, Airflow, API integration, data governance, CI/CD, performance optimisation and production support, while giving me experience delivering reliable enterprise-scale data solutions.</p>

<p>At Microsoft, through Kapital Info Tech, I worked as a Data Engineer, where I was responsible for designing and developing ETL workflows using SSIS, Azure Data Factory and Databricks. I worked with stakeholders to understand business requirements and built data pipelines to ingest information from SAP BW, SAP BO and relational databases into ADLS and Delta Lake. I used Python, PySpark and SQL for data transformation, cleansing and processing, and worked with SSAS and OLAP to support enterprise data warehousing and analytics. I also worked on schema evolution, partitioning and data-retention strategies, developed Power BI reports and dashboards, and used Git and Azure DevOps for CI/CD and deployment processes. My responsibilities included SQL and index optimisation, automated data-quality validation and reconciliation using Python, and production support. I monitored ETL processes, investigated pipeline failures and implemented preventive measures to improve the reliability and performance of the data platform.</p><p>Overall, my Microsoft experience strengthened my expertise in Azure Data Factory, Databricks, ADLS, Delta Lake, Python, PySpark, SQL, SSIS, SSAS, Power BI, SAP integration, CI/CD, data quality and production support.</p>

<p>At eBay, through Kapital Info Tech, I worked as a Data Analyst, where I collaborated with business users and analysts to understand reporting requirements and developed ETL and reporting solutions using SSIS, SSRS and Power BI. I built ETL processes to load data into SQL Server, performing data validation and cleansing to maintain accuracy and consistency.</p><p>I developed interactive Power BI and Tableau dashboards, created SSAS OLAP cubes to support analytical reporting, and used Alteryx and SQL for data transformation and preparation. I also worked with SAP data integration, optimised SQL queries and indexes for improved performance, and automated report scheduling, monitoring and delivery. I used Jira for task tracking and collaboration with project teams. Overall, this role gave me strong experience in SQL, SSIS, SSRS, Power BI, Tableau, SSAS, Alteryx, ETL development, data quality, performance optimisation and business reporting.</p>