soujanya muppana

soujanya muppana

Data Engineer
United States of America

نبذة عني

10+ years of experience working in BI Development and Application Maintenance using Microsoft Technologies. Experience in Azure SQL server, Azure Data Factory and Azure Data Lake, Azure Data Bricks. Extensive experience …

الخبرة

Data Engineer

CDW, Chicago USA
May 2021 - حتى الآن · 5 سنوات 2 أشهر

Analyzed requirements and created complex Dataflows to load data.
Gathered business requirements and prepared technical design documents, target to source mapping document, and mapping specification document.
Worked on parameters and transformations like Look up, Aggregate, Join, Window, Filter, Alter Row, Derived Column with complex expressions.
Loaded incremental data into Azure SQL Server.
Created pipelines in ADF using Linked Services, Datasets, Dataflows, and Pipeline from source to Data lake and Data lake to Azure SQL Server.
Created and debugged the stored procedure.
Created Logic Apps.
Scheduled and monitored the ADF pipelines in production.
Fixed production issues for pipeline failures.
Performed performance tuning of stored procedures in Azure SQL Server.
Worked on POCs based on client requirements.
Implemented ETL pipelines using Azure Data Factory.
Developed stored procedures, functions, and views using SQL and PL/SQL.
Performed end-to-end processes to extract, ingest, and consume large volumes of data from multiple sources.
Worked with data ingestion and manipulation of JSON, Apache Parquet, CSV, and other formats using ETL tools to connect data warehouse.
Applied version control practices and exposure to CI/CD tools and principles.
Worked with REST APIs and building REST-based applications.
Collaborated with Business Analysts, other developers, and business users through the project life cycle to gather and understand requirements.
Participated in business calls with product owners for better understanding of requirements.
Analyzed and evaluated data sources, data volume, and business rules.
Built and maintained SQL scripts, indexes, and complex queries for data analysis and extraction.
Performed basic and unit testing.
Assisted in UAT testing and provided necessary reports to business users.

Data Engineer

S4 consultants Inc
May 2021 - حتى الآن · 5 سنوات 2 أشهر

• Understanding the functional requirements of the customers.
• Analysis of the Azure services and deciding on the suitable services required for project by doing R&D and performing POCs.
• Developer for handling the Azure project by creating dataflows and pipelines using ADF.
• Expert in creating data pipelines(jobs) using Azure Data factory
• Implemented best practices and performance tuning to improve ETL process and easy code readability
• Developed Mappings using Transformations like Expression, Filter, Joins and Lookups for better data mappings.
• Working on creating Logic Apps.
• Working on creating Notebooks using Azure Databricks.
• Created jobs to load historical data and incremental data.
• Extensive experience in scheduled and maintain the ADF data pipeline using Azure Data Factory triggers
• Team Lead/Developer for handling the MSBI project.
• Attending the walkthroughs for the project/change requirements.
• Developing and implementing the SSIS Packages for the different stages of ETL and Reporting.
• Created ETL Packages using SSIS from Excel, SQL Server source to SQL Server Destination.
• Writing and validating Unit Test Cases.
• Working on the Enhancements of the application.
• Writing Stored Procedures, functions as per the requirement.
• Production support, fixing bugs, issues.
• Creating various reports for projects like Weekly status report, Monthly status report, Job issue tracker, defect tracker and CR Tracker.
• Involved in Effort estimation of the requirements.

Data Engineer

TARDIS WAREHOUSE, Torus, UK
Jun 2017 - Apr 2021 · 3 سنوات 10 أشهر

Worked as an ETL Developer and Reporting Developer and collected all required specifications of input data.
Used control flow tasks like For Loop Container, For Each Loop Container, Sequential Container, Execute SQL Task, and Data Flow Task.
Worked in data extraction, data transformation, and loading the data, and developed packages.
Created SSIS packages using transformations like Derived Column, Look up, Conditional Split, Merge Join, and Multicast while loading data into DWH.
Worked frequently with Dataflow Task and ExecuteSqlTask.
Created configurations and deployed packages to target server.
Created SQL Server Agent jobs with SSIS packages to run daily ETLs at scheduled times.
Implemented transformations in dataflow to clean data.
Created reports from DWH using SSRS.
Created Tabular, Matrix, and Chart reports in SSRS as per end user requirement.
Created report subscriptions to send reports by email by scheduling the reports.
Provided report-level securities for end users.
Involved in processing the data of cubes.

Software Engineer

PBM Project, Trademark
Mar 2014 - Apr 2017 · 3 سنوات 1 شهر

Involved in creating database objects like Tables, Stored Procedures, Views, Triggers, and user defined functions for this project.
Gathered requirements from the end user and developed logical model and implemented requirements in SQL Server.
Created workflows with Data flow, Execute SQL task, Execute package tasks, and Containers.
Created package configuration to handle data source connection information.
Implemented logging for each package.
Generated reports according to client requirement after loading the data.
Created reports using Reporting Services 2008R2.
Identified database tables for defining queries for reports.
Identified and defined datasets for report generation.
Wrote queries for drill down reports to get the dataset required to build the report.
Deployed generated reports onto the Report Server to access through browser.

المهارات

البيانات الضخمة مستودع البيانات هادوب (Hadoop) سكالا سبارك أباتشي هايف أباتشي بيغ خدمات أمازون ويب (AWS) كافكا نوسكيو إل ردشفت (خدمة قاعدة بيانات) إس 3 (خدمة تخزين البيانات على الإنترنت) Microsoft Technologies Azure SQL Server Azure Data Factory Azure Data Lake Azure Databricks ETL Data Migration Cloud Migration Logic Apps PySpark Python Microsoft SQL Server ADF Pipelines SSIS Stored Procedures Functions Triggers Indexes Views CTE GitHub Technical Writing Presentations Communication Analytical Skills Problem-solving Interpersonal Skills Self-motivation Initiative Design Documentation Project Cutover Sanity Checks Project Scope Deliverables Timeline Project Execution Plan SQL Server PL/SQL SSAS SSRS Power BI Synapse REST APIs CI/CD SQL Data Warehousing Dataflows Linked Services Datasets Pipelines Parameters
الإبلاغ عن هذا الملف الشخصي؟