Monish Varghese Joshy

Data Engineer (Remote)
- Designed and developed scalable ETL pipelines for Azure Data Warehouse.
- Automated ETL processes using ADF Pipelines and SSIS, reducing processing time by 30%.
- Developed and integrated Python functions in Synapse pipelines for advanced data transformations.
- Leveraged Pyspark and Spark SQL for efficient data processing and marketing campaign analysis.
- Supported financial and healthcare clients by delivering high-quality data solutions.

<p>Designed and developed ETL pipelines to load data from different sources including Azure Data Warehouse.<br>
Automated ETL applications like Azure Pipelines and SSIS.<br>
Developed Python functions to be used on Synapse pipelines.<br>
Developed PySpark notebooks to execute marketing campaigns of different healthcare clients.<br>
Utilized Spark SQL API within PySpark to extract, transform and load data and perform SQL queries.<br>
Performed ETL from different source systems to Azure storage services using Azure Pipelines, T-SQL and Spark SQL.<br>
Supported different financial and healthcare clients for marketing their products.<br>
Leveraged PySpark and Spark SQL for efficient data processing and marketing campaign analysis.<br>
Supported financial and healthcare clients by delivering high-quality data solutions.</p>

<p>Worked on ETL of state of Texas student and staff information from ODS into PDM (Data Mart).<br>
Wrote complex procedures to validate the data.<br>
Created Jasper reports.<br>
Developed SSIS packages.<br>
Wrote hundreds of complex procedures in PL/SQL.<br>
Wrote procedures to validate business rules and generate reports when the data did not conform to validation rules.<br>
Developed Azure pipelines for ETL of student financial data information from various EA systems.<br>
Developed PySpark code in Databricks.</p>

<p>Developed ETL packages using SSIS to load data from multiple sources into PDW Server.<br>
Developed Power BI dashboards from data warehouse.<br>
Designed Power BI reports utilizing cross tabs, scatter plots, pie bar, map charts and density charts.<br>
Used DAX queries for computed columns in Power BI.<br>
Created financial Power BI dashboard for stakeholders and product owners for business decision making.<br>
Developed Python functions for transforming data to be used within Azure Data Factory.<br>
Designed and developed Azure Data Factory pipelines to load data from sources including Blobs, SharePoint List, Azure Data Warehouse, Oracle, DB2, SAP and Hadoop.<br>
Designed and developed Power BI reports.<br>
Automated ETL applications like ADF pipelines and SSIS.<br>
Developed PySpark code in Databricks.</p>

<p>Loaded source data from Oracle into SQL tables to load into Microsoft AX.<br>
Fetched source data from Oracle and performed data cleansing and transformation before loading into final destination tables.<br>
Created SSIS packages for each entity including Customer Bank Account, Vendor Bank Account, Subscription billing and Sales Partner.<br>
Developed T-SQL stored procedures, triggers, views and table changes for data load, transformation and extraction.<br>
Designed physical and logical data models for vendor and sales domain.<br>
Cleansed master data using DQS cleansing component, fuzzy lookup and lookup transformations in SSIS packages.<br>
Designed Azure Database and created SSIS package to load into Azure.<br>
Created Power BI dashboards utilizing scatter plots and pie bar charts.<br>
Used Power BI and Power Pivot to develop data analysis prototype and Power View to visualize reports.</p>

<p>Extracted data from claims in Oracle, converted into Acord XML and performed incremental load into IEV XTM database.<br>
Ensured data moved from XTM database into TDS and from TDS into ODS.<br>
Developed up-selling and cross-selling Power BI reports using DAX functions.<br>
Created row-level security with Power BI and integration with Power BI Service portal.<br>
Developed T-SQL stored procedures, triggers, views and table changes for data load, transformation and extraction.<br>
Used Execution Plan, SQL Profiler and Database Engine Tuning Advisor to optimize queries and enhance database performance.<br>
Used complex query statements including sub queries, correlated queries, derived tables and CASE functions to insert data depending on criteria.<br>
Wrote T-SQL queries and created dynamic stored procedures using input values.<br>
Loaded Acord XML from Oracle CA into IEV XTM using Script Task (C#.NET).<br>
Extracted data from AS400 and loaded into Sapiens using SSIS package.<br>
Extracted data from claims and loaded into Sapiens using SSIS package.<br>
Created SSIS package to process claims and policy information into Sapiens database.<br>
Created SSIS package to find exceptions after loading claims and wins file into SSIS and email the file to different team members of the Sapiens team.<br>
Worked extensively on data analysis to solve bugs created by business analysts when they saw the data was wrong.<br>
Extracted policy data and claims data from flat files, Excel/CSV files and relational databases like Oracle and SQL Server and loaded into different destinations for analysis.<br>
Worked with data scientists and learned data science hands on from senior data scientists of the company.</p>

<p>Designed and developed CDW database for data migration from HCN Oracle database belonging to Coram since CVS merged with Coram.<br>
Managed indexing, debugging, optimization and performance tuning using SQL Profiler and SQL Server Agent.<br>
Created master package, receipt package, validation packages, loading packages, archival package and acknowledgment package using Visual Studio Data Tool Environment.</p>

<p>Worked in production support.<br>
Created complex stored procedures, views, functions, triggers and tables.<br>
Performed reverse engineering using ER Studio.<br>
Created stored procedures to load raw data into xraw tables, filter bad data using temporary tables and load good records into raw tables, Allocation and Block trade tables.<br>
Created documentation for tables, stored procedures, views and user-defined functions.<br>
Debugged errors occurring while loading data from OMS to CTR in SQL Server.<br>
Loaded trades obtained from State Street in CTR within the UNIX environment.<br>
Tested data obtained in CTR for accuracy.<br>
Debugged and tested stored procedures, functions, views and triggers during production support.</p>

<p>Planned, defined and designed data based on business requirements and provided documentation.<br>
Developed logical and physical data model using ER Studio and mapped data into database objects.<br>
Developed reporting data model for the database using ER Studio.<br>
Designed General Ledger Reporting Data Warehouse using ER Studio.<br>
Developed complex views for Spotfire reports.<br>
Worked extensively on query optimization and performance tuning.<br>
Wrote T-SQL statements for retrieval of data and performance tuning of T-SQL queries.<br>
Created documentation for tables, stored procedures, views and user-defined functions.<br>
Created ETL packages with different data sources including SQL Server, flat files, Excel source files and Oracle and loaded data into target tables using SSIS.<br>
Created package dynamics using SSIS transformations and variables.<br>
Created SSIS packages to extract data from OLTP to data warehouse systems and scheduled jobs to call the packages and stored procedures.<br>
Developed logging for ETL load at package level and task level to log number of records processed by each package and task.</p>

<p>Developed logical and physical data model using ER Studio and mapped data into database objects.<br>
Wrote complex stored procedures to process prospective customer information and balance processing load between front end and back end.<br>
Enhanced the old logical and physical database design to fit new business requirement and implemented new design into SQL Server 2008 R2.<br>
Worked with Oracle Server to extract and load customer information.<br>
Wrote standard and complex T-SQL queries to perform data validation and graph validation.<br>
Transferred old data from flat files, MS Access and Excel into MS SQL Server 2008 using SSIS packages.<br>
Developed data access queries and programs using SQL Query to run in production on a regular basis.<br>
Assisted end users with development of complex ad hoc queries.</p>