Monish Varghese Joshy

Data Engineer (Remote)
- Designed and developed scalable ETL pipelines for Azure Data Warehouse.
- Automated ETL processes using ADF Pipelines and SSIS, reducing processing time by 30%.
- Developed and integrated Python functions in Synapse pipelines for advanced data transformations.
- Leveraged Pyspark and Spark SQL for efficient data processing and marketing campaign analysis.
- Supported financial and healthcare clients by delivering high-quality data solutions.

Designed and developed ETL pipelines to load data from different sources including Azure Data Warehouse.
Automated ETL applications like Azure Pipelines and SSIS.
Developed Python functions to be used on Synapse pipelines.
Developed PySpark notebooks to execute marketing campaigns of different healthcare clients.
Utilized Spark SQL API within PySpark to extract, transform and load data and perform SQL queries.
Performed ETL from different source systems to Azure storage services using Azure Pipelines, T-SQL and Spark SQL.
Supported different financial and healthcare clients for marketing their products.
Leveraged PySpark and Spark SQL for efficient data processing and marketing campaign analysis.
Supported financial and healthcare clients by delivering high-quality data solutions.

Worked on ETL of state of Texas student and staff information from ODS into PDM (Data Mart).
Wrote complex procedures to validate the data.
Created Jasper reports.
Developed SSIS packages.
Wrote hundreds of complex procedures in PL/SQL.
Wrote procedures to validate business rules and generate reports when the data did not conform to validation rules.
Developed Azure pipelines for ETL of student financial data information from various EA systems.
Developed PySpark code in Databricks.

Developed ETL packages using SSIS to load data from multiple sources into PDW Server.
Developed Power BI dashboards from data warehouse.
Designed Power BI reports utilizing cross tabs, scatter plots, pie bar, map charts and density charts.
Used DAX queries for computed columns in Power BI.
Created financial Power BI dashboard for stakeholders and product owners for business decision making.
Developed Python functions for transforming data to be used within Azure Data Factory.
Designed and developed Azure Data Factory pipelines to load data from sources including Blobs, SharePoint List, Azure Data Warehouse, Oracle, DB2, SAP and Hadoop.
Designed and developed Power BI reports.
Automated ETL applications like ADF pipelines and SSIS.
Developed PySpark code in Databricks.

Loaded source data from Oracle into SQL tables to load into Microsoft AX.
Fetched source data from Oracle and performed data cleansing and transformation before loading into final destination tables.
Created SSIS packages for each entity including Customer Bank Account, Vendor Bank Account, Subscription billing and Sales Partner.
Developed T-SQL stored procedures, triggers, views and table changes for data load, transformation and extraction.
Designed physical and logical data models for vendor and sales domain.
Cleansed master data using DQS cleansing component, fuzzy lookup and lookup transformations in SSIS packages.
Designed Azure Database and created SSIS package to load into Azure.
Created Power BI dashboards utilizing scatter plots and pie bar charts.
Used Power BI and Power Pivot to develop data analysis prototype and Power View to visualize reports.

Extracted data from claims in Oracle, converted into Acord XML and performed incremental load into IEV XTM database.
Ensured data moved from XTM database into TDS and from TDS into ODS.
Developed up-selling and cross-selling Power BI reports using DAX functions.
Created row-level security with Power BI and integration with Power BI Service portal.
Developed T-SQL stored procedures, triggers, views and table changes for data load, transformation and extraction.
Used Execution Plan, SQL Profiler and Database Engine Tuning Advisor to optimize queries and enhance database performance.
Used complex query statements including sub queries, correlated queries, derived tables and CASE functions to insert data depending on criteria.
Wrote T-SQL queries and created dynamic stored procedures using input values.
Loaded Acord XML from Oracle CA into IEV XTM using Script Task (C#.NET).
Extracted data from AS400 and loaded into Sapiens using SSIS package.
Extracted data from claims and loaded into Sapiens using SSIS package.
Created SSIS package to process claims and policy information into Sapiens database.
Created SSIS package to find exceptions after loading claims and wins file into SSIS and email the file to different team members of the Sapiens team.
Worked extensively on data analysis to solve bugs created by business analysts when they saw the data was wrong.
Extracted policy data and claims data from flat files, Excel/CSV files and relational databases like Oracle and SQL Server and loaded into different destinations for analysis.
Worked with data scientists and learned data science hands on from senior data scientists of the company.

Designed and developed CDW database for data migration from HCN Oracle database belonging to Coram since CVS merged with Coram.
Managed indexing, debugging, optimization and performance tuning using SQL Profiler and SQL Server Agent.
Created master package, receipt package, validation packages, loading packages, archival package and acknowledgment package using Visual Studio Data Tool Environment.

Worked in production support.
Created complex stored procedures, views, functions, triggers and tables.
Performed reverse engineering using ER Studio.
Created stored procedures to load raw data into xraw tables, filter bad data using temporary tables and load good records into raw tables, Allocation and Block trade tables.
Created documentation for tables, stored procedures, views and user-defined functions.
Debugged errors occurring while loading data from OMS to CTR in SQL Server.
Loaded trades obtained from State Street in CTR within the UNIX environment.
Tested data obtained in CTR for accuracy.
Debugged and tested stored procedures, functions, views and triggers during production support.

Planned, defined and designed data based on business requirements and provided documentation.
Developed logical and physical data model using ER Studio and mapped data into database objects.
Developed reporting data model for the database using ER Studio.
Designed General Ledger Reporting Data Warehouse using ER Studio.
Developed complex views for Spotfire reports.
Worked extensively on query optimization and performance tuning.
Wrote T-SQL statements for retrieval of data and performance tuning of T-SQL queries.
Created documentation for tables, stored procedures, views and user-defined functions.
Created ETL packages with different data sources including SQL Server, flat files, Excel source files and Oracle and loaded data into target tables using SSIS.
Created package dynamics using SSIS transformations and variables.
Created SSIS packages to extract data from OLTP to data warehouse systems and scheduled jobs to call the packages and stored procedures.
Developed logging for ETL load at package level and task level to log number of records processed by each package and task.

Developed logical and physical data model using ER Studio and mapped data into database objects.
Wrote complex stored procedures to process prospective customer information and balance processing load between front end and back end.
Enhanced the old logical and physical database design to fit new business requirement and implemented new design into SQL Server 2008 R2.
Worked with Oracle Server to extract and load customer information.
Wrote standard and complex T-SQL queries to perform data validation and graph validation.
Transferred old data from flat files, MS Access and Excel into MS SQL Server 2008 using SSIS packages.
Developed data access queries and programs using SQL Query to run in production on a regular basis.
Assisted end users with development of complex ad hoc queries.