Sayali Dudhande

Created a pipeline which consumes data from MySQL-Hadoop System-Druid using Spark and Python
scripts. Used Pandas data frames for ingesting data from Druid data to Redshift server.
Owner of Analytics Interface Database Backend in which SQL server, Druid, Hive-Spark and MySQL
are used, and responsible for code reviews, maintaining, scaling and optimization of the system.
Managing two SQL servers with Master-Slave configuration.
Launched an APIs in Python which gives the critical service errors in detail from Elastic Search Logs
and built an alert system where it sends a notification/alert in Flock Messenger if system is in critical
and warning state.
Led the development of Auto Template serving, Search Re-targeting system, and monitored,
optimized, and reviewed all the database development part in MySQL and Hadoop integration.
Delivered a platform for reporting all the error and system-level stats of different products using
Kibana Dashboard with Elastic Search Logs and Graphana which led to early detection of errors.
Created a pipeline which consumes data from Kafka to Hadoop (Hive tables) and Druid (Realtime
Ingestion & Batch Ingestion), from Hadoop to Druid and Druid to Reporting using Python, Shell
scripts, Spark jobs and Oozie jobs.
Prioritize product and customer requirements, defining the product vision, and worked closely with
stakeholders.

Created a pipeline which consumes data from MySQL-Hadoop System-Druid using Spark and Python scripts.
Used Pandas data frames for ingesting data from Druid data to Redshift server.
Owner of Analytics Interface Database Backend in which SQL server, Druid, Hive-Spark, and MySQL are used.
Responsible for code reviews, maintaining, scaling, and optimization of the system.
Managing two SQL servers with Master-Slave configuration.
Launched APIs in Python for critical service errors in detail from Elastic Search Logs.
Built an alert system in Flock Messenger for critical and warning states.
Led the development of Auto Template serving, Search Re-targeting system, and monitored, optimized, and reviewed all the database development part.
Delivered a platform for reporting all the error and system-level stats of different products using Kibana Dashboard with Elastic Search Logs and Graphana.
Created a pipeline which consumes data from Kafka to Hadoop and Druid, from Hadoop to Druid and Druid to Reporting using Python, Shell scripts, Spark jobs, and Oozie jobs.
Prioritized product and customer requirements, defined the product vision, and worked closely with stakeholders.

<p>Owner of Database System of Newsprompt extension in MySQL tokudb, with optimized procedures which servers the data very fast using proper table structures, indexes and partitions.<br>
Managing four servers for this project with Master-Slave Replication configuration of one master server and three slaves.<br>
Implemented the alerting system for MySQL servers on grafana, which led to detection of server errors, its downtime and its performance, also logged the procedure execution time on grafana which helped to focus on exact issue or the area of the optimization.<br>
Created an ETL which accepts raw data files and migrated to SQL and OLAP data using MS SQL Server with SSIS and SSAS tools for many projects.<br>
Implemented a Hive for data processing for User Behavior project using Oozie jobs and python scripts to ingest data in druid.<br>
Developed a generic database structure for Chrome Apps and Extensions including logging and serving functionality.<br>
Worked on Big Data system: Hive data processing, Hbase ingestion for serving, Druid Ingestion for Reporting.<br>
Worked on Hyperloop and scoop for Replication.<br>
Hyperloop is tool which transfers the data from any source like MSSQL/MySQL/HIVE to any source.</p>