Sharmistha Sahu

Sharmistha Sahu

Azure Data Engineer
Canada

About Me

Overall 7+ years of IT experience which includes 4+ years as an Azure Data Engineer in architecting and implementing end-to-end data solutions on the Azure platform and successfully designed and executed robust data arch…

Experience

Azure Data Engineer

TCS, Canada
Oct 2021 - Present · 5 years 1 month

• Designed, developed, and maintained robust data pipelines to facilitate the seamless flow of information within the organization, ensured data quality and reliability through comprehensive data validation and error-handling mechanisms
• Managed Azure Data Lake Storage to optimize data processing time and facilitate the daily processing of substantial data volumes and implemented robust data access controls and encryption measures, ensuring a high data availability rate and compliance with data security standards

Azure Data Engineer

TCS, Canada
Oct 2021 - Present · 5 years

<p>Designed, developed, and maintained robust data pipelines to facilitate the seamless flow of information within the organization<br>
Ensured data quality and reliability through comprehensive data validation and error-handling mechanisms<br>
Managed Azure Data Lake Storage to optimize data processing time and facilitate the daily processing of substantial data volumes<br>
Implemented robust data access controls and encryption measures<br>
Ensured a high data availability rate and compliance with data security standards<br>
Orchestrated the development of sophisticated Extract, Transform, Load (ETL) processes<br>
Demonstrated a keen understanding of data engineering principles<br>
Through meticulous design and implementation, achieved a substantial improvement in data integration efficiency<br>
Utilized Azure Databricks to develop and deploy advanced data analytics solutions<br>
Leveraged Apache Spark for data processing<br>
Resulted in reduction of processing time for large datasets<br>
Adopted scalable data pipelines, enabling the efficient analysis of petabytes of data for actionable insights<br>
Initiated Azure Data Factory to automate data integration and transformation<br>
Reduced data processing time<br>
Implemented robust data monitoring and alerting for enhanced reliability<br>
Collaborated cross-functionally to deliver timely, error-free data solutions<br>
Improving operational efficiency and enabling data-driven decisions<br>
Optimized Azure Blob Storage for scalable and secure data storage solutions<br>
Implemented data lifecycle management policies<br>
Reducing storage costs<br>
Ensured data availability<br>
Established data quality standards and implemented data governance processes<br>
Improvement in data accuracy with teams to streamline data storage and retrieval processes<br>
Enhancing overall data management efficiency<br>
Evaluated complex mapping and transformation processes through data migration<br>
Data accuracy rate post-migration closely with stakeholders to define migration objectives<br>
Minimize downtime<br>
Meet project deadlines<br>
Facilitating a smooth transition and preserving data integrity<br>
Improved data accessibility by implementing data warehouse optimizations<br>
Reduction in report generation time<br>
Collaborated with data scientists and analysts to understand business requirements and optimize data processes</p>

Azure Data Engineer

TCS, India
Aug 2019 - Sep 2021 · 2 years 1 month

<p>Designed scalable and cost-effective data architectures on Microsoft Azure<br>
Leveraging services such as Azure Data Factory, Azure Synapse Analytics, and Azure Data Lake Storage<br>
Orchestrated data pipelines in Azure Data Factory<br>
Achieving improvement in ETL efficiency and reducing data processing costs<br>
Monitored solutions to result in reduction in incident response time and ensuring pipeline reliability<br>
Led the design and implementation of data warehousing solutions on Azure Synapse Analytics<br>
Improvement in query performance and reduction in data loading times<br>
Achieved optimal resource utilization, contributing to a reduction in overall data processing costs<br>
Managed data storage and retrieval in Azure Data Lake Storage<br>
Enhancing data access speed and significantly improving overall query performance<br>
Implemented effective data partitioning strategies<br>
Contributing to a reduction in storage costs<br>
Initiated the deployment and optimization of Azure Synapse Analytics (formerly Azure SQL Data Warehouse)<br>
Improving query response times and reducing data warehouse processing costs by implementing data compression strategies<br>
Leading to a reduction in storage consumption and contributing to enhanced overall system efficiency<br>
Developed and optimized data storage in Azure Blob Storage<br>
Implementing lifecycle management policies and efficient data practices<br>
Achieved high availability rates<br>
Ensuring reliable data accessibility for critical applications<br>
Streamlined ETL processes<br>
Significantly reducing data processing time and improving overall data transformation efficiency and quality checks<br>
This led to a notable decrease in post-release defects<br>
Ensuring high-quality data integration<br>
Implemented big data solutions on Azure, utilizing services such as Azure Databricks and HDInsight to enhance data processing speed and reduce resource utilization<br>
This optimization contributes to cost efficiency and overall improvements in big data analytics capabilities<br>
Executed complex data migration projects<br>
Ensuring seamless transition of data between systems<br>
Meticulous data validation<br>
Minimizing downtime<br>
Resulting in successful data migrations with minimal disruption to business operations</p>

Software Engineer

Mind Tree, India
Jul 2016 - Jul 2019 · 3 years

<p>Implemented Agile methodologies<br>
Enhancing project delivery efficiency with increased sprint velocity and a notable reduction in time-to-market for software releases<br>
Demonstrated proficiency in requirements analysis<br>
Leading to a reduction in project scope changes and improved accuracy in initial project estimations<br>
This contribution positively impacted project planning and successful execution<br>
Developed the system design phase<br>
Optimizing architecture to achieve improved application scalability<br>
This was evident in increased user load capacity and a reduction in system response times<br>
Demonstrated coding expertise<br>
Consistently delivering high-quality code through successful code reviews<br>
Contributing to a reduction in post-release defects<br>
Showcase a commitment to reliable software development<br>
Drove comprehensive testing initiatives to increase test coverage and decrease post-release defects<br>
Ensured the delivery of robust and high-quality software solutions<br>
Led efficient deployment processes to maintain a high system uptime and reduce deployment-related incidents<br>
Ensuring seamless operation and minimizing disruptions for end-users<br>
Coordinated cross-functional collaboration efforts<br>
Significantly boosting team productivity<br>
Received outstanding ratings in team satisfaction surveys<br>
Highlighting successful teamwork and fostering positive working relationships</p>

Skills

Business Communication Azure Data Factory Azure SQL Database Azure Databricks Azure Synapse Analytics Snowflake Azure Cosmos DB Azure HDInsight Jira Confluence Azure Data Lake Storage ETL Apache Spark Azure Blob Storage Data Warehousing Data Pipelines Data Validation Error Handling Data Access Controls Encryption Data Governance Data Migration Data Partitioning Data Compression Lifecycle Management Agile Requirements Analysis System Design Code Reviews Testing Deployment Communication Collaboration
Report this Profile?