nishu jain

nishu jain

Azure Data Engineer
India
English, Hindi
Full-time Hybrid

نبذة عني

Azure Data Engineer with 10+ years of IT experience, including 2.5+ years of hands-on experience in Azure Data Engineering. Experienced in designing and building scalable ETL/ELT pipelines using Azure Data Factory (ADF),…

الخبرة

Azure Data Engineer

Tata Consultancy Services (TCS) · Bengaluru , Karnataka , India
Jan 2022 - May 2024 · 2 سنوات 3 أشهر

Designed and built scalable data pipelines using Azure Data Factory and Azure Databricks, processing 20M+ records across enterprise systems. Implemented Medallion Architecture (Bronze-Silver-Gold) on ADLS Gen2 with Delta Lake for structured and efficient data processing. Optimized PySpark workloads, improving data processing performance by 30-40%. Architected and optimized data storage solutions on Azure Data Lake Storage (ADLS) Gen2, improving processing efficiency by 25%. Developed data models and data warehousing solutions, enhancing reporting and analytics capability by 25%. Strengthened data security by integrating Azure Key Vault for secure credential and secrets management. Implemented data validation frameworks, reducing inconsistencies by 20% and improving overall data quality.

Senior Analyst

Tata Consultancy Services (TCS) · Bengaluru , Karnataka , India
Mar 2018 - Jul 2021 · 3 سنوات 4 أشهر

Led IAM operations, managed large-scale datasets, developed SQL-based reporting solutions, automated operational processes and mentored team members.Subject Matter expert and POC for many IAM applications

المهارات

Azure Data Factory (ADF) Azure Databricks ADLS Gen2 Azure Key Vault Managed Identity Apache Spark PySpark Spark SQL Delta Lake HDFS ETL/ELT Data Ingestion Data Transformation Data Validation Data Migration Workflow Orchestration SQL Server SQL Stored Procedures CTEs Window Functions Views SCD Type 1 Medallion Architecture Metadata-Driven Pipelines Parameterization Partitioning Bucketing Broadcast Hash Join Sort Merge Join Caching C# JavaScript HTML CSS
الإبلاغ عن هذا الملف الشخصي؟