nishu jain

nishu jain

Azure Data Engineer
India
English, Hindi
Full-time Hybrid

نبذة عني

Azure Data Engineer with 10+ years of IT experience, including 2.5+ years of hands-on experience in Azure Data Engineering. Experienced in designing and building scalable ETL/ELT pipelines using Azure Data Factory (ADF),…

الخبرة

Azure Data Engineer

Tata Consultancy Services (TCS) · Bengaluru , Karnataka , India
Jan 2022 - May 2024 · 2 سنوات 3 أشهر

<p>Designed and built scalable data pipelines using Azure Data Factory and Azure Databricks, processing 20M+ records across enterprise systems.</p><p> Implemented Medallion Architecture (Bronze-Silver-Gold) on ADLS Gen2 with Delta Lake for structured and efficient data processing.</p><p> Optimized PySpark workloads, improving data processing performance by 30-40%.</p><p> Architected and optimized data storage solutions on Azure Data Lake Storage (ADLS) Gen2, improving processing efficiency by 25%.</p><p> Developed data models and data warehousing solutions, enhancing reporting and analytics capability by 25%.</p><p> Strengthened data security by integrating Azure Key Vault for secure credential and secrets management.</p><p> Implemented data validation frameworks, reducing inconsistencies by 20% and improving overall data quality.</p>

Senior Analyst

Tata Consultancy Services (TCS) · Bengaluru , Karnataka , India
Mar 2018 - Jul 2021 · 3 سنوات 4 أشهر

<p>Led IAM operations, managed large-scale datasets, developed SQL-based reporting solutions, automated operational processes and mentored team members.</p><p>Subject Matter expert and POC for many IAM applications </p>

المهارات

Azure Data Factory (ADF) Azure Databricks ADLS Gen2 Azure Key Vault Managed Identity Apache Spark PySpark Spark SQL Delta Lake HDFS ETL/ELT Data Ingestion Data Transformation Data Validation Data Migration Workflow Orchestration SQL Server SQL Stored Procedures CTEs Window Functions Views SCD Type 1 Medallion Architecture Metadata-Driven Pipelines Parameterization Partitioning Bucketing Broadcast Hash Join Sort Merge Join Caching C# JavaScript HTML CSS
الإبلاغ عن هذا الملف الشخصي؟