Sai Nikita

Sai Nikita

Data Engineer
Canada

نبذة عني

Data Engineer with 4+ years of experience designing scalable cloud-native data platforms and building enterprise ETL/ELT solutions across Azure, AWS, and GCP environments. Expertise in Databricks, Snowflake, PySpark, Azu…

الخبرة

Azure Data Engineer

Bank of America, North Carolina, USA
Aug 2024 - حتى الآن · 1 سنة 11 أشهر

Developed metadata-driven ETL frameworks that accelerated onboarding of new source systems and improved engineering productivity.
Built Delta Lake Medallion Architecture supporting AML analytics, fraud monitoring, and regulatory reporting across high-volume financial datasets.
Optimized PySpark transformation pipelines processing 500GB+ daily transaction data, reducing overall pipeline runtime by 25%.
Created finance and compliance reporting datasets in Snowflake and Synapse Analytics, improving audit readiness and reporting turnaround.
Leveraged Microsoft Fabric components including Data Factory, Lakehouse, OneLake, and Warehouse to build scalable ELT pipelines and centralized analytics platforms, improving data integration efficiency and supporting self-service reporting initiatives.
Automated orchestration and monitoring workflows using parameterized ADF pipelines, achieving 99.9% SLA compliance.
Developed Kafka-based streaming pipelines enabling near real-time fraud detection and transaction analytics.
Reduced cloud compute costs through partitioning, caching, workload optimization, and Databricks performance tuning.
Implemented dbt transformation workflows improving data lineage visibility, modularity, and testing coverage.
Automated Azure infrastructure provisioning using Terraform and Azure DevOps CI/CD pipelines, improving deployment consistency across environments.
Collaborated with fraud, risk, and finance stakeholders to deliver analytics-ready datasets and operational dashboards for faster business decision-making.
Enabled advanced analytics and AI-driven use cases by supporting Azure ML, LLMs, NLP, and Generative AI initiatives, leveraging GitHub Copilot for accelerated development and integrating Power BI dashboards for executive-level decision making.

AWS Data Engineer

Labcorp, Burlington, North Carolina, USA
Feb 2024 - Jul 2024 · 5 أشهر

Engineered secure AWS Glue and Redshift pipelines integrating clinical records, laboratory results, APIs, and flat-file healthcare datasets.
Built scalable ingestion workflows processing healthcare data while maintaining HIPAA-compliant validation and encryption standards.
Designed dimensional data models and optimized Redshift tables improving performance for patient and clinical analytics reporting.
Automated near real-time ingestion workflows using AWS Lambda and S3 event-driven architectures, improving downstream data availability.
Implemented reusable validation and reconciliation routines improving consistency across multiple healthcare source systems.
Reduced query latency and improved ETL efficiency through Redshift partitioning, indexing, and workload optimization.
Enforced healthcare data governance standards using metadata tracking, RBAC controls, encryption policies, and audit-compliant practices.
Monitored ETL operations using AWS CloudWatch and proactively resolved workflow failures to maintain highly available processing environments.

GCP Data Engineer

Aegon Life Insurance, Mumbai, India
Aug 2021 - Jul 2023 · 1 سنة 11 أشهر

Developed cloud-native data pipelines using Dataflow, BigQuery, and Apache Airflow supporting large-scale insurance analytics and reporting initiatives.
Built Pub/Sub streaming architectures enabling near real-time processing of policy transactions, underwriting events, and claims updates.
Designed scalable star and snowflake schema models in BigQuery improving reporting performance and analytical accessibility.
Consolidated claims systems, policy platforms, APIs, and relational database sources into centralized enterprise data repositories.
Developed transformation pipelines converting raw operational data into business-ready datasets for underwriting, risk, and customer analytics.
Improved reporting accuracy through automated validation checks, reconciliation routines, and data quality monitoring frameworks.
Reduced BigQuery storage and query costs using partitioning, clustering, and optimized query execution strategies.
Supported enterprise governance initiatives by implementing lineage tracking, validation frameworks, and role-based access controls.
Delivered integrated analytics datasets powering Power BI and Looker dashboards for operational and claims KPIs.
Collaborated with analytics and business teams to optimize reporting workflows and improve data-driven decision-making.

المهارات

Azure Data Factory Azure Databricks ADLS Gen2 Synapse Analytics Microsoft Fabric Snowflake AWS Glue Redshift Lambda S3 BigQuery Dataflow Pub/Sub ETL/ELT Development StreamSets dbt Data Lakehouse Architecture Medallion Architecture Apache Spark PySpark Kafka Delta Lake Structured Streaming Event-Driven Processing Python SQL Apache Airflow Azure DevOps Jenkins CI/CD Pipelines Docker Terraform Data Quality Validation Metadata Management Data Lineage Performance Tuning Unity Catalog Data Governance Cost Optimization Power BI Tableau Looker
الإبلاغ عن هذا الملف الشخصي؟