Sr. Data Engineer – MS Fabric, Azure

Location: Chicago Illinois (Hybrid 2 days/week onsite)

STAFFXPERT LLC is seeking a Senior Data Engineer Microsoft Fabric & Azure on behalf of our client in Chicago Illinois. We are looking for a highly skilled data engineering professional with deep expertise in Microsoft Fabric and the Azure Data Platform to design build and optimize scalable enterprise data solutions. This role is ideal for a candidate passionate about modern data architecture cloud-native engineering governance and large-scale analytics environments.

The ideal candidate will bring hands-on experience across Microsoft Fabric workloads Azure-based data services large-scale data processing and modern data governance frameworks to support enterprise-level analytics and AI initiatives.

• Design and develop end-to-end enterprise data platforms using Microsoft Fabric including:
  • Lakehouse
  • Warehouse
  • OneLake
  • Dataflows Gen2
• Build optimize and maintain scalable Spark-based workloads using PySpark and SparkSQL for high-volume data processing.
• Develop and support MLOps pipelines and feature engineering frameworks to enable advanced analytics and AI use cases.
• Design and implement scalable ETL/ELT pipelines using:
  • Azure Data Factory (ADF)
  • Microsoft Fabric Data Pipelines
  • Dataflow Gen2
  • SSIS (On-Premises Azure-SSIS Integration Runtime and migration scenarios)
• Implement modern enterprise data modeling strategies including:
  • Medallion Architecture (Bronze Silver Gold)
  • Dimensional Modeling (Star and Snowflake schemas)
• Process and manage multiple structured and semi-structured data formats such as Parquet JSON and XML.
• Implement and manage enterprise data governance solutions using Microsoft Purview including:
  • Data cataloging and classification
  • Automated lineage across Azure and Fabric ecosystems
  • Business glossary management
• Enforce enterprise-grade security and governance controls including:
  • Role-Based Access Control (RBAC)
  • Column-level security
  • Data masking policies
  • Governance alignment across Fabric and Purview
• Optimize performance scalability reliability and cost efficiency across enterprise data environments.
• Implement CI/CD pipelines and Infrastructure as Code (IaC) for data engineering and governance assets.
• Collaborate cross-functionally with Security Compliance Analytics and BI teams to deliver trusted and governed data solutions.

• Strong hands-on experience with Microsoft Fabric Data Engineering workloads
• Expertise with:
  • Lakehouse and Warehouse architectures
  • OneLake ecosystem
  • Fabric pipelines and notebooks
  • Capacity planning and performance optimization

• Advanced expertise in PySpark including:
  • Joins window functions and UDFs
  • Partitioning strategies shuffle optimization and caching
• Strong SparkSQL experience
• Experience processing large-scale datasets (TB)

• Azure SQL Database / SQL Server
• Azure Data Factory (ADF)
• SSIS / Azure-SSIS Integration Runtime
• Azure Data Lake Storage (ADLS Gen2)

• Strong experience with Microsoft Purview including:
  • Data cataloging and scanning
  • Automated data lineage across Fabric ADF SQL and ADLS
  • Business glossary management
• Experience integrating governance frameworks with enterprise security policies and Azure RBAC

• Strong experience working within enterprise-scale Azure data ecosystems
• Expertise in modern data architecture governance and performance optimization
• Experience supporting scalable analytics and AI-driven initiatives