Microsoft Fabric Data Engineer

Title: Microsoft Fabric Data Engineer

Location: PA (Day 1 Onsite)

Overview

The Microsoft Fabric Core Lead Engineer is responsible for leading the design development implementation and support of enterprise-scale data and analytics solutions using Microsoft Fabric. The role provides technical leadership drives architecture decisions mentors engineering teams and ensures successful delivery of scalable secure and high-performing data platforms.

Roles & Responsibilities

Technical Leadership

• Lead the end-to-end implementation of Microsoft Fabric solutions across enterprise programs.
• Define technical architecture engineering standards and best practices for Microsoft Fabric adoption.
• Provide technical leadership to a team of data engineers and developers.
• Review solution designs code and deployment strategies to ensure quality and scalability.

Microsoft Fabric Architecture

• Design and implement enterprise data platforms using Microsoft Fabric components including OneLake Lakehouse Data Warehouse Data Factory Real-Time Intelligence Data Engineering and Power BI.
• Architect scalable cloud-native data solutions supporting analytics AI and business intelligence workloads.
• Establish reusable design patterns and reference architectures.

Data Engineering & Integration

• Design and develop robust ETL/ELT pipelines using Microsoft Fabric Data Factory and Spark Notebooks.
• Integrate structured semi-structured and unstructured data from cloud and on-premises systems.
• Implement data transformation cleansing validation and orchestration processes.
• Optimize data ingestion strategies for performance and reliability.

Data Modeling & Analytics

• Design dimensional models Lakehouse architectures and enterprise data warehouses.
• Develop semantic models and datasets for Power BI reporting and self-service analytics.
• Collaborate with business teams to translate analytical requirements into scalable data solutions.

Performance Optimization

• Optimize Spark workloads SQL Warehouse performance and OneLake storage utilization.
• Implement partitioning indexing caching and workload optimization strategies.
• Monitor platform performance and proactively resolve bottlenecks.

Security & Governance

• Implement enterprise security using Microsoft Entra ID RBAC and Fabric workspace security.
• Define governance policies for data quality lineage cataloging auditing and compliance.
• Ensure adherence to enterprise security privacy and regulatory standards.

DevOps & Automation

• Implement CI/CD pipelines using Azure DevOps or GitHub.
• Automate deployment of Microsoft Fabric artifacts across Development QA UAT and Production environments.
• Manage source control release management and deployment automation.

AI & Advanced Analytics

• Enable AI Machine Learning and Copilot capabilities within Microsoft Fabric.
• Support Data Science workloads using Spark notebooks and ML models.
• Collaborate with AI teams to operationalize predictive analytics and intelligent data solutions.

Production Support & Operations

• Lead production deployments and post-production support activities.
• Monitor platform health troubleshoot incidents and ensure SLA compliance.
• Implement disaster recovery backup and business continuity strategies.

Stakeholder Management

• Collaborate with enterprise architects product owners business stakeholders and cross-functional teams.
• Participate in architecture review boards and technical governance meetings.
• Communicate technical solutions and project status to senior leadership.

Team Leadership & Mentoring

• Mentor junior and senior engineers on Microsoft Fabric technologies and engineering best practices.
• Conduct code reviews design reviews and technical knowledge-sharing sessions.
• Drive continuous improvement initiatives and foster engineering excellence.

Required Qualifications

• Bachelors or Masters degree in Computer Science Information Technology Engineering or a related field.
• 10 years of experience in Data Engineering Data Warehousing or Cloud Data Platform development.
• 4 years of hands-on experience with Microsoft Azure Data Platform technologies.
• 2 years of hands-on experience with Microsoft Fabric in enterprise implementations.
• Strong expertise in SQL PySpark Python and Spark optimization.
• Experience with Microsoft Fabric components including OneLake Lakehouse Data Warehouse Data Factory Power BI and Real-Time Intelligence.
• Experience with Azure Data Lake Storage (ADLS) Azure DevOps GitHub and CI/CD pipelines.
• Strong knowledge of dimensional data modeling ETL/ELT architecture and data governance.
• Experience leading technical teams and delivering large-scale enterprise data modernization programs.

Preferred Skills

• Microsoft Certified: Fabric Analytics Engineer Associate (DP-600)
• Microsoft Azure Data Engineer Associate (DP-203)
• Experience with Databricks Synapse Analytics Azure AI Services or Microsoft Purview.
• Knowledge of Agile/Scrum delivery methodologies.
• Strong communication stakeholder management and problem-solving skills.

Regards

Manoj Goud

Derex Technologies INC

Contact : Ext 206

Additional Information :

All your information will be kept confidential according to EEO guidelines.

Remote Work :

No

Employment Type :

Full-time