Senior Data Engineer Microsoft Fabric

Senior Data Engineer - Microsoft Fabric

PJ Dick Trumbull & The Lindy Group

Hybrid Pittsburgh (North Shore)

Position Overview

We are seeking an experienced Senior Data Engineer to design build and optimize the enterprise data platform that powers analytics reporting and AI initiatives across PJ Dick Trumbull and The Lindy Group.

This role will lead the design and implementation of modern data solutions using Microsoft Fabric Azure services and industry best practices for data engineering. The ideal candidate will possess extensive experience developing large-scale data pipelines ETL/ELT processes data models and analytics platforms that support business-critical decision making.

You will work closely with business leaders application developers data analysts and external partners to transform data into a strategic asset. This position offers the opportunity to shape the companys long-term data architecture.

---

What You Will Do

Microsoft Fabric Architecture & Development

• Design implement and maintain enterprise data solutions using Microsoft Fabric.
• Build and manage Fabric Lakehouses Warehouses Semantic Models and Data Factory Pipelines.
• Develop scalable data architectures that support reporting analytics machine learning and AI initiatives.
• Optimize Fabric workloads for performance scalability governance and cost management.

ETL / ELT & Data Pipelines

• Design build and maintain complex ETL and ELT pipelines that ingest data from ERP project management financial operational and external systems.
• Develop automated data integration processes utilizing Fabric Data Factory Azure Data Factory Spark notebooks and APIs.
• Ensure data quality reliability lineage and governance throughout the data lifecycle.
• Serve as a primary technical resource for diagnosing and resolving pipeline failures data quality issues and reporting discrepancies often working backward from a broken output to identify root cause across ingestion transformation and delivery layers.

Data Engineering & Analytics

• Design and maintain enterprise data models that support operational and executive reporting.
• Transform structured and unstructured data into analytics-ready datasets.
• Collaborate with BI developers and analysts to build semantic models and Power BI reporting solutions.
• Establish standards for data architecture metadata management and master data management.

Azure Integration

• Integrate Fabric solutions with Azure SQL Database Azure Storage Cosmos DB Azure Functions API Management and other Azure services.
• Secure data exchange processes utilizing Entra ID Key Vault and Azure networking services.
• Develop data ingestion frameworks from cloud on-premises SaaS and third-party platforms.

Governance & Operational Excellence

• Work with our security team to implement data governance retention and compliance requirements.
• Document architecture operational procedures and technical standards.
• Mentor team members and promote data engineering best practices across the organization.

---

Required Qualifications

Experience

• Minimum 7 years of professional Data Engineering experience supporting enterprise-scale environments.
• Minimum 1 years of hands-on Microsoft Fabric experience in production environments.
• Demonstrated experience designing and supporting large-scale data platforms and analytics ecosystems.
• Proven experience delivering end-to-end data engineering solutions from requirements through production deployment.

Technical Skills

Microsoft Fabric

Deep expertise with:

• Fabric Data Factory
• Fabric Lakehouses
• Fabric Warehouses
• Semantic Models
• OneLake
• Spark Notebooks
• Data Pipelines
• Real-Time Analytics
• Dataflows Gen2

Data Engineering

• Advanced SQL development and optimization.
• Strong ETL/ELT development experience.
• Experience working with large datasets and complex data transformations.
• Expertise in data modeling dimensional modeling and data warehousing methodologies.
• Experience building resilient scalable and automated pipelines.
• Experience converting non-relational or document-based data sources including NoSQL and legacy platforms into normalized relational schemas.
• Comfortable reverse-engineering data structures and tracing data discrepancies back to root cause in systems with limited or no formal documentation.

Azure

Strong experience with:

• Azure SQL Database
• Azure Data Factory
• Azure Storage
• Azure Functions
• Azure Key Vault
• Azure Monitor
• Entra ID

Development & Automation

• Strong proficiency in Python.
• Experience with Spark and PySpark.
• Experience working with REST APIs and integration frameworks.
• Source control experience using Git Azure DevOps or Bitbucket.
• Experience implementing CI/CD for data engineering solutions.

Business & Leadership Skills

• Ability to translate business requirements into scalable technical solutions.
• Strong analytical and problem-solving skills.
• Excellent written and verbal communication skills.
• Experience working directly with both technical and non-technical stakeholders.
• Ability to manage multiple priorities and projects simultaneously.
• Ability to scope estimate and deliver against committed timelines with proactive communication when priorities or scope shift.
• Comfortable operating in an iterative delivery model where business stakeholders remain engaged throughout the build and requirements evolve as the work takes shape.

---

Preferred Qualifications

• Experience with construction engineering manufacturing or professional services organizations.
• Experience integrating ERP platforms such as CMiC or similar enterprise systems.
• Experience with Power BI administration and enterprise reporting environments.
• Knowledge of data governance frameworks and regulatory compliance requirements.
• Experience supporting AI machine learning and advanced analytics initiatives.
• Prior experience serving as a technical lead or mentoring other data engineers.

---

Education & Certifications

Bachelors degree in Computer Science Data Engineering Software Engineering or a related field (or equivalent professional experience).

Preferred Microsoft Certifications

• DP-700: Microsoft Fabric Data Engineer Associate
• DP-600: Fabric Analytics Engineer Associate
• AZ-305: Azure Solutions Architect Expert
• AZ-204: Azure Developer Associate
• DP-203 (or equivalent Azure Data Engineering certification)

---

Why Join Us

Lead the modernization of a rapidly growing enterprise data platform.

Shape the future of analytics reporting and AI across three industry-leading construction organizations.

Work with modern Microsoft technologies including Fabric Azure Power BI and AI solutions.

Collaborate with business leaders who value data-driven decision making.

Be part of an organization consistently recognized as one of Pittsburghs Best Places to Work.

Work Arrangement: Hybrid (Pittsburgh)

Individuals with Disabilities: PJ Dick-Trumbull-The Lindy Group wants all interested and qualified candidates to be able to use the career site to review and apply for employment opportunities. If you have a disability and need an accommodation to access this site please contact us for assistance at 412.807.2000 or email us at .

PJ Dick-Trumbull-The Lindy Group strives to create a diverse safe welcoming and inclusive work environment in which all teams can excel.

We are an Equal Opportunity and VEVRAA Federal Contracting Employer and welcome all applications from a wide range of candidates including covered veterans minorities females and people with disabilities. Our policy is clear: We do not discriminate based on any characteristic protected by law.

To view our EEO policy click here; to view our Section 503 and VEVRAA Affirmative Action Policy click here.

Required Experience:

Senior IC