Job Description:Microsoft Fabric Senior Developer ADF and Medallion Architecture
Location: Remote
Type: Long Term Contract
Role Summary
We are seeking a seasonedSenior Data Engineer / Microsoft Fabric Developerto design build and operate scalable data platforms usingMicrosoft FabricAzure Data Factory (ADF) andMedallion Architecturepatterns. This role leads end-to-end data platform initiatives translates business requirements into robust data pipelines and lakehouse solutions and mentors engineers to deliver reliable performant and governed data products.
Key Responsibilities
Architect and implementend-to-end data solutions on Microsoft Fabric applying Medallion Architecture (Bronze Silver Gold) to organize ingestion cleansing transformation and serving layers.
Design and buildscalable ETL/ELT pipelines using Azure Data Factory Fabric Dataflows and Fabric Notebooks; optimize for throughput latency and cost.
Develop data models and transformationsusing Spark SQL and Fabric OneLake; implement incremental processing schema evolution and data quality checks.
Implement data governance and security: access controls encryption lineage cataloging and compliance with organizational policies.
Operationalize pipelineswith monitoring alerting automated testing DevOps CI/CD setup and Deployment automation and runbook documentation to ensure high availability.
Collaborate cross-functionallywith product owners data scientists BI teams and platform engineers to translate requirements into production-ready data products.
Mentor and reviewcode design patterns and best practices for junior and mid-level engineers.
Drive performance tuningfor Spark jobs Fabric compute and storage; manage cost optimization strategies.
Evaluate and adoptnew Fabric features Azure services and third-party tools to improve platform capabilities.
Required Qualifications
Experience: 5 years in data engineering or related roles Fabric data pipelines Azure Data Factory or equivalent orchestration tools.
Microsoft Fabric: Hands-on experience designing and delivering solutions on Microsoft Fabric or strong experience with lakehouse architectures and willingness to adopt Fabric.
Medallion Architecture: Proven experience implementing Bronze/Silver/Gold layers data partitioning and incremental processing patterns.
Big Data Technologies: Strong Spark experience (PySpark or Scala) SQL and familiarity with distributed compute concepts.
Data Storage: Experience with OneLake ADLS Gen2 Delta Lake or similar lakehouse storage formats.
DevOps and CI/CD: Experience with Git Azure DevOps or GitHub Actions and deployment pipelines.
Data Governance: Knowledge of data cataloging lineage RBAC and compliance controls.
Soft Skills: Strong communication stakeholder management and mentoring ability.
Technical Skills and Tools
Core: Azure Data Factory; Microsoft Fabric components (Data Engineering Data Factory integration Notebooks OneLake); Spark (PySpark/Scala); SQL.
Orchestration and Scheduling: ADF pipelines Fabric pipelines event-driven triggers.
CI/CD and Automation: Git Azure DevOps GitHub Actions
Value Added Skills and Tool: Azure Monitor Databricks experience; Power BI Data Quality Great Expectations Purview
Preferred Qualifications
Batchers degreein Computer Science Engineering Data Science or related field.
Value Added Certifications: Microsoft Certified: Azure Data Engineer Associate or Microsoft Fabric certifications.
Required Skills:
AZURE DATA FACTORYAZURE SERVICESGITSTAKEHOLDER MANAGEMENTAUTOMATIONPOWER BIAUTOMATED TESTINGDESIGN PATTERNSDEVOPSSPARKMICROSOFTSQLCI/CD
Job Description:Microsoft Fabric Senior Developer ADF and Medallion ArchitectureLocation: RemoteType: Long Term ContractRole SummaryWe are seeking a seasonedSenior Data Engineer / Microsoft Fabric Developerto design build and operate scalable data platforms usingMicrosoft FabricAzure Data Factory (...
Job Description:Microsoft Fabric Senior Developer ADF and Medallion Architecture
Location: Remote
Type: Long Term Contract
Role Summary
We are seeking a seasonedSenior Data Engineer / Microsoft Fabric Developerto design build and operate scalable data platforms usingMicrosoft FabricAzure Data Factory (ADF) andMedallion Architecturepatterns. This role leads end-to-end data platform initiatives translates business requirements into robust data pipelines and lakehouse solutions and mentors engineers to deliver reliable performant and governed data products.
Key Responsibilities
Architect and implementend-to-end data solutions on Microsoft Fabric applying Medallion Architecture (Bronze Silver Gold) to organize ingestion cleansing transformation and serving layers.
Design and buildscalable ETL/ELT pipelines using Azure Data Factory Fabric Dataflows and Fabric Notebooks; optimize for throughput latency and cost.
Develop data models and transformationsusing Spark SQL and Fabric OneLake; implement incremental processing schema evolution and data quality checks.
Implement data governance and security: access controls encryption lineage cataloging and compliance with organizational policies.
Operationalize pipelineswith monitoring alerting automated testing DevOps CI/CD setup and Deployment automation and runbook documentation to ensure high availability.
Collaborate cross-functionallywith product owners data scientists BI teams and platform engineers to translate requirements into production-ready data products.
Mentor and reviewcode design patterns and best practices for junior and mid-level engineers.
Drive performance tuningfor Spark jobs Fabric compute and storage; manage cost optimization strategies.
Evaluate and adoptnew Fabric features Azure services and third-party tools to improve platform capabilities.
Required Qualifications
Experience: 5 years in data engineering or related roles Fabric data pipelines Azure Data Factory or equivalent orchestration tools.
Microsoft Fabric: Hands-on experience designing and delivering solutions on Microsoft Fabric or strong experience with lakehouse architectures and willingness to adopt Fabric.
Medallion Architecture: Proven experience implementing Bronze/Silver/Gold layers data partitioning and incremental processing patterns.
Big Data Technologies: Strong Spark experience (PySpark or Scala) SQL and familiarity with distributed compute concepts.
Data Storage: Experience with OneLake ADLS Gen2 Delta Lake or similar lakehouse storage formats.
DevOps and CI/CD: Experience with Git Azure DevOps or GitHub Actions and deployment pipelines.
Data Governance: Knowledge of data cataloging lineage RBAC and compliance controls.
Soft Skills: Strong communication stakeholder management and mentoring ability.
Technical Skills and Tools
Core: Azure Data Factory; Microsoft Fabric components (Data Engineering Data Factory integration Notebooks OneLake); Spark (PySpark/Scala); SQL.
Orchestration and Scheduling: ADF pipelines Fabric pipelines event-driven triggers.
CI/CD and Automation: Git Azure DevOps GitHub Actions
Value Added Skills and Tool: Azure Monitor Databricks experience; Power BI Data Quality Great Expectations Purview
Preferred Qualifications
Batchers degreein Computer Science Engineering Data Science or related field.
Value Added Certifications: Microsoft Certified: Azure Data Engineer Associate or Microsoft Fabric certifications.
Required Skills:
AZURE DATA FACTORYAZURE SERVICESGITSTAKEHOLDER MANAGEMENTAUTOMATIONPOWER BIAUTOMATED TESTINGDESIGN PATTERNSDEVOPSSPARKMICROSOFTSQLCI/CD
View more
View less