Design develop and orchestrate endtoend data pipelines using Microsoft Fabric Build scalable and reusable data frameworks including: o Configdriven pipeline architecture o Centralized configuration tables supporting multiple pipelines Develop and maintain Spark notebooks and pipelines Implement ETLELT processes using SQL Spark and Python Perform data modeling and transformations for analytics and reporting Collaborate with architectural and engineering teams to design robust solutions Ensure adherence to enterprise standards including: o Confluence documentation o CICD pipelines o Code quality and deployment guidelines Support deployments across multiple client environments Own deliverables endtoend with minimal supervision Required Skills Experience MustHave 5 years of experience as a Data Engineer Strong experience with Microsoft Fabric (2 years of work experience in Fabric) o OR strong background in Azure Synapse Analytics with Azure data services (ADF Databricks Delta tables etc.) o Good to have Fabric certified candidates Handson experience with: o SQL o Data Modeling o ETL ELT Pipelines Experience with Spark notebooks and pipelines or Python experience for data engineering use cases Create Semantic models and generate BI reports Proven ability to design and orchestrate scalable data solutions Experience working in environments with CICD processes for deployments NicetoHave Experience building generic or reusable data frameworks Familiarity with enterprise documentation standards (e.g. Confluence) Soft Skills Selfstarter and quick learner Strong sense of ownership and accountability Ability to work independently in a fastpaced environment Clear communicator with good collaboration skills
Design develop and orchestrate endtoend data pipelines using Microsoft Fabric Build scalable and reusable data frameworks including: o Configdriven pipeline architecture o Centralized configuration tables supporting multiple pipelines Develop and maintain Spark notebooks and pipelines Implement ETLE...
Design develop and orchestrate endtoend data pipelines using Microsoft Fabric Build scalable and reusable data frameworks including: o Configdriven pipeline architecture o Centralized configuration tables supporting multiple pipelines Develop and maintain Spark notebooks and pipelines Implement ETLELT processes using SQL Spark and Python Perform data modeling and transformations for analytics and reporting Collaborate with architectural and engineering teams to design robust solutions Ensure adherence to enterprise standards including: o Confluence documentation o CICD pipelines o Code quality and deployment guidelines Support deployments across multiple client environments Own deliverables endtoend with minimal supervision Required Skills Experience MustHave 5 years of experience as a Data Engineer Strong experience with Microsoft Fabric (2 years of work experience in Fabric) o OR strong background in Azure Synapse Analytics with Azure data services (ADF Databricks Delta tables etc.) o Good to have Fabric certified candidates Handson experience with: o SQL o Data Modeling o ETL ELT Pipelines Experience with Spark notebooks and pipelines or Python experience for data engineering use cases Create Semantic models and generate BI reports Proven ability to design and orchestrate scalable data solutions Experience working in environments with CICD processes for deployments NicetoHave Experience building generic or reusable data frameworks Familiarity with enterprise documentation standards (e.g. Confluence) Soft Skills Selfstarter and quick learner Strong sense of ownership and accountability Ability to work independently in a fastpaced environment Clear communicator with good collaboration skills