Azure Data Engineer â Databricks & Microsoft Fabric Specialist
Azure Data Engineer â Databricks & Microsoft Fabric Specialist
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Not Disclosed
Salary Not Disclosed
1 Vacancy
Job Description
Job Title: Azure Data Engineer Databricks & Microsoft Fabric Specialist
Location: Atlanta Georgia(Hybrid)
We are currently seeking candidates who meet the following qualification
Required Qualifications:- Bachelors degree in Computer Science Data Engineering or a related field.
- Minimum 3 years of experience in data engineering or analytics engineering.
- Proficient in advanced SQL for data transformation optimization and querying.
- Hands-on experience with:
- Azure Databricks (Spark Delta Lake)
- Microsoft Fabric (Dataflows Pipelines OneLake)
- SQL and Python (including Pandas and PySpark)
- SQL Server 2019
- Solid understanding of:
- ETL/ELT processes
- Data quality frameworks
- Schema design and dimensional modeling
- Data governance and security best practices
- Experience working with Power BI datasets and semantic modeling.
- Familiarity with Microsoft Purview Unity Catalog or other data governance tools.
- Exposure to real-time data processing and streaming architecture.
- Understanding of federal/state compliance requirements for data handling.
- Experience with Azure DevOps Terraform or CI/CD pipeline automation.
- Microsoft Fabric Analytics Engineer certification is a plus.
- Develop and maintain robust ETL/ELT pipelines using Azure Databricks and Microsoft Fabric.
- Utilize the medallion architecture (Bronze Silver Gold) for structured data flow.
- Build real-time and batch data ingestion solutions from IES Gateway and other systems.
- Ensure high data quality validation and consistent transformation logic.
- Write efficient Spark and SQL code using Databricks/Fabric notebooks.
- Leverage Delta Lake for versioning ACID transactions and schema enforcement.
- Integrate data pipelines with Azure services such as OneLake ADLS Gen2.
- Design dimensional and real-time data models in collaboration with Domain Owners.
- Create analytics-ready datasets for Power BI and other reporting needs.
- Standardize schema definitions and field naming conventions.
- Implement data classification and tagging per DECALs governance framework.
- Apply row-level security data masking and audit logging.
- Support metadata and lineage tracking through Microsoft Purview.
- Partner with BI developers to optimize data models for Power BI reporting.
- Deliver curated datasets aligned with business logic.
- Create and support BI dashboards; provide training for end users.
- Support CI/CD processes for data pipelines using Azure DevOps.
- Monitor data workflows log issues and fine-tune job and cluster performance.
Soft Skills: - Strong analytical and problem-solving skills.
- Excellent verbal and written communication for both technical and non-technical audiences.
- Experience collaborating with government stakeholders is highly desirable.
If you meet these qualifications please submit your application via link provided in Linkedin.
Kindly do not call the general line to submit your application.
Employment Type
Full-time
