Azure Data Engineer with AI. - Remote
Key Responsibilities:
Design develop and optimize scalable ETL/ELT pipelines using Azure Data Factory Databricks and Synapse Analytics
Build and manage data lakes and Delta Lake architectures for both batch and real-time processing
Integrate AI/ML models (developed by data scientists) into production pipelines for energy forecasting anomaly detection and smart grid analytics
Collaborate with AI/ML teams to ensure robust data availability for model training and inference
Leverage Azure Machine Learning and Cognitive Services to enable intelligent data workflows
Implement data governance data quality checks and lineage tracking using tools like Purview
Optimize query performance and cost management within Azure environments
Maintain CI/CD pipelines and automation using Azure DevOps or GitHub Actions