Job Title: Developer (Cloud and Airflow)
Location: Minneapolis MN (Remote)
Duration: 6 months with possible extension
Skill (Primary): Microsoft Dynamics (APPS)Microsoft AzureTools and StandardsAzure DevOps
Job Details:
Cloud & Data Pipeline Development:
- Design develop and deploy scalable cloudbased applications and data pipelines using Azure services (Azure Data Factory Azure Functions Azure Kubernetes Service etc.).
- Implement Apache Airflow DAGs for scheduling and orchestrating complex data workflows.
- Optimize data extraction transformation and loading (ETL/ELT) processes for high performance.
- Ensure fault tolerance scalability and monitoring of cloudbased applications.
Airflow Workflow Orchestration:
- Develop and manage Apache Airflow DAGs to automate data workflows.
- Integrate Airflow with Azure Data Services SQL and cloud storage.
- Monitor troubleshoot and optimize Airflow performance and dependencies.
DevOps & CI/CD Automation:
- Implement CI/CD pipelines using Azure DevOps GitHub Actions or Jenkins for automated deployments.
- Manage infrastructure as code (IaC) using Terraform ARM templates or Bicep.
- Automate cloud resource provisioning and application deployments.
- Ensure logging monitoring and alerting using Azure Monitor Application Insights or Prometheus.
Security & Compliance:
- Implement rolebased access control (RBAC) encryption and cloud security best practices.
- Ensure compliance with industry security standards (ISO SOC GDPR).
- Optimize cost and resource utilization across cloud environments.