Senior Cloud Data Engineer – IPaaS & Event-Driven Platform Engineering
Rock Island County, IL - USA
Job Summary
This is a remote position.
We are seeking a highly skilled and experienced Senior Cloud Data Engineer to design develop and support enterprise-scale iPaaS and event-driven data integration platforms on Microsoft Azure.
This role will focus on building scalable metadata-driven and cloud-native integration frameworks supporting enterprise data movement API orchestration event processing and operational workflows across distributed systems.
The ideal candidate will have strong hands-on experience implementing Azure-based iPaaS architectures event-driven integration patterns containerized applications and modern orchestration frameworks involving AKS messaging platforms Snowflake and Astronomer Airflow.
Job Duties
Design and develop cloud-native iPaaS integration frameworks on Azure
Implement reusable inbound outbound and feedback-driven integration services
Build scalable API orchestration and event-processing frameworks
Develop canonical integration patterns and standardized payload models
Implement event-driven architectures using Logic Apps Azure Service Bus Event Grid or Kafka
Develop retry replay dead-letter and idempotency frameworks
Build containerized microservices using Python and Kubernetes-based deployment patterns
Develop scalable AKS-hosted integration applications
Build REST APIs and integration services
Build and support workflow orchestration frameworks using Astronomer Airflow / Apache Airflow
Develop metadata-driven pipeline orchestration frameworks
Develop Snowflake integration workflows and operational frameworks
Develop Cosmos DB integration services and operational frameworks
Implement centralized logging audit and operational monitoring frameworks
Must Have Qualifications
58 years of experience in Cloud Data Engineering Integration Engineering or Distributed Systems development
Strong hands-on expertise with Microsoft Azure cloud services
Strong experience implementing enterprise integration platforms and event-driven workflows
Hands-on experience with Azure Service Bus Event Grid messaging and asynchronous processing
Strong understanding of retry frameworks replay mechanisms dead-letter handling and idempotency
Strong experience with Kubernetes and Azure Kubernetes Service (AKS)
Hands-on expertise with Docker containerization
Strong Python development experience
Experience building REST APIs and event-processing applications
Strong hands-on experience with Astronomer Airflow / Apache Airflow
Hands-on experience integrating enterprise data platforms with Snowflake
Familiarity with deploying applications using Helm Charts and Kubernetes manifests
Familiarity with CI/CD pipelines and cloud-native deployment practices
Good to Have Qualifications
Familiarity with Terraform or Infrastructure as Code concepts
Exposure to Azure Key Vault and secure secret consumption patterns
Familiarity with Kafka and real-time streaming architectures
Exposure to metadata-driven orchestration or integration frameworks
Experience with monitoring platforms such as Azure Monitor App Insights Grafana or Prometheus
Familiarity with AI-assisted workflow orchestration or agentic execution frameworks
Experience with GitOps Ansible ARM Templates or Bicep
Azure Kubernetes or Snowflake certifications
Preferred Technical Stack
Cloud | Azure |
Container Platform | AKS Docker |
Integration & Messaging | Logic Apps Azure Service Bus Event Grid Kafka |
Orchestration | Astronomer Airflow Apache Airflow |
Data Platform | Snowflake CosmosDB |
Deployment | Helm Charts Kubernetes YAML |
CI/CD | Azure DevOps GitHub Actions |
Programming | Python Bash |
Monitoring | Azure Monitor App Insights Grafana |