Senior Cloud Data Engineer – IPaaS & Event-Driven Platform Engineering

Blackbuck Insights


Job Location:

Rock Island County, IL - USA

Monthly Salary: Not Disclosed
Experience Required: 5-10years
Posted on: 30+ days ago
Vacancies: 1 Vacancy

Job Summary

This is a remote position.

We are seeking a highly skilled and experienced Senior Cloud Data Engineer to design develop and support enterprise-scale iPaaS and event-driven data integration platforms on Microsoft Azure.

This role will focus on building scalable metadata-driven and cloud-native integration frameworks supporting enterprise data movement API orchestration event processing and operational workflows across distributed systems.

The ideal candidate will have strong hands-on experience implementing Azure-based iPaaS architectures event-driven integration patterns containerized applications and modern orchestration frameworks involving AKS messaging platforms Snowflake and Astronomer Airflow.

Job Duties

Design and develop cloud-native iPaaS integration frameworks on Azure

Implement reusable inbound outbound and feedback-driven integration services

Build scalable API orchestration and event-processing frameworks

Develop canonical integration patterns and standardized payload models

Implement event-driven architectures using Logic Apps Azure Service Bus Event Grid or Kafka

Develop retry replay dead-letter and idempotency frameworks

Build containerized microservices using Python and Kubernetes-based deployment patterns

Develop scalable AKS-hosted integration applications

Build REST APIs and integration services

Build and support workflow orchestration frameworks using Astronomer Airflow / Apache Airflow

Develop metadata-driven pipeline orchestration frameworks

Develop Snowflake integration workflows and operational frameworks

Develop Cosmos DB integration services and operational frameworks

Implement centralized logging audit and operational monitoring frameworks


Must Have Qualifications

58 years of experience in Cloud Data Engineering Integration Engineering or Distributed Systems development

Strong hands-on expertise with Microsoft Azure cloud services

Strong experience implementing enterprise integration platforms and event-driven workflows

Hands-on experience with Azure Service Bus Event Grid messaging and asynchronous processing

Strong understanding of retry frameworks replay mechanisms dead-letter handling and idempotency

Strong experience with Kubernetes and Azure Kubernetes Service (AKS)

Hands-on expertise with Docker containerization

Strong Python development experience

Experience building REST APIs and event-processing applications

Strong hands-on experience with Astronomer Airflow / Apache Airflow

Hands-on experience integrating enterprise data platforms with Snowflake

Familiarity with deploying applications using Helm Charts and Kubernetes manifests

Familiarity with CI/CD pipelines and cloud-native deployment practices


Good to Have Qualifications

Familiarity with Terraform or Infrastructure as Code concepts

Exposure to Azure Key Vault and secure secret consumption patterns

Familiarity with Kafka and real-time streaming architectures

Exposure to metadata-driven orchestration or integration frameworks

Experience with monitoring platforms such as Azure Monitor App Insights Grafana or Prometheus

Familiarity with AI-assisted workflow orchestration or agentic execution frameworks

Experience with GitOps Ansible ARM Templates or Bicep

Azure Kubernetes or Snowflake certifications

Preferred Technical Stack

Cloud

Azure

Container Platform

AKS Docker

Integration & Messaging

Logic Apps Azure Service Bus Event Grid Kafka

Orchestration

Astronomer Airflow Apache Airflow

Data Platform

Snowflake CosmosDB

Deployment

Helm Charts Kubernetes YAML

CI/CD

Azure DevOps GitHub Actions

Programming

Python Bash

Monitoring

Azure Monitor App Insights Grafana




This is a remote position.We are seeking a highly skilled and experienced Senior Cloud Data Engineer to design develop and support enterprise-scale iPaaS and event-driven data integration platforms on Microsoft Azure. This role will focus on building scalable metadata-driven and cloud-native int...