We are seeking a highly skilled Real-Time Data Streaming Engineer to join a dynamic team supporting one of Randstads premier clients in Washington DC. This role requires deep experience in building and managing event-driven architectures and real-time data pipelines using modern streaming and orchestration tools. The ideal candidate has a passion for distributed systems excels in handling high-throughput data pipelines and is comfortable working across cloud-native environments with a focus on performance security and scalability.
Key Responsibilities:
Design build and maintain real-time data pipelines using Apache Kafka Amazon MSK Kafka Streams and Kafka Connect
Implement and optimize stream processing solutions using Apache Flink Spark Streaming or similar frameworks
Manage data workflows and orchestration using Apache NiFi and Apache Airflow
Administer and integrate messaging platforms such as MQ and Pub/Sub systems to support event-driven microservices
Architect and support scalable cloud-native streaming infrastructure across AWS GCP or Azure environments
Implement best practices for schema evolution data governance and secure data processing
Collaborate with cross-functional engineering teams to develop event-based microservices and integrations
Troubleshoot and resolve issues related to stream processing performance and reliability
Contribute to the continuous improvement of infrastructure deployment automation and monitoring solutions
Stay current on emerging technologies and help drive innovation in real-time data architecture and tooling
Required Skills : Data Analysis
Basic Qualification :
Additional Skills :
This is a high PRIORITY requisition. This is a PROACTIVE requisition
Background Check : No
Drug Screen : No
We are seeking a highly skilled Real-Time Data Streaming Engineer to join a dynamic team supporting one of Randstads premier clients in Washington DC. This role requires deep experience in building and managing event-driven architectures and real-time data pipelines using modern streaming and orches...
We are seeking a highly skilled Real-Time Data Streaming Engineer to join a dynamic team supporting one of Randstads premier clients in Washington DC. This role requires deep experience in building and managing event-driven architectures and real-time data pipelines using modern streaming and orchestration tools. The ideal candidate has a passion for distributed systems excels in handling high-throughput data pipelines and is comfortable working across cloud-native environments with a focus on performance security and scalability.
Key Responsibilities:
Design build and maintain real-time data pipelines using Apache Kafka Amazon MSK Kafka Streams and Kafka Connect
Implement and optimize stream processing solutions using Apache Flink Spark Streaming or similar frameworks
Manage data workflows and orchestration using Apache NiFi and Apache Airflow
Administer and integrate messaging platforms such as MQ and Pub/Sub systems to support event-driven microservices
Architect and support scalable cloud-native streaming infrastructure across AWS GCP or Azure environments
Implement best practices for schema evolution data governance and secure data processing
Collaborate with cross-functional engineering teams to develop event-based microservices and integrations
Troubleshoot and resolve issues related to stream processing performance and reliability
Contribute to the continuous improvement of infrastructure deployment automation and monitoring solutions
Stay current on emerging technologies and help drive innovation in real-time data architecture and tooling
Required Skills : Data Analysis
Basic Qualification :
Additional Skills :
This is a high PRIORITY requisition. This is a PROACTIVE requisition
Background Check : No
Drug Screen : No
View more
View less