Key Responsibilities
- Stream Application Development: Design and develop high-throughput low-latency and highly available stream processing applications using Java/Python and the Apache Flink DataStream API.
- State Management & Fault Tolerance: Implement reliable state management leveraging Flinks checkpointing and save point mechanisms to ensure exactly once processing semantics and disaster recovery.
- Messaging Integration: Integrate Flink applications with real-time messaging platforms primarily Apache Kafka for both consuming and producing data streams.
- Performance Tuning: Monitor troubleshoot and optimize Flink jobs for performance memory and latency including fine-tuning watermarks and windowing strategies.
Required Qualifications & Skills
- 5 years of software engineering experience with 3 years focusing on stream processing.
- Python with solid experience developing enterprise-level applications.
- Deep hands-on production experience with Apache Flink (DataStream API Windowing State Processors).
- Solid knowledge of Apache Kafka or other streaming/messaging platforms.
- Strong understanding of distributed system concepts including consistency models event time vs. processing time and stateful stream processing.
Experience with
AWS and its relevant big data services.
Key Responsibilities Stream Application Development: Design and develop high-throughput low-latency and highly available stream processing applications using Java/Python and the Apache Flink DataStream API. State Management & Fault Tolerance: Implement reliable state management leveraging Flinks ...
Key Responsibilities
- Stream Application Development: Design and develop high-throughput low-latency and highly available stream processing applications using Java/Python and the Apache Flink DataStream API.
- State Management & Fault Tolerance: Implement reliable state management leveraging Flinks checkpointing and save point mechanisms to ensure exactly once processing semantics and disaster recovery.
- Messaging Integration: Integrate Flink applications with real-time messaging platforms primarily Apache Kafka for both consuming and producing data streams.
- Performance Tuning: Monitor troubleshoot and optimize Flink jobs for performance memory and latency including fine-tuning watermarks and windowing strategies.
Required Qualifications & Skills
- 5 years of software engineering experience with 3 years focusing on stream processing.
- Python with solid experience developing enterprise-level applications.
- Deep hands-on production experience with Apache Flink (DataStream API Windowing State Processors).
- Solid knowledge of Apache Kafka or other streaming/messaging platforms.
- Strong understanding of distributed system concepts including consistency models event time vs. processing time and stateful stream processing.
Experience with
AWS and its relevant big data services.
View more
View less