Kafka Flink Engineer

Role: Kafka Flink Engineer
Location: Melbourne VIC
Experience: 7 yrs
Job Type: Permanent

Key Responsibilities

• Develop custom integration code using Java / Spring Boot for source system connectivity where managed connectors are not applicable.
• Build and maintain Kafka producers and consumers topic integration logic and event-driven services on Confluent Cloud / NGIP.
• Develop and maintain Flink SQL / stream processing logic for transformation enrichment validation routing and de-duplication.
• Implement integration with Schema Registry topic schemas and message validation controls.
• Support HTTP / API-based integrations through Kong Gateway for NGIP to target application communication.
• Configure and support HTTP Sink delivery patterns including payload mapping retries and failure handling.
• Troubleshoot and resolve integration streaming and message-delivery issues in collaboration with platform and application teams.
• Document integration designs schemas and operational procedures and contribute to team standards and best practices.

Must-Have Skills

• Java / Spring Boot development for custom source-system integration.
• Kafka producer / consumer development and topic integration logic on Confluent Cloud / NGIP.
• Flink SQL / stream processing for transformation enrichment validation routing and de-duplication.
• Schema Registry integration topic schema management and message validation controls.
• HTTP / API-based integration via Kong Gateway (NGIP to target application communication).
• HTTP Sink configuration and support: payload mapping retries and failure handling.