Kafka ArchitectRaleigh NC - Hybrid

Role: Kafka Architect
Years of Experience: 12 years
Location: hybrid (Raleigh NC)


Job description:
Seasoned messaging expert with established track record with Kafka technology with handson production experience and a deep understanding of the Kafka architecture and internals of how it works along with interplay of architectural components: brokers Zookeeper producers/consumers Kafka Connect Kafka Streams
Knowledge of Building Kafka ecosystem by creating a framework for leveraging technologies such as Kafka Connect Streams/KSQL Schema Registry and other streamingoriented technology.
Strong fundamentals in Kafka administration configuration and troubleshooting
Mandatory experience implementing Kafka Multi Region Cluster (MRC) architecture.
Experience enabling observability on Kafka cluster through Datadog
Knowledge of Kafka clustering and its faulttolerance model supporting HA and DR
Practical experience with how to scale Kafka Streams and Connector infrastructures with the motivation to build efficient platforms.
Best practices to optimize the Kafka ecosystem based on usecase and workload e.g. how to effectively use topic partitions and consumer groups to provide optimal routing and support of QOS.
Experience with Kafka Streams / KSQL architecture and associated clustering mode.
Deep understanding of different messaging paradigms (pub/sub queuing) as well as delivery models qualityofservice and faulttolerance architectures
Experience analyzing production issues with authentication consumer rebalancing and latency variation as well as any others that are encountered.
Experience with nodowntime Kafka infrastructure upgrades
Experience Benchmarking existing and potential infrastructure options to provide a scaleout plan.
Strong knowledge of the Kafka Connect framework with experience using several connector types: HTTP REST proxy JMS File SFTP JDBC Splunk Salesforce and how to support wireformat translations. Knowledge of connectors available from Confluent and the community
Handson experience in designing writing and operationalizing new Kafka Connectors using the framework.
Strong familiarity of wire formats such as XML JSON Avro CSV etc. along with serialization/deserialization options Knowledge of messaging protocols and associated APIs
Strong background in integration