Kafka Migration engineer ( .NET + Kafka)

Kafka Migration Engineer (.NET Kafka)

Location: London

Duration: 4 months

Note: This role requires skills in addition to Kafka expertise. All producers and consumers applications APIs produce messages and some services both consume and produce. This is not an infrastructure-only Kafka role; it requires reading modifying and Kafka client code.

Responsibilities

Migrate all Kafka producers and consumers from Kafka to Confluent Cloud

client configuration (SASL auth Schema Registry bootstrap servers)

Validate message flows end-to-end for apps acting as both producer and consumer

Ensure consumer group configurations offset management and error handling are correct post-migration

Kafka throughput validation and performance testing

Work engineers to resolve application-level Kafka integration issues

Required Skills

C# / .NET strong coding ability (reading and modifying producer/consumer code)

.NET client library (ProducerBuilder ConsumerBuilder configuration)

Confluent Cloud SASL/PLAIN authentication Schema Registry ACLs

Kafka internals: topics partitions consumer groups offset management rebalancing

Message serialization (Avro JSON Schema) -specific serializers/deserializers

Troubleshooting Kafka connectivity and message flow issues applications

Kafka monitoring (consumer lag throughput error rates)

Nice to Have

Experience with apps that are both consumers and producers (event-driven architectures)

Schema evolution and compatibility strategies in Schema Registry

Performance tuning (batch size compression) producers

Kafka Connect and MirrorMaker for migration scenari