Engineer Kafka

Bangalore - India

Monthly Salary: Not Disclosed

Experience Required: 5-8years

Posted on: 30+ days ago

Vacancies: 1 Vacancy

Job Summary

Job Title: Engineer - Kafka

Location: CHENNAI PUNE HYDERABAD KOLKATA BANGALORE PAN India

Job description: must have

Cluster Management:

Install configure and maintain Confluent and AWS MSK Kafka clusters.

Manage large-scale multi-node Kafka cluster environments (on-prem and cloud).

Troubleshoot and resolve issues related to Kafka brokers topics and data flow.

Optimize Kafka configurations for performance scalability and fault tolerance.

Plan and execute Kafka version upgrades and apply patches.

Develop and maintain disaster recovery plans.

Create and maintain documentation.

Security:

Implement and manage security protocols.

Performance and Monitoring:

Monitor Kafka clusters to ensure optimal performance and availability.

Collect and maintain performance metrics.

Fine-tune Kafka configurations based on performance data.

Collaboration:

Provide guidance and support to developers using Kafka.

Automation:

Automate Kafka Cluster installations and topics/acls/connectors deployments using tools like Ansible terraform gitops.

Develop and maintain automation for Kafka infrastructure.

Skills and Experience:

Kafka Administration

Strong understanding of Kafka architecture concepts and best practices.

Proven experience in administering Confluent platform Brokers Zookeepers Schema registry Restproxy Ksql Connectors and Control Center Topics ACLs etc.

Experience in administering and supporting AWS MSK Clusters.

Experience with Kafka AdminClient for managing topics programmatically.

Technical Skills:

Experience with monitoring and alerting tools like Prometheus Grafana Alertmanager Dynatrace etc.

Experience with Linux/Unix operating systems.

Knowledge of software containerization and Kubernetes.

Experience with scripting languages (Python Shell).

Automate installations and deployments using tools like Ansible gitops terraform etc.

Experience with GitLab pipeline.

Knowledge of Service-Now JIRA software.

Good to have:

Strong troubleshooting skills.

Excellent communication and collaboration skills.

Ability to work as part of a team and independently.

Experience in providing enhanced support to application teams.

BigData and Hadoop Ecosystems~Digital : Apache Spark~Digital : Kafka Experience Range in Required Skills: 6 - 8yrs //Considerable: Overall 5+ yrs Kafka admin - min 2.5yrs

Education

Job Title: Engineer - KafkaLocation: CHENNAI PUNE HYDERABAD KOLKATA BANGALORE PAN IndiaJob description: must have Cluster Management:Install configure and maintain Confluent and AWS MSK Kafka clusters.Manage large-scale multi-node Kafka cluster environments (on-prem and cloud).Troubleshoot and re...