OSS Infrastructure & Apache Kafka- Senior Developer

Position Description:

Company Profile:
Founded in 1976 CGI is among the largest independent IT and business consulting services firms in the world. With 94000 consultants and professionals across the globe CGI delivers an end-to-end portfolio of capabilities from strategic IT and business consulting to systems integration managed IT and business process services and intellectual property solutions. CGI works with clients through a local relationship model complemented by a global delivery network that helps clients digitally transform their organizations and accelerate results. CGI Fiscal 2024 reported revenue is CA$14.68 billion and CGI shares are listed on the TSX (GIB.A) and the NYSE (GIB). Learn more at .

Job Title: OSS Infrastructure & Apache Kafka- Senior Developer

Position: Senior Systems Engineer

Experience: 5 yrs

Category: IT Infrastructure

Main location: Hyderabad -

Position ID: J0626-0615
Employment Type: Full Time

Qualification: Bachelors degree in Computer Science or related field or higher with minimum 3 years of relevant experience.

Job Description:
Apache Kafka Architecture & Deployment

. Design and deploy multi-broker Apache Kafka clusters for high-throughput low-latency financial messaging pipelines
. Implement geo-redundant and multi-datacenter Kafka topologies using MirrorMaker 2 or Confluent Replicator
. Configure KRaft mode (ZooKeeper-free) deployments and manage migration from ZooKeeper-based clusters
. Define and enforce topic partitioning strategies replication factors and retention policies aligned with data governance requirements
. Tune JVM heap settings OS-level I/O parameters and network buffers for optimal broker performance


Resiliency & High Availability

. Implement fault-tolerant cluster configurations with appropriate ISR (In-Sync Replica) thresholds and unclean leader election policies
. Design and test disaster recovery (DR) runbooks including broker failure rack failure and full-datacenter failover scenarios
. Configure Kafka consumer group rebalancing strategies to minimize consumer lag during rolling restarts and upgrades
. Establish lag monitoring dead-letter queue (DLQ) patterns and automated alerting using Prometheus Grafana or Datadog
. Perform capacity planning and load testing to ensure SLA adherence under peak financial transaction volumes


Security & Compliance

. Configure end-to-end TLS/mTLS encryption for inter-broker and client-to-broker communication
. Implement SASL authentication (Kerberos/GSSAPI SCRAM-SHA-512 OAuth/OIDC) and fine-grained ACL authorization
. Apply network segmentation firewall rules and broker listener isolation for financial-grade zero-trust architectures
. Ensure compliance with financial regulations including PCI-DSS SOX GDPR and FINRA data handling requirements
. Integrate Kafka with enterprise secret management solutions (HashiCorp Vault CyberArk) for credential rotation
. Conduct security audits of Kafka configurations and remediate findings in line with CIS Benchmarks and DORA/NIST frameworks


Open Source Ecosystem & Integration

. Install configure and manage the broader OSS data platform stack including:
. Apache Zookeeper / KRaft
. Kafka Connect (source & sink connectors for databases S3 Elasticsearch)
. Kafka Streams and/or Apache Flink for real-time stream processing
. Schema Registry (Confluent or Apicurio) for Avro/Protobuf/JSON Schema enforcement
. Automate infrastructure provisioning using Ansible Terraform or Helm for Kubernetes-based deployments
. Integrate Kafka with CI/CD pipelines and support blue/green and canary deployment models


Operations & Governance

. Establish and maintain runbooks architecture decision records (ADRs) and operational documentation
. Participate in on-call rotation and provide Level 3 support for production Kafka incidents
. Collaborate with application development security and compliance teams to define producer/consumer contracts and SLAs
. Conduct code and configuration reviews; mentor junior engineers on OSS best practices



Experience

. 7 years of professional software engineering experience in enterprise or financial services environments
. 5 years of hands-on Apache Kafka administration deployment and performance tuning in production
. Demonstrated experience deploying OSS platforms at scale within regulated industries (banking capital markets insurance or payments)
. Proven track record of implementing Kafka security hardening (TLS SASL ACLs) in PCI-DSS or SOX-compliant environments


Technical Skills

. Apache Kafka: broker configuration topic management consumer group internals log compaction quotas
. Security: mTLS SASL/GSSAPI (Kerberos) SCRAM OAuth 2.0 PKI certificate lifecycle management
. Infrastructure as Code: Ansible Terraform Helm or equivalent
. Container orchestration: Kubernetes (Strimzi Kafka Operator experience a strong plus)
. Monitoring & observability: Prometheus JMX Exporter Grafana ELK/OpenSearch or Splunk
. Linux systems administration: RHEL/CentOS/Ubuntu kernel tuning systemd network configuration
. Programming/scripting: Python Bash or Java (for Kafka Streams / custom connectors)
. Source control and DevOps: Git Jenkins GitLab CI or GitHub Actions


Knowledge Areas

. Distributed systems fundamentals: consensus algorithms CAP theorem exactly-once semantics (EOS)
. Financial messaging standards and protocols (FIX SWIFT ISO 20022) familiarity preferred
. Data governance concepts: schema evolution data lineage retention and archival policies
. Network security in financial environments: DMZ architecture bastion hosts private endpoints


PREFERRED QUALIFICATIONS

. Confluent Certified Administrator for Apache Kafka (CCAAK) or equivalent certification
. Experience with Confluent Platform (Control Center Schema Registry ksqlDB) in an enterprise context
. Familiarity with additional OSS data platforms: Apache Flink Apache Spark Apache Pulsar
. Experience with financial cloud environments: AWS GovCloud Azure Financial Services or on-premises private cloud
. Knowledge of FIPS 140-2 compliant cryptographic modules for federal or regulated deployments
. Prior engagement with outsourced/staff-augmentation delivery models in financial sector programs


PROFESSIONAL COMPETENCIES

. Strong written and verbal communication skills; ability to present technical architecture to non-technical stakeholders
. Self-directed and capable of delivering with minimal oversight in a fast-paced matrixed organization
. Analytical problem-solver with a disciplined approach to root-cause analysis and post-incident reviews
. Collaborative team player with experience working across engineering security compliance and operations functions
Life at CGI:
It is rooted in ownership teamwork respect and belonging. Here youll reach your full potential because
You are invited to be an owner from day 1 as we work together to bring our Dream to life. Thats why we call ourselves CGI Partners rather than employees. We benefit from our collective success and actively shape our companys strategy and direction
Your work creates value. Youll develop innovative solutions and build relationships with teammates and clients while accessing global capabilities to scale your ideas embrace new opportunities and benefit from expansive industry and technology expertise
Youll shape your career by joining a company built to grow and last. Youll be supported by leaders who care about your health and well-being and provide you with opportunities to deepen your skills and broaden your horizons
Come join our team one of the largest IT and business consulting services firms in the world

Skills:

• Ansible
• Apache Kafka
• English
• Helm
• Java
• Terraform

What you can expect from us:

Together as owners lets turn meaningful insights into action.

Life at CGI is rooted in ownership teamwork respect and belonging. Here youll reach your full potential because

You are invited to be an owner from day 1 as we work together to bring our Dream to life. Thats why we call ourselves CGI Partners rather than employees. We benefit from our collective success and actively shape our companys strategy and direction.

Your work creates value. Youll develop innovative solutions and build relationships with teammates and clients while accessing global capabilities to scale your ideas embrace new opportunities and benefit from expansive industry and technology expertise.

Youll shape your career by joining a company built to grow and last. Youll be supported by leaders who care about your health and well-being and provide you with opportunities to deepen your skills and broaden your horizons.

That same commitment to fairness extends to how we use technology. To support our recruitment team AI tools may be used to help assess applications though they never replace human judgement. All hiring decisions remain entirely in the hands of our recruitment professionals.

Come join our teamone of the largest IT and business consulting services firms in the world.