DevOps Engineer Ruby

Our client Ruby is looking for DevOps Engineer in Islamabad.

Job Description:
Role Overview

As our DevOps Engineer you will own the infrastructure that powers Ruby AIs products. Youll work closely with backend frontend and AI engineering teams to build reliable secure and scalable systems. This is a hands-on role where youll set up infrastructure from the ground up establish CI/CD practices implement monitoring and ensure our payment and data systems meet security and compliance standards.

Key Responsibilities

Infrastructure Setup & Scaling

• Design provision and manage AWS infrastructure (EC2 ECS/EKS VPC IAM Lambda S3) for all Ruby AI services.
• Implement Infrastructure as Code (IaC) using Terraform CloudFormation or AWS CDK for repeatable version-controlled provisioning.
• Architect auto-scaling strategies to handle variable workloads particularly around LLM API traffic patterns.
• Manage and optimize Cassandra clusters and PostgreSQL (with pgvector) for performance replication and high availability.
  

Security & Compliance

• Harden infrastructure security including network segmentation firewall rules and least-privilege IAM policies.
• Implement secrets management (AWS Secrets Manager HashiCorp Vault or Sealed Secrets) for LLM API keys and payment credentials.
• Ensure PCI-DSS compliance considerations for the payment system including encryption at rest and in transit.
• Conduct regular security audits and vulnerability assessments of deployed infrastructure.

Monitoring & Observability

• Build a comprehensive observability stack (Prometheus Grafana
• ELK/Loki CloudWatch) covering all services and databases.
• Set up alerting for critical metrics: API latency database health
• LLM API error rates cost anomalies and payment system uptime.
• Implement distributed tracing to debug performance issues across microservices.
• Create dashboards for LLM API usage tracking and cost monitoring across OpenAI Gemini and Anthropic.

CI/CD & Deployment Automation

• Design and maintain CI/CD pipelines (GitHub Actions GitLab CI or Jenkins) for backend frontend and AI services.
• Implement blue-green or canary deployment strategies for zero-downtime releases.
• Containerize services using Docker and manage orchestration with Kubernetes or ECS.
• Manage environment separation (development staging production) with automated promotion workflows

Collaboration & Reliability

• Work with backend frontend and AI engineers to establish deployment workflows and release governance.
• Build and maintain disaster recovery plans backup strategies and runbooks for incident response.
• Drive on-call culture and incident management processes as the team scales.
  

Required Qualifications

• 35 years of hands-on DevOps SRE or Infrastructure Engineering experience.
• Strong AWS expertise: VPC EC2 ECS/EKS IAM Lambda CloudWatch S3 RDS.
• Proficiency with Infrastructure as Code: Terraform CloudFormation or AWS CDK.
• Solid experience with Docker and container orchestration (Kubernetes preferred).
• Experience managing relational databases (PostgreSQL) and distributed databases (Cassandra DynamoDB or similar).
• Hands-on experience building CI/CD pipelines with GitHub Actions GitLab CI or Jenkins.
• Strong knowledge of monitoring and logging tools: Prometheus Grafana ELK stack or similar.
• Understanding of networking: VPC design subnetting load balancers DNS and SSL/TLS.
• Familiarity with secrets management and security best practices.
• Strong Linux administration and scripting skills (Bash Python)

Nice to Have

• Experience with pgvector or vector database operations for AI/ML workloads.
• Familiarity with LLM API integration patterns rate limiting and cost optimization.
• Experience with GPU instance management or ML model serving infrastructure.
• Exposure to service mesh technologies (Istio Linkerd).
  
• Experience with payment system infrastructure and PCI-DSS compliance.
• Cassandra cluster management experience (repair compaction replication tuning)

What We Offer

• Work with founders who have seen it all from idea to IPO being early at Snowflake. Built multiple venture backed startups with exits to Snowflake and Private Equity funds.
• The company is backed by tier 1 funds like Flybridge and Inovia Capital.
• Focus on craft: We value curiosity clarity and craft and were looking for engineers who care about solving real problems with elegant reliable code.
• Make an impact: Youll be part of a small team and have an outsized impact.
• Be valued: We offer highly market-competitive compensation