Sovereign AI Platform Engineer (DevOps Engineer) (mfd)
Job Summary
Purpose
Design build and operate a sovereign AI toolchain used in isolated or tightly controlled environments including model serving retrieval orchestration observability and secure platform operations for enterprise AI engineering workloads
Role focus
This role centers on open-source or open-weight LLM stacks air-gapped or isolated deployment models Kubernetes-based platform engineering GPU-enabled environments and auditable AI operations suitable for sovereignty-sensitive programs
WHAT WILL YOU DO
- Design and run Kubernetes environments optimized for AI inference retrieval experimentation and agent execution in secure or isolated settings
- Deploy and operate open-source or open-weight model stacks model gateways vector databases and supporting platform components
- Build reproducible platform automation using Infrastructure as Code and GitOps approaches for stable auditable delivery
- Manage local registries package mirrors secrets access controls storage networking and observability in environments with limited or no public cloud dependency.
- Optimize GPU compute and storage usage for reliable AI workloads while maintaining security and data sovereignty requirements. Examples of market tools models and platform components expected
- Inference and local serving stacks such as vLLM Ollama or OpenAI-compatible self-hosted endpoints.
- Open-source or open-weight models appropriate for sovereign deployment for example coding-capable and general-purpose families hosted internally through approved serving layers.
- Platform tooling such as Kubernetes Helm Terraform Ansible ArgoCD private registries Qdrant or similar vector stores and Open WebUI or comparable internal interfaces.
- Developer-facing integration options such as VS Code-compatible extensions Continue-style local model connectors or editor integrations pointed at internal APIs instead of external SaaS endpoints.
- Hardware awareness covering GPU-backed nodes CPU-only fallback options storage performance network isolation and on-prem or dedicated infrastructure patterns.
Qualifications :
YOU WILL SUCCEED IF YOU:
- Have 5 years in platform engineering DevOps SRE or MLOps with strong Kubernetes and Linux expertise
- Have proven experience with AI infrastructure model serving private or on-prem deployments and production operations for LLM-based workloads.
- Have strong hands-on skills in Python plus automation tooling such as Terraform Ansible Helm and GitOps workflows.
- Have good understanding of networking storage access control monitoring and operational hardening in high-security environments.
- Are comfortable working in sovereignty-driven environments where auditability isolation and controlled data handling are mandatory.
Additional Information :
WHY SHOULD YOU CHOOSE US
We believe in balance between work and personal life. An attractive and extensive work-life balance portfolio guarantees lasting motivation for employees and thus a better quality of life promotes physical and mental well-being and contributes to a positive work environment. All this with the aim of providing more freedom in reconciling work career growth private life and individual lifestyle. Therefore we offer to our employees over 25 different benefits to improve their personal and professional life in these areas:
- Financial benefits
- Benefits with focus on learning and development
- Benefits with focus on health and sport
- Benefits with focus on family and work life balance
- Other benefits
For more information about our benefits click to Benefits
Salary
Final salary is negotiable.
We are offering base salary depending on seniority level and previous experience of addition to base salary we provide variable part and other financial benefits. Base salary will not be lower than 2100 /brutto.
Additional information
* Please be informed that our remote working possibility is only available within Slovakia due to European taxation regulation.
Remote Work :
No
Employment Type :
Full-time
About Company
Our brand Deutsche Telekom IT Solutions Slovakia entered the life of Košice region in 2006 under the name of T-Systems Slovakia and ever since has been inextricably linked with the region when became one of the founding members of Košice IT Valley. We have managed to grow from scratch ... View more