Kubernetes Principal Engineer Architect

COMPANY OVERVIEW

XCEL Engineering Inc. is an award-winning small business that provides trusted information technology engineering consulting and project management solutions and services to federal agencies and organizations. Originally founded in 1971 by professional engineers at the University of Tennessee XCEL was acquired in 2003 by U.S. Army and Navy veterans and in 2023 became a MartinFed company.

XCEL Engineering is a part of IT Lab Partners (ITLP) which was created to support a leading research facility in the East Tennessee region in recruiting the best and the brightest technical talent. Considering joining our impressive team today!

JOB OVERVIEW

XCEL Engineering is seeking a qualified applicant for a Kubernetes Principal Engineer/ Architect. As a Platform Engineer you will architect implement and maintain the infrastructure underpinning our on-premises Kubernetes clusters with a strong focus on scalability reliability and maintainability. You will lead the technical direction of our platform engineering initiatives evaluate and integrate key technologies and deliver a robust internal platform that powers development across the organization.

ESSENTIAL FUNCTIONS

• Platform Architecture & Implementation
  • Lead the design and technical implementation of on-premises Kubernetes clusters that replace and improve upon features previously provided by OpenShift.
  • Select evaluate and integrate critical components for networking CI/CD tooling OS management service mesh and Kubernetes operators-excluding observability which is handled by a dedicated SRE sub-team.
  • Build test environments to evaluate tooling based on performance feature set and maintainability-especially for components that must work reliably with on-premise hardware and OS requirements.
  • Own upgrades security hardening monitoring integration and scalability of all cluster infrastructure.
• Infrastructure as Code (IaC) & Tooling
  • Write and maintain infrastructure and deployment code using tools such as ArgoCD (GitOps) Puppet (OS management) Go Python Bash and GitLab CI.
  • Support the use and understanding of in-house Kubernetes operators and serve as a secondary maintainer for those controllers.
• Internal Developer Platform & Enablement
  • Collaborate on building a next-generation internal developer platform inspired by tools like Backstage or AWS Proton focused on increasing development efficiency and security.
  • Work with the cybersecurity team to define secure image baselines and automate the patching pipeline for container images and golden base layers.
  • Engage with development teams to understand platform needs and tailor the cluster experience to meet evolving requirements.
• Technical Leadership & Mentorship
  • Provide architectural guidance code reviews and pair programming support to a team of 8-12 engineers.
  • Contribute to onboarding team documentation and process improvement initiatives.
  • Act as a go-to technical expert for all Kubernetes platform questions across the engineering organization.
• Collaboration
  • Partner closely with internal cybersecurity and development teams to ensure the platform meets security compliance and usability expectations.
  • Participate in cross-functional projects related to platform enhancements and cluster lifecycle automation.
  • Be able to represent the Platforms team with vendors and both internal and external collaborators and partners.

Key Technologies & Tools

• Languages: Go Python Bash
• CI/CD: GitLab CI ArgoCD
• IaC/Config Management: Puppet Helm
• Kubernetes & Ecosystem: On-prem K8s Custom Operators Service Mesh
• Operating Systems: Linux-based OS management at the hardware level

• Deep involvement in operating managing and designing on-prem Kubernetes infrastructure with full ownership from OS/hardware layer up to service-level automation.
• A platform-first approach to engineering that balances security developer experience and operational scalability.
• Strong mentorship and team enablement focus-guiding engineers while staying hands-on with operations architecture and implementation.

BASIC QUALIFICATIONS

• Bachelors Degree in computer science or closely related field and a minimum of 8 years as a Platforms engineer. At least 5 years of Kubernetes experience. An equivalent combination of education and experience may be considered.
• The ability to obtain and maintain a Department of Energy Q clearance is required. This requires US Citizenship.

DESIRED QUALIFICATIONS

• Excellent interpersonal/communication skills and the ability to work as part of a team.
• Strong working knowledge of Unix system fundamentals and common network protocols.
• Experience managing Linux/UNIX operating systems in a heterogeneous environment.
• Solid understanding of networked computing environment concepts.
• Excellent understanding of networking particularly Linux and Kubernetes networking
• Experience with instrumenting bare metal and VMWare infrastructure
• Ability to develop and maintain programs and scripts that aid in the operation and automation using various shell (primarily bash) and high-level languages (Python or Go).
• Ability to proactively identify performance issues problems and areas for improvement.
• Ability to identify requirements and to define plan and implement requisite solutions.
• Ability to plan organize prioritize tasks and complete assigned projects with minimal supervision.
• Experience with continuous integration and continuous deployment software methodologies
• An understanding of code review and familiarity with tools like GitHub and GitLab
• Experience using tools such as Nagios Grafana and Prometheus to monitor systems metrics and create dashboards.
• Experience designing and implement highly available systems/services utilizing virtual machines and Kubernetes resources.
• Experience participating in an opensource community with patches accepted upstream.
• Experience deploying and maintaining automated configuration management software such as Puppet or Ansible
• Experience implementing systems-level security technologies like SELinux and following security best practices.

PHYSICAL REQUIREMENTS & ENVIRONMENTAL CONDITIONS

• Inside office environment.
• Working on a computer for long periods of time.
• May involve long period of sitting at a desk.
• The work environment is fast-paced and sometimes involves extreme deadline pressures.

OTHER DUTIES

This job description is not designed to cover or contain a comprehensive listing of activities duties or responsibilities that are required of the employee for this job. Duties responsibilities and activities may change at any time with or without notice.

Xcel Engineering is an Equal Opportunity/Affirmative Action Employer. All qualified applicants will receive consideration for employment without regards to race color religion religious creed gender sexual orientation gender identity gender expression transgender pregnancy marital status national origin ancestry citizenship status age disability protected Veteran Status genetics or any other characteristics protected by applicable federal state or local law.

If you are a qualified individual with a disability or disabled veteran you have the right to request a reasonable accommodation if you are unable or limited in your ability to use or access Xcel Engineerings current openings as a result of your disability. You can request reasonable accommodations by calling 855.212.1810. Thank you for your interest in Xcel Engineering.

All positions at Xcel Engineering Inc. are contingent upon passing both a background check and drug screening prior to a start date and are subject to random drug screenings during the employment addition Xcel Engineering is an E-Verify employer.

Required Experience:

Staff IC