LLMOps Engineer

We are looking for an experiencedSeniorLLMOpsEngineerto design implement andmaintainproduction-grade large-language-model (LLM) pipelines deployment architectures and monitoring systems across enterprise environments. The SeniorLLMOpsEngineer will play a critical role in operationalizing generative AI capabilities ensuring that LLM-based applications are scalable secure reliable and compliant with emerging AI risk and governance frameworks. This role spans the spectrum of model deployment orchestration evaluation and optimization.

• Architect andmaintainscalable LLM and RAG pipelines including model hosting inference optimization retrieval layers and context management frameworks.

• Lead the design and implementation of secure GenAI infrastructure across cloud environments ensuring reliability performance and cost efficiency.

• Build and manage automated evaluation systems that assess LLM output quality safety latency and adherence to AI governance requirements.

• Develop CI/CD workflows tailored for LLM- and GenAI-based applications including dataset versioning model lineage and automated testing of prompt and model behaviors.

• Collaborate with AI Product Engineers and Data Scientists toproductionizeLLM-based prototypes into enterprise-grade maintainable systems.

• Integrate vector databases model gateways content filters and guardrail frameworks into end-to-end LLM solutions.

• Implement observability and monitoring solutions that track performance metrics hallucination rates cost profiles and user interaction patterns.

• Lead troubleshooting and root-cause analysis for issues related to LLM deployment inference performance or pipeline reliability.

• Stay current with emerging LLM architectures inference optimizations fine-tuning techniques and relevantMLSecOpspatterns.

• Ensure compliance with data privacy ethical AI and AI-governance frameworks throughout pipeline design and operations.

• Mentor junior engineers and contribute to Steampunks AI engineering best practices tooling and reusable infrastructure patterns.

• You will contribute to the growth of our AI & Data Exploitation Practice!

• Ability to hold aposition of public trustwith the U.S. government.

• Bachelors and 8 years of experience.

• 5 yearsof experience in software engineering data engineeringMLOps or cloud engineering with2 yearsfocusing specifically on LLM or GenAI operations.

• Strong experience deploying models using frameworks such asHugging Face TransformersvLLMTensorRT-LLM or similar.

• Proficiencyin Python and operational tooling such asFastAPIPyTorchLangChainLlamaIndex and vector databases(FAISS Milvus Pinecone or similar).

• Advanced knowledge ofcloud platforms(AWS Azure GCP) including model hosting distributedcompute and secure networking patterns.

• Hands-on experience buildingCI/CD pipelines automated testing frameworks and environment provisioning for AI/ML workloads.

• Experience withDocker Kubernetes and infrastructure-as-code(Terraform CloudFormation).

• Familiarity withMLSecOps AI governance model hardening prompt injection defenses and content safety monitoring.

• Strong understanding oflogging observability and performance profilingfor high-throughput LLM inference systems.

• Excellent written and verbal communication skills with the ability to explain trade-offs and architectural decisions to technical and non-technical stakeholders.

• Demonstrated ability to balance long-term platform thinking with hands-on operations and rapid problem solving.

• Experience working in agile teams and using modern project management tools.

Steampunk relies on several factors to determine salary including but not limited to geographic location contractual requirements education knowledge skills competencies and experience. The projected compensation range for this position is $140000 to $190000. The estimate displayed represents a typical annual salary range for this position. Annual salary is just one aspect of Steampunks total compensation package for employees. Learn more about additional Steampunk benefits here.

Identity Statement

As part of the application process you are expected to be on camera during interviews and assessments. We reserve the right to take your picture to verify your identity and prevent fraud.

Steampunk is a Change Agent in the Federal contracting industry bringing new thinking to clients in the Homeland Federal Civilian Health and DoD sectors. Through our Human-Centered delivery methodology we are fundamentally changing the expectations our Federal clients have for true shared accountability in solving their toughest mission challenges. As an employee owned company we focus on investing in our employees to enable them to do the greatest work of their careers and rewarding them for outstanding contributions to our growth. If you want to learn more about our story visit .

We are an equal opportunity employer and all qualified applicants will receive consideration for employment without regard to race color religion sex national origin disability status protected veteran status or any other characteristic protected by participates in the E-Verify program.