Director, Cloud AI Platform Engineering

We are the leading provider of professional services to the middle market globally our purpose is to instill confidence in a world of change empowering our clients and people to realize their full potential. Our exceptional people are the key to our unrivaled culture and talent experience and our ability to be compelling to our clients. Youll find an environment that inspires and empowers you to thrive both personally and professionally. Theres no one like you and thats why theres nowhere like RSM.

Role overview

The Cloud AI Platform Engineer builds and runs the cloud platforms that let mid-market clients put AI into production safely. You will design AI landing zones deploy model and agent infrastructure and harden vibe-coded and custom AI apps so they scale.

Youll join RSMs MCI (Managed Cloud & Infrastructure) Cloud practice serving companies with $200M$4B in revenue. You will work beside our Cloud Solutions Architects: together you will shape the solution; you build automate and operate it. Much of your work will be carried into RSMs Managed IT Services (MITS) as Managed AI and Managed Cloud often as a Forward Deployed Engineer embedded with client IT teams.

Key responsibilities

Platform build

• Design and deploy AI landing zones on Azure and AWS: networking identity policy logging and private endpoints.
• Stand up model platforms: Azure AI Foundry / Azure OpenAI Amazon Bedrock and SageMaker; integrate Anthropic OpenAI and open-weight models.
• Build infrastructure for RAG and agents: vector stores orchestration MCP servers and API gateways.
• Codify everything in Terraform or Bicep delivered through CI/CD pipelines.

Hardening and scaling

• Take vibe-coded and prototype AI apps to production: containerize add auth secrets management testing and observability.
• Implement AI guardrails: content filtering prompt-injection defenses data loss prevention and least privilege access.
• Align controls to client security baselines Microsoft Purview and frameworks such as NIST AI RMF and ISO 42001.

Operations and FinOps

• Run LLMOps: model versioning evaluation monitoring drift and quality alerts and incident response.
• Instrument token and GPU consumption; build chargeback quotas and caching to control AI spend.
• Transition platforms into MITS run-state with runbooks SLAs and handoff to shared or dedicated teams.

Client advisory

• Scope platform work estimate effort and contribute to SOWs and assessments.
• Explain trade-offs in plain language to CIOs CISOs and engineering leads.
• Contribute reusable accelerators reference architectures and the firms vibe-coding harness.

Required qualifications

• 5 years in cloud platform or DevOps engineering; 1 year deploying generative AI workloads in production.
• Hands-on depth in Azure or AWS with working knowledge of the other.
• Infrastructure as code (Terraform or Bicep) and CI/CD (GitHub Actions or Azure DevOps).
• Containers and orchestration: Docker Kubernetes (AKS or EKS) or serverless equivalents.
• Python plus one of TypeScript or Go.
• Cloud identity and security: Entra ID or IAM Key Vault or Secrets Manager private networking.
• Observability tooling such as Azure Monitor CloudWatch Datadog or OpenTelemetry.
• Client-facing experience in consulting or a managed services provider.
• Ability to travel to client sites up to 25%.

Preferred qualifications

• Bachelors degree in a technical field or equivalent experience.
• Certifications: Azure AI Engineer Associate (AI-102) Azure Solutions Architect Expert AWS Certified Machine Learning or GenAI Developer HashiCorp Terraform Associate FinOps Certified Practitioner.
• AI gateway and LLMOps tools: Azure API Management AI gateway LiteLLM LangSmith Langfuse or MLflow.
• Agent frameworks and protocols: Semantic Kernel LangGraph Bedrock Agents MCP.
• Microsoft 365 Copilot Copilot Studio and Purview data governance.
• GPU capacity planning and cost management.
• Experience with mid-market clients and PE-backed portfolio companies.

At RSM we offer a competitive benefits and compensation package for all our more about our total rewards at believe flexibility and in-person connection both play an important role in how we work and grow. Most roles at RSM follow a hybrid workstyle which means team members are aligned to an RSM office and come together in person when it best supports clients teams development or relationship-building. Some roles may be virtual or primarily on-site based on role requirements team priorities and client needs.

All applicants will receive consideration for employment as RSM does not tolerate discrimination and/or harassment based on race; color; creed; sincerely held religious beliefs practices or observances; sex (including pregnancy or disabilities related to nursing); gender; sexual orientation; HIV Status; national origin; ancestry; familial or marital status; age; physical or mental disability; citizenship; political affiliation; medical condition (including family and medical leave); domestic violence victim status; past current or prospective service in the US uniformed service; US Military/Veteran status; pre-disposing genetic characteristics or any other characteristic protected under applicable federal state or local law.

Accommodation for applicants with disabilities is available upon request in connection with the recruitment process and/or employment/ is committed to providing equal opportunity and reasonable accommodation for people with disabilities. If you require a reasonable accommodation to complete an application interview or otherwise participate in the recruiting process please call us at or send us an email at .

RSM does not intend to hire entry level candidates who will require sponsorship now OR in the future (i.e. F-1 visa holders). If you are a recent U.S. college / university graduate possessing 1-2 years of progressive and relevant work experience in a same or similar role to the one for which you are applying excluding internships you may be eligible for hire as an experienced associate.

RSM will consider for employment qualified applicants with arrest or conviction records. For those living in California or applying to a position in California please click here for additional information.

At RSM an employees pay at any point in their career is intended to reflect their experiences performance and skills for their current role. The salary range (or starting rate for interns and associates) for this role represents numerous factors considered in the hiring decisions including but not limited to education skills work experience certifications location etc. As such pay for the successful candidate(s) could fall anywhere within the stated range.