Senior Staff Software Engineer ( AI agents & Prompt Engineering)
Senior Staff Software Engineer ( AI agents & Prompt Engineering)
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
What you get in the role:
We are looking for a highly skilled Senior Staff Software Engineer AI to design develop and optimize next-generation AI Agents that power intelligent automation and enhance user experiences. This role requires deep expertise in large language models (LLMs) prompt engineering/tuning agent orchestration and performance optimization. You will partner with product managers data scientists and engineering teams to architect scalable AI-driven solutions and integrate them into our enterprise ecosystem.
Key Responsibilities
Architecture Design: Define and design end-to-end architecture for AI agents ensuring scalability reliability and security in enterprise environments.
AI Agent Development: Design build and deploy autonomous AI agents capable of handling complex tasks with minimal human intervention.
Prompt Tuning & Optimization: Develop advanced prompt engineering strategies fine-tune LLMs and optimize model outputs for accuracy reliability and efficiency.
Agent Integration: Architect and implement frameworks for integrating multiple AI agents and external systems ensuring seamless workflows and interoperability having experience with protocols like MCP.
Performance Engineering: Continuously measure evaluate and enhance the performance scalability and reliability of AI agents.
Innovation & Research: Stay ahead of AI/ML advancements (LLMs multi-agent systems reasoning engines retrieval-augmented generation vector databases etc.) and apply them to real-world use cases.
Collaboration & Leadership: Mentor junior engineers contribute to technical roadmaps and drive cross-functional collaboration with product and platform teams.
Governance & Compliance: Ensure responsible AI practices model interpretability and compliance with data security and ethical guidelines.
Strong Platform/Product mindset with the ability to think beyond features and focus on building reusable scalable solutions.
Strong problem-solving skills and ability to architect large-scale AI systems.
Qualifications :
To be successful in this role you have:
Bachelors or Masters degree in Computer Science Artificial Intelligence Machine Learning or related field.
15 years of software engineering experience with at least 5 years in AI/ML systems.
Proven hands-on experience in building and deploying AI agents LLM-based applications or conversational AI systems.
Strong expertise in LLMs (OpenAI Anthropic Llama etc.) vector databases (Pinecone FAISS Weaviate) RAG pipelines and multi-agent frameworks.
Proficiency in Python and frameworks such as LangChain LlamaIndex Hugging Face Transformers Ray or similar.
Experience with prompt engineering fine-tuning and evaluation methodologies.
Deep knowledge of cloud platforms (AWS GCP Azure) and MLOps practices.
SaaS exposure with a clear understanding of platform scalability multi-tenancy and product lifecycle management.
Strong Platform/Product mindset with the ability to think beyond features and focus on building reusable scalable solutions.
Strong problem-solving skills and ability to architect large-scale AI systems.
Additional Information :
Work Personas
We approach our distributed world of work with flexibility and trust. Work personas (flexible remote or required in office) are categories that are assigned to ServiceNow employees depending on the nature of their work and their assigned work location. Learn more here. To determine eligibility for a work persona ServiceNow may confirm the distance between your primary residence and the closest ServiceNow office using a third-party service.
Equal Opportunity Employer
ServiceNow is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race color creed religion sex sexual orientation national origin or nationality ancestry age disability gender identity or expression marital status veteran status or any other category protected by addition all qualified applicants with arrest or conviction records will be considered for employment in accordance with legal requirements.
Accommodations
We strive to create an accessible and inclusive experience for all candidates. If you require a reasonable accommodation to complete any part of the application process or are unable to use this online application and need an alternative method to apply please contact for assistance.
Export Control Regulations
For positions requiring access to controlled technology subject to export control regulations including the U.S. Export Administration Regulations (EAR) ServiceNow may be required to obtain export control approval from government authorities for certain individuals. All employment is contingent upon ServiceNow obtaining any export license or other approval that may be required by relevant export control authorities.
From Fortune. 2025 Fortune Media IP Limited. All rights reserved. Used under license.
Remote Work :
No
Employment Type :
Full-time
Employment Type
Full-time
