Enter a job title or keyword
Senior AI System Architect
Job Location:
Job Location:
San Jose, CA - USA
Yearly Salary:
USD 160000 - 220000
Yearly Salary:
Posted:
15 October 2026 (Yesterday)
Posted:
Application Deadline:
12 January 2027
Application Deadline:
Vacancies:
1 Vacancy
Vacancies:
Job Summary
Description
Team Credo is looking for a Senior AI System Architect to join our team in San Jose CA reporting to AVP XPU system AI interface. This role needs to solve the system-level interconnection challenges that connect XPUs (NPU/GPU/custom silicon) into working AI infrastructure. This role needs to follow and define how compute elements are wired networked and orchestrated together at node rack and cluster scale so that large-scale LLM training and inference run efficiently across the platform. We strongly prefer candidates with a hands-on NPU hardware architect background and real experience taking NPU silicon into production deployment at scale.
Base salary range is $160000 - $220000 a year. The base salary offer will depend on factors such as education experience training skills qualifications and location. This position is also eligible for a discretionary bonus equity and a full range of medical and other benefits.
Why Credo
Team Credo is looking for a Senior AI System Architect to join our team in San Jose CA reporting to AVP XPU system AI interface. This role needs to solve the system-level interconnection challenges that connect XPUs (NPU/GPU/custom silicon) into working AI infrastructure. This role needs to follow and define how compute elements are wired networked and orchestrated together at node rack and cluster scale so that large-scale LLM training and inference run efficiently across the platform. We strongly prefer candidates with a hands-on NPU hardware architect background and real experience taking NPU silicon into production deployment at scale.
Base salary range is $160000 - $220000 a year. The base salary offer will depend on factors such as education experience training skills qualifications and location. This position is also eligible for a discretionary bonus equity and a full range of medical and other benefits.
Why Credo
- Purpose: We invest in what matters. From meaningful-future shaping projects to competitive compensation we empower you to grow your career while making a lasting impact.
- People: Connection starts within. We collaborate celebrate wins and create an environment where everyone can do their best work.
- Possibilities: Our belief shapes whats next. Our technology powers the most reliable and energy-efficient connections around the world and our team powers new products and markets that come next.
Requirements
Basic Qualifications
Basic Qualifications
- Bachelors degree in Computer Engineering EE CS or related field required.
- Three years in XPU or AI interconnect system architecture and micro architecture working experience.
- Strong foundational understanding of computer architecture including GPU NPU and/or CPU design principles.
- Familiarity with large language model architectures and distributed training/inference concepts (e.g. parallelism strategies model serving) through coursework research or personal projects.
- Demonstrated analytical ability for example through published research thesis work or quantitative project work with a track record of independently studying and synthesizing technical material.
- Strong cross-functional leadership and communication skills daily experience working with compiler software SOC & backend team preferred.
- Masters or PhD in Computer Science Artificial Intelligence Engineering or a related field.
- Deep hands-on NPU hardware architecture expertise.
- Real hands-on NPU architecture background with direct experience participating in an NPU design from architecture definition through silicon bring-up validation and volume production deployment.
- Working knowledge of high-speed interconnect or networking concepts (e.g. PCIe Ethernet RDMA) is a plus.
Required Experience:
Senior IC
About Company
Credo delivers high-speed, energy-efficient connectivity solutions powering AI, cloud computing, and hyperscale networks up to 1.6T.
