Software Engineer III AI Engineer

We have an exciting and rewarding opportunity for you to take your software engineering career to the next level.

As a Software Engineer III at JPMorganChase within the Consumer and Community Banking you serve as a seasoned member of an agile team to design and deliver trusted market-leading technology products in a secure stable and scalable way. You are responsible for carrying out critical technology solutions across multiple technical areas within various business functions in support of the firms business objectives.

Job responsibilities

• Develop production-ready FastAPI applications and RESTful APIs that serve AI models and orchestrate complex workflows
• Design and implement RAG systems that combine large language models with external knowledge sources for intelligent information retrieval
• Build autonomous agentic AI systems capable of multi-step reasoning tool utilization and dynamic decision-making
• Optimize AI pipelines for latency throughput and cost efficiency
• Write clean maintainable code with comprehensive testing (unit integration and end-to-end tests)
• Lead technical design reviews and contribute to architectural decisions. Design scalable microservices architectures to handle enterprise-grade workloads
• Plan and implement cloud infrastructure on AWS for maximum reliability and performance
• Establish best practices for deployment monitoring and incident response
• Evaluate and integrate emerging AI/ML technologies and frameworks
• Partner with ML engineers data scientists and product teams to translate requirements into technical solutions. Mentor and support junior engineers through code reviews and technical guidance
• Document systems and knowledge to enable team collaboration. Contribute to continuous improvement of engineering practices and tools

Required qualifications capabilities and skills

• Formal training or certification on software engineering concepts and 3 years applied experience
• Youre proficient in Python and have shipped multiple FastAPI applications to production. Youve successfully built and deployed RAG systems understanding vector databases embeddings and retrieval strategies
• You have hands-on experience with agentic AI systems LLM orchestration and multi-agent frameworks. You excel at system designyou can architect complex systems think about trade-offs and optimize for scalability and reliability
• Youre an AWS expert with deep knowledge of core services and cloud-native architecture patterns
• You hold an active AWS Cloud Certification (Solutions Architect Professional Developer Associate or equivalent)
• Strong fundamentals in data structures algorithms and distributed systems
• Experience working with vector databases (Pinecone Weaviate Milvus) and embedding models. Familiarity with LLM frameworks and orchestration tools (LangChain LlamaIndex AutoGen)
• Proficiency with containerization (Docker) and infrastructure-as-code (Terraform). Solid understanding of CI/CD pipelines and modern DevOps practices
• Experience with testing frameworks and a commitment to code quality. Excellent communication skillsyou can explain complex ideas clearly to both technical and non-technical stakeholders
• Proactive and self-motivated; you take ownership of problems and drive them to resolution. Collaborative team player who thrives in fast-paced environments
• Curious learner who stays current with AI/ML advancements and best practices. Leader with a growth mindset and willingness to mentor others