Java Backend Developer (JAVA + AI)

We are looking for an experienced Java Backend Developer with AI integration experience to join a financial services technology team in Toronto. You will design and maintain high-performance backend services while integrating generative AI and large language model capabilities into enterprise workflows.

What youll do

• Design develop and maintain backend services using Java 17 Spring Boot and microservices architecture
• Build and expose RESTful and event-driven APIs supporting enterprise scale applications
• Integrate generative AI and large language model capabilities into backend workflows
• Design and optimize prompt templates prompt pipelines and prompt orchestration strategies
• Develop retrieval augmented generation services and AI inference orchestration layers
• Implement secure API integrations with AI platforms and internal data sources
• Apply prompt versioning evaluation and monitoring techniques to improve AI output quality
• Contribute to CI/CD pipelines containerization and cloud-native deployments
• Ensure scalability resiliency performance and observability across backend systems
• Participate in code reviews architecture discussions and technical design decisions
• Support production systems and troubleshoot complex backend and AI integration issues

What you bring

• 5 or more years of hands-on Java backend development experience
• Strong expertise in Java 11 and 17 Spring Boot Spring MVC and Spring Security
• Solid experience with microservices REST APIs and OpenAPI or Swagger design
• Hands-on experience integrating large language models into backend systems
• Strong understanding of prompt engineering techniques including zero-shot few-shot and chain of thought prompting
• Experience building retrieval augmented generation solutions using vector stores and embeddings
• Experience with Docker Kubernetes OpenShift and cloud platforms such as Azure or AWS
• Strong knowledge of SQL and NoSQL databases including DB2 PostgreSQL and MongoDB
• Experience implementing OAuth 2.0 JWT and secure API patterns
• Awareness of data privacy PII handling and AI governance in regulated environments

Nice to have

• Familiarity with AI orchestration frameworks or SDKs
• Experience in banking or financial services environments
• Background in prompt evaluation for quality bias and consistency

Work setup

• 6 to 12 month contract based in Toronto ON
• Hybrid with 4 days onsite per week