Enter a job title or keyword

6002500LLM Scientist | Fast-Growing AI & Cloud Data Transformation Company


Job Location:

Tokyo - Japan

Monthly Salary: JPY 600 - 2500
Experience Required: 1Year
Posted: 17 June 2026 (30+ days ago)
Application Deadline: 14 September 2026
Vacancies: 1 Vacancy

Job Summary

We are currently partnering with a fast-growing AI & Data consulting company in Japan that is actively expanding its Generative AI and Large Language Model (LLM) division and is now looking for both LLM Scientists and Senior LLM Scientists.

Please note that prior financial industry experience is NOT required.

For foreign candidates a valid Japanese work visa and at least JLPT N2-level Japanese (or equivalent business Japanese communication skills) are required to apply.

Position Levels

Junior / Mid-Level: 6M 10M JPY
Senior Level: 10M 25M JPY

The company works directly with major enterprise clients in Japan on cutting-edge AI transformation initiatives involving Generative AI LLM applications AI governance intelligent automation and next-generation enterprise AI ecosystems.

These positions offer the opportunity to work on real-world Generative AI implementation projects including Retrieval-Augmented Generation (RAG) AI Agents enterprise knowledge systems AI-powered business process transformation LLM evaluation frameworks and production-grade AI applications.

The environment is highly collaborative and technology-driven combining hands-on development advanced AI implementation and business-oriented consulting engagements.

Key Responsibilities

Design develop and evaluate enterprise-grade applications utilizing Large Language Models (LLMs)
Develop and optimize prompts workflows and inference strategies for Generative AI solutions
Build and support Retrieval-Augmented Generation (RAG) systems and AI Agent-based applications
Participate in Generative AI proof-of-concepts (PoCs) implementation projects and production deployments
Collaborate with AI consultants data scientists and data engineers to translate business requirements into AI solutions
Conduct technical validation benchmarking and evaluation of LLM-based systems
Support AI governance guardrails model safety and responsible AI initiatives
Contribute to internal AI frameworks reusable assets and next-generation Generative AI capabilities
Participate in enterprise AI transformation projects across multiple business domains

Examples of projects include:

Enterprise knowledge search and RAG implementation initiatives
Local/private LLM deployment and operational efficiency projects
AI governance and guardrail validation initiatives
Business process transformation through Generative AI and intelligent automation
Legacy system modernization supported by Generative AI technologies
AI Agent development and orchestration frameworks
LLM evaluation and optimization projects

Requirements


Required:

Bachelors degree or equivalent academic background in Computer Science Machine Learning Data Science Mathematics Statistics Engineering or related fields
Approximately 1 years of professional experience in AI data science machine learning or related technical fields
Experience developing applications utilizing Large Language Models (LLMs) through commercial cloud AI services or equivalent platforms
Experience with prompt engineering LLM integration or Generative AI application development
Business-level Japanese (JLPT N2 or equivalent)
Eligibility to work in Japan

Preferred:

Experience with Retrieval-Augmented Generation (RAG)
Experience with AI Agents and multi-agent systems
Experience with LLMOps model evaluation fine-tuning or AI deployment pipelines
Experience collaborating directly with business stakeholders and translating requirements into AI solutions
Experience with enterprise AI transformation or consulting projects
Experience with structured and unstructured data analytics
Experience with Python for AI development and production implementation
Experience using modern data platforms such as Snowflake Databricks or BigQuery
Masters degree in Computer Science Machine Learning Applied Mathematics Statistics Econometrics or related disciplines
English communication skills
Financial services experience is a plus but not required

Benefits

Compensation & Benefits:
Annual salary: 6M 25M JPY
Location: Nihonbashi Chuo-ku Tokyo
Hybrid work style available (office remote work combination)
Full flex-time system (no core time)
Standard working hours: 8 hours/day

Holidays & Time Off:
Full two-day weekend system
123 annual holidays annually
Paid leave granted after probation period
Refresh leave / New Year holidays / parental leave / condolence leave

Benefits:
Defined contribution pension plan
Learning & self-development support
Internal/external networking support budget
Sports & wellness allowance
Full annual health check support
Full influenza vaccination support including dependents
Full transportation reimbursement
Relocation support (eligible employees)
Childcare/babysitter support
Business trip & training allowances
Marriage / childbirth / condolence support system

Insurance:
Health insurance
Employee pension
Employment insurance
Workers compensation insurance

Additional Information:
Non-smoking office environment
Flexible internal role mobility and career growth opportunities

This is an excellent opportunity for someone who wants to work at the intersection of enterprise AI large-scale data architecture and real business transformation within Japans financial industry