Research Internship (F/M/NB) â Crafting NPCs & Bots behaviors with LLM/VLM - La Forge
Research Internship (F/M/NB) â Crafting NPCs & Bots behaviors with LLM/VLM - La Forge
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
Recent advancements in Large Language Models (LLM) and Visual Language Models (VLM) are revolutionizing many fields including video games. Multiple videogame companies are already studying how to leverage LLMs for gamechanging innovations such as enabling players to cooperate in natural language with NPCs (nonplayer characters). Within academia multiple research labs are studying how to adapt LLMs/VLMs to new use cases such as interacting in complex environments through reinforcement learning or evolutionary strategies. These breakthroughs open up vast opportunities for enhancing player immersion through more intelligent and responsive NPCs.
This internship aims to explore the integration of LLMs and VLMs with reinforcement learning (RL) or evolutionary strategies to enhance the intelligence and behavior of NPCs and bots in video games. By combining the creative potential of LLMs with the interactive feedback loops of RL we aim to build better NPCs and reduce iteration time for game developers.
Relevant literature :
- Large Language Models in Interactive Environments with Online Reinforcement Learning
- FineTuning Large VisionLanguage Models as DecisionMaking Agents via Reinforcement Learning
- the current uses of LLMs/VLMs in gaming focusing on how they enhance NPC decisionmaking.
- Study recent research on using reinforcement learning to improve the performance of LLM/VLMs with a particular focus on grounding these models in interactive environments such as video games.
- Throughout discussion with production teams identify a potential realworld use case on which to calibrate prototyping and research.
- Experiment with methods to optimize NPC learning in simulated or live gaming environments providing a balance between realism and computational efficiency.
Internship Structure:
The internship will take place within Ubisofts La Forge where cuttingedge tools and resources are available for research including a set of realistic 3D games specifically designed for research purposes large datasets and stateoftheart learning algorithms deployed on GPU clusters. This internship will benefit from close collaboration with the Inria Flowers team led by PierreYves Oudeyer.
Qualifications :
- You are in the final year of your engineering degree or pursuing a research masters in computer science or a related field.
- You possess a solid foundation in computer science and mathematics particularly in areas relevant to machine learning deep learning LLMs/VLMs or reinforcement learning.
- You have experience using Python and machine learning libraries to build and experiment with models.
- Your English proficiency enables you to collaborate effectively in an international environment and communicate clearly with colleagues from diverse backgrounds.
- An interest in game design and game development.
Skills and competencies show up in different forms and can be based on different experiences thats why we strongly encourage you to apply even though you may not have all the requirements listed above.
Informations supplmentaires :
This job is open for an internship (6month contract).
Remote: hybrid model
Start Date: ASAP or in September
Process:
- Interview with our recruiter
- One or more technical and project interviews with the manager and his team
If your application is not retained you will receive a negative answer.
We are working to enrich players lives through unique and memorable gaming experiences and by improving the positive impacts of our games. To get there we are creating a safer more inclusive work environment we are giving back to the communities where Ubisoft operates by working with local nonprofit partners and by working to reduce the environmental impact of our business. Learn more on our Social Impact here
Remote Work :
No
Employment Type :
Fulltime
Employment Type
Full-time
