Research Intern Interactive Multimodal Futures Group (Situated, Social & Ubiquitous Computing)

Research Internships at Microsoft provide a dynamic environment for research careers with a network of world-class research labs led by globally-recognized scientists and engineers who pursue innovation in a range of scientific and technical disciplines to help solve complex challenges in diverse fields including computing healthcare economics and the environment.

TheInteractive Multimodal Futures (IMF)group at Microsoft Research seeks a PhD-level Research Intern to work on a project at the intersection ofsituated interactionsocial computing ubiquitous computing andhuman-centered Artificial Intelligence (AI) systems. The project will include elements of multimodal sensing (physiology speech gaze gestures olfaction/gas etc.) signal processing and real-time interaction.

Our groups research spans several sub-areas:

• Human-centered AI foraffective and social computingand adaptive experiences.
• Situated interactionbetween humans and AI systems such as robots deployed in the physical world.
• Conversational AI Agentsthat aresociallyand context aware.
• Ubiquitous sensing and ambient intelligencewith unobtrusive sensing in the real world.

You will collaborate with IMF researchers to prototype systems run user studies develop machine learning models and explore technical capabilities of generative AI for human-AI interaction.

Research Interns put inquiry and theory into practice. Alongside fellow doctoral candidates and some of the worlds best researchers Research Interns learn collaborate and network for life. Research Interns not only advance their own careers but they also contribute to exciting research and development strides. During the 12-week internship Research Interns are paired with mentors and expected to collaborate with other Research Interns and researchers present findings and contribute to the vibrant life of the community. Research internships are available in all areas of research and are offered year-round though they typically begin in the summer.

• Design and implement research prototypes for real-time situated and adaptive interaction.
• Explore the use of the latest generative AI techniques related to interpreting multimodal interaction conversation and behavioral signals.
• Conduct user studies and analyze multimodal data.
• Contribute to publications and share findings with the research community.

• Currently enrolled in a Doctorate degree program in Human-Computer Interaction (HCI) Human-Robot Interaction (HRI) Computer Science Cognitive Science Robotics Electrical Engineering Psychology or related STEM field.

Other Requirements

• Research Interns are expected to be physically located in their managers Microsoft worksite location for the duration of their internship.
• Please include a cover letter indicating which of the above research topics you are most interested in and aligned with. Be sure to indicate which of the specific preferred qualifications (listed below) you possess.

We are looking for some combination of the following qualifications (please address these in your cover letter):

• 2 years of research experience using human-centered approaches in HCI HRI Machine Learning (ML) Computer Vision (CV) Ubiquitous Computing or Affective Computing.
• Experience writing peer-reviewed publications.
• Experience with generative AI techniques ML frameworks (e.g. PyTorch) and real-time interactive systems.
• Proficient collaboration and communication skills.
• Conducting human-subjects research.
• Experience implementing research prototypes (frontend backend or both).
• Using human-centered design & research methods.
• Familiarity with reinforcement learning or time-series signal processing.
• Working with large datasets (e.g. text vision physiology behavioral).

Affective and Social Computing sub-area:

• Background in affective computing behavioral or physiological sensing.
• Experience collecting data with wearable devices.
• Hardware prototyping or wearable device experience.
• Healthcare/wellbeing experience - e.g. pain assessment and modeling (nociceptive signals stress/anxiety detection) or collaboration with clinical partners.
• Olfaction & gas sensing - e.g. experience with electronic noses breath analysis or volatile organic compound sensing.

Situated Interaction sub-area:

• Demonstrated experience in programming multimodal systems that interact with real human users e.g. robots or virtual agents particularly by integrating multiple machine-learned components such as computer vision speech recognition dialogue handling natural language generation etc.
• Demonstrated experience in conducting research outside of a controlled lab environment e.g. field research ethnography in-the-wild studies etc.

Conversational AI Agents sub-area:

• Experience prototyping real-time conversational AI agents using tools such as the OpenAI Realtime API including function calling and supporting interactions via text voice and other interfaces.
• Designed implemented and evaluated different personality styles for AI agents varying factors such as communication style voice characteristics and emotional tone to study their impact on user experience engagement and trust.
• Incorporated multimodal sensory inputs (e.g. text audio contextual signals) to enhance interaction quality and make agent responses more adaptive and context aware.

Ubiquitous Computing and Ambient Intelligence sub-area:

• Leveraging the latest in AI techniques to perform sensing in the real world
• Working with multimodal AI models

The base pay range for this internship is USD $6810 - $13480 per month. There is a different range applicable to specific work locations within the San Francisco Bay area and New York City metropolitan area and the base pay range for this role in thoselocations is USD $8920 - $14610 per month.

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here: accepts applications and processes offers for these roles on an ongoing basis throughout the academic calendar (September - April).

This position will be open for a minimum of 5 days with applications accepted on an ongoing basis until the position is filled.

Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age ancestry citizenship color family or medical care leave gender identity or expression genetic information immigration status marital status medical condition national origin physical or mental disability political affiliation protected veteran or military status race ethnicity religion sex (including pregnancy) sexual orientation or any other characteristic protected by applicable local laws regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process read more about requesting accommodations.

Required Experience:

IC