Ph.D XXXIX

Supervisor: Luca Chittaro

Phone: +39 0432 558413

Room: Rizzi L2c-02-CD 

Mail: corro.christian@spes.uniud.it

Research Project

A Framework for Integrating Context-Aware Intelligent Agents into Multimodal, Instructional Mixed Reality

Recent advancements in generative artificial intelligence, particularly in Large Language Models (LLMs), have shown significant capabilities of these models to generate human-like, contextually relevant text. This research project aims to use the generative capabilities of LLMs alongside Computer Vision techniques to build a framework for integrating context-aware intelligent agents into multimodal, instructional mixed-reality environments. The project adopts a Human-Computer Interaction (HCI) perspective, focusing on the interaction between users and intelligent agents. Indeed, it will explore the integration of intelligent agents capable of understanding multimodal inputs from users, such as speech, gaze, gestures, and body movements, while also being aware of the environmental context. This understanding will be leveraged to deliver personalized, contextually relevant outputs in mixed reality environments with a focus on education and training.