Institute of Information Science, Academia Sinica

Extended (or cross) reality (XR) research has been growing to achieve immersive and versatile XR experiences. While visual and audio feedback have been extensively explored, haptic feedback, which involves complex physical changes and is perceived by different neurons on the body, remains an area of ongoing research. A lot of haptic sensations are still not achieved or explored by off-the-shelves products and relative research. As a result, there exists a gap between the current state of XR haptic effects and the expectations portrayed in the movie Ready Player One. Furthermore, when it comes to bridging the virtual and physical worlds in XR interactions, the challenges and potential are much greater. Besides physical experiences from XR haptics, with the development of LLM (large language models), integrating artificial intelligence (AI) techniques in XR interactions could enhance users' mental experiences in XRAI. This talk will introduce a series of our XR haptic and XRAI works, sharing the process and experience of performing novel technique research in human-computer interaction (HCI).

Hsin-Ruey (Ray) Tsai is an associate professor of the Department of Computer Science and the Digital Content Technologies program in National Chengchi University. His current research interests are virtual reality (VR), augmented reality (AR), augmented human (AH) and haptic interactions in the human-computer interaction (HCI) field.