An experimental mixed reality using a multimodal approach lets users play characters in interactive narratives as though acting on a stage. Users interact with characters through speech, attitude, and gesture, enhancing their immersion in the virtual world.
Citation:
Marc Cavazza, Fred Charles, Steven J. Mead, Olivier Martin, Xavier Marichal, Alok Nandi, "Multimodal Acting in Mixed Reality Interactive Storytelling," IEEE MultiMedia, vol. 11, no. 3, pp. 30-39, July 2004, doi:10.1109/MMUL.2004.11