The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.03 - July-September (2011 vol.4)
pp: 249-260
M. Sugimoto , Dept. of Electr. Eng. & Inf. Syst., Univ. of Tokyo, Tokyo, Japan
ABSTRACT
This paper describes a system called GENTORO that uses a robot and a handheld projector for supporting children's storytelling activities. GENTORO differs from many existing systems in that children can make a robot play their own story in a physical space augmented by mixed-reality technologies. Pilot studies have been conducted to clarify the design requirements of GENTORO from both technological and practical viewpoints. A user study indicates that GENTORO's ability to enable manipulation of a robot using a handheld projector in a physical space can enhance children's embodied participation in, and their level of engagement with, their storytelling activities, and can support children in designing and expressing creative and original stories.
INDEX TERMS
mobile robots, augmented reality, computer aided instruction, physical space, mobile mixed-reality environment, children storytelling activity, handheld projector, robot, GENTORO system, Visualization, Mobile communication, Robot vision systems, Cameras, Rendering (computer graphics), Virtual reality, collaborative learning., Storytelling, children, handheld projector, robot, mobile mixed-reality, artificial, augmented, and virtual realities
CITATION
M. Sugimoto, "A Mobile Mixed-Reality Environment for Children's Storytelling Using a Handheld Projector and a Robot", IEEE Transactions on Learning Technologies, vol.4, no. 3, pp. 249-260, July-September 2011, doi:10.1109/TLT.2011.13
REFERENCES
[1] H. Alborzi et al., "Designing StoryRooms: Interactive Storytelling Spaces for Children," Proc. Third Conf. Designing Interactive Systems: Processes, Practices, Methods, and Techniques (DIS '00), pp. 95-104, 2000.
[2] M. Allen and W. Yen, Introduction to Measurement Theory. Waveland Press, 2002.
[3] T. Amabile, "Social Psychology of Creativity: A Consensual Assessment Technique," J. Personality and Social Psychology, vol. 43, no. 5, pp. 997-1013, 1982.
[4] V. Bayon et al., "Mixed Reality Storytelling Environments," Virtual Reality, vol. 7, no. 1 pp. 54-63, 2003.
[5] S. Besemer and L. O'Quinn, "Creative Product Analysis Matrix: Testing the Model Structure and a Comparison among Products-Three Novel Chairs," Creativity Research J., vol. 11, no. 4, pp. 333-346, 1998.
[6] A. Bobick et al., "The KidsRoom: A Perceptually-Based Interactive and Immersive Story Environment," Presence: Teleoperators and Virtual Environments, vol. 8, no. 4, pp. 367-391, 2000.
[7] X. Cao and R. Balakrishnan, "Interacting with Dynamically Defined Information Spaces Using a Handheld Projector and a Pen," Proc. 19th Ann. ACM Symp. User Interface Software and Technology (UIST '06), pp. 225-234, 2006.
[8] T. Collett and B. MacDonald, "Developer Oriented Visualization of a Robot Program," Proc. First ACM SIGCHI/SIGART Conf. Human-Robot Interaction (HRI '06), pp. 49-56, 2006.
[9] M. Csikszentmihalyi, Flow: The Psychology of Optimal Experience. Harper Collins, 1990.
[10] A. Druin et al., "Designing PETS: A Personal Electronic Teller of Stories," Proc. SIGCHI Conf. Human Factors in Computing Systems: The CHI is the Limit (CHI '99), pp. 326-329, 1999.
[11] J. Fails et al., "Child's Play: A Comparison of Desktop and Physical Interactive Environments," Proc. Conf. Interaction Design and Children (IDC '05), pp. 48-55, 2005.
[12] C. Forlines et al., "Zoom-and-Pick: Facilitating Visual Zooming and Precision Pointing with Interactive Handheld Projectors," Proc. 18th Ann. ACM Symp. User Interface Software and Technology (UIST '05), pp. 73-82, 2005.
[13] F. Garzotto and M. Forfori, "Hyperstories and Social Interaction in 2D and 3D Edutainment Spaces for Children," Proc. 17th Conf. Hypertext and Hypermedia (HYPERTEXT '06), pp. 57-67, 2006.
[14] J. Hourcade, B. Benderson, A. Druin, and G. Taxen, "KidPad: Collaborative Storytelling for Children," Proc. Extended Abstracts on Human Factors in Computing Systems (CHI '02), pp. 500-501, 2002.
[15] K. Hosoi, V. Dao, A. Mori, and M. Sugimoto, "CoGAME: Manipulation by Projection," Proc. ACM SIGGRAPH, 2007.
[16] K. Howland, J. Good, and J. Robertson, "A Learner-Centered Design Approach to Developing a Visual Language for Interactive Storytelling," Proc. Sixth Int'l Conf. Interaction Design and Children (IDC '07), pp. 45-52, 2007.
[17] T. Ito, G. Nguyen, and M. Sugimoto, "A Storytelling Support System Using Robots and Handheld Projectors," Proc. Seventh Int'l Conf. Interaction Design and Children (IDC '08), pp. 113-116, 2008.
[18] Japanese Ministry of Education, National Curriculum Standards (Nat'l Language), http://www.mext.go.jp/b_menu/shuppan/ sonota/ 990301b990301d.htm (in Japanese), 2008.
[19] MICROVISION Pico Projector Display, http://www.microvision. compico_projector_displays , Mar. 2010.
[20] J. Montemayor et al., "Tools for Children to Create Physical Interactive StoryRooms," Computers in Entertainment, vol. 2, no. 1, pp. 1-24, 2004.
[21] H. Raffle et al., "Jabberstamp: Embedding Sound and Voice in Traditional Drawings," Proc. Sixth Int'l Conf. Interaction Design and Children (IDC '07), pp. 137-144, 2007.
[22] R. Rasker, G. Welch, K. Low, and D. Bandyopadhyay, "Shader Lamps: Animating Real Objects with Image-Based Illumination," Proc. 12th Eurographics Workshop Rendering Techniques, pp. 89-102, 2001.
[23] R. Raskar et al., "RFIG Lamps: Interacting with a Self-Describing World via Photosensing Wireless Tags and Projectors," ACM Trans. Graphics, vol. 23, no. 3, pp. 406-415, 2004.
[24] K. Ryokai and J. Cassel, "StoryMat: A Play Space for Collaborative Storytelling," Proc. Extended Abstract on Human Factors in Computing Systems (CHI '99), pp. 272-273, 2002.
[25] M. Shoji, K. Miura, and A. Konno, "UTsu-Shi-O-Mi: The Virtual Humanoid You Can Reach," Proc. SIGGRAPH Emerging Technologies, 2006.
[26] M. Sugimoto, K. Hosoi, and H. Hashizume, "Caretta: A System for Supporting Face-to-Face Collaboration by Integrating Personal and Shared Spaces," Proc. SIGCHI Conf. Human Factors in Computing Systems (CHI '04), pp. 41-48, 2004.
[27] M. Sugimoto, T. Ito, G. Nguyen, and S. Inagaki, "GENTORO: A System for Supporting Children's Storytelling Using a Handheld Projector and a Robot," Proc. Eighth Int'l Conf. Interaction Design and Children (IDC '09), pp. 214-217, 2009.
[28] M. Sugimoto, M. Kojima, A. Nakamura, G. Kagotani, H. Nii, and M. Inami, "Augmented Coliseum: Display-Based Computing for Augmented Reality Inspiration Computing Robot," Proc. SIGGRAPH Emerging Technologies, 2005.
[29] B. Thang, S.-W. Thiescheffer, and A. Vermeeren, "Comparing the Creativity of Children's Design Solutions Based on Expert Assessment," Proc. Seventh Int'l Conf. Interaction Design and Children (IDC '08), pp. 266-273, 2008.
[30] Wikipedia, "Tokusatsu," http://en.wikipedia.org/wiki Tokusatsu , 2011.
[31] M. Umaschi, "Soft Toys with Computer Hearts: Building Personal Storytelling Environment," Proc. Extended Abstracts on Human Factors in Computing Systems: Looking to the Future Extended Abstracts (CHI EA '97), pp. 20-21, 1997.
[32] C. Vaucelle and T. Jehan, "Dolltalk: A Computational Toy to Enhance Children's Creativity," Proc. Extended Abstracts on Human Factors in Computing Systems (CHI '02), pp. 776-777, 2002.
[33] D. Wagner, "ARToolKitPlus," http://studierstube.icg.tugraz.ac. at/handheld artoolkitplus.php, 2011.
[34] R. Want, K. Fishkin, A. Gujar, and B. Harrison, "Bridging Physical and Virtual Worlds with Electronic Tags," Proc. SIGCHI Conf. Human Factors in Computing Systems: The CHI is the Limit (CHI '99), pp. 370-377, 1999.
[35] A. White and B. Smith, "Assessing Advertising Creativity using the Creative Product Semantic Scale," J. Advertising Research, vol. 41, no. 6, pp. 27-34, 2001.
[36] A. Wright, Creating Stories with Children. Oxford Univ., 1997.
[37] E. Yamaguchi, S. Inagaki, M. Sugimoto, F. Kusunoki, A. Deguchi, Y. Takeuchi, T. Seki, S. Tachibana, and Y. Yamamoto, "Fostering Students' Participation in Face-to-Face Interactions and Deepening Their Understanding by Integrating Personal and Shared Spaces," Trans. Edutainment II, pp. 228-245, 2009.
[38] J. Young, M. Xin, and E. Sharlin, "Robot Expressionism through Cartooning," Proc. ACM/IEEE Int'l Conf. Human-Robot Interaction (HRI '07), pp. 309-316, 2007.
[39] Z. Zhou, A. Cheok, J. Pan, and Y. Li, "An Interactive 3D Exploration Narrative Interface for Storytelling," Proc. Conf. Interaction Design and Children: Building a Community (IDC '04), pp. 155-156, 2004.
33 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool