This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
M. Sugimoto, Dept. of Electr. Eng. & Inf. Syst., Univ. of Tokyo, Tokyo, Japan
This paper describes a system called GENTORO that uses a robot and a handheld projector for supporting children's storytelling activities. GENTORO differs from many existing systems in that children can make a robot play their own story in a physical space augmented by mixed-reality technologies. Pilot studies have been conducted to clarify the design requirements of GENTORO from both technological and practical viewpoints. A user study indicates that GENTORO's ability to enable manipulation of a robot using a handheld projector in a physical space can enhance children's embodied participation in, and their level of engagement with, their storytelling activities, and can support children in designing and expressing creative and original stories.

[1] H. Alborzi et al., "Designing StoryRooms: Interactive Storytelling Spaces for Children," Proc. Third Conf. Designing Interactive Systems: Processes, Practices, Methods, and Techniques (DIS '00), pp. 95-104, 2000.
[2] M. Allen and W. Yen, Introduction to Measurement Theory. Waveland Press, 2002.
[3] T. Amabile, "Social Psychology of Creativity: A Consensual Assessment Technique," J. Personality and Social Psychology, vol. 43, no. 5, pp. 997-1013, 1982.
[4] V. Bayon et al., "Mixed Reality Storytelling Environments," Virtual Reality, vol. 7, no. 1 pp. 54-63, 2003.
[5] S. Besemer and L. O'Quinn, "Creative Product Analysis Matrix: Testing the Model Structure and a Comparison among Products-Three Novel Chairs," Creativity Research J., vol. 11, no. 4, pp. 333-346, 1998.
[6] A. Bobick et al., "The KidsRoom: A Perceptually-Based Interactive and Immersive Story Environment," Presence: Teleoperators and Virtual Environments, vol. 8, no. 4, pp. 367-391, 2000.
[7] X. Cao and R. Balakrishnan, "Interacting with Dynamically Defined Information Spaces Using a Handheld Projector and a Pen," Proc. 19th Ann. ACM Symp. User Interface Software and Technology (UIST '06), pp. 225-234, 2006.
[8] T. Collett and B. MacDonald, "Developer Oriented Visualization of a Robot Program," Proc. First ACM SIGCHI/SIGART Conf. Human-Robot Interaction (HRI '06), pp. 49-56, 2006.
[9] M. Csikszentmihalyi, Flow: The Psychology of Optimal Experience. Harper Collins, 1990.
[10] A. Druin et al., "Designing PETS: A Personal Electronic Teller of Stories," Proc. SIGCHI Conf. Human Factors in Computing Systems: The CHI is the Limit (CHI '99), pp. 326-329, 1999.
[11] J. Fails et al., "Child's Play: A Comparison of Desktop and Physical Interactive Environments," Proc. Conf. Interaction Design and Children (IDC '05), pp. 48-55, 2005.
[12] C. Forlines et al., "Zoom-and-Pick: Facilitating Visual Zooming and Precision Pointing with Interactive Handheld Projectors," Proc. 18th Ann. ACM Symp. User Interface Software and Technology (UIST '05), pp. 73-82, 2005.
[13] F. Garzotto and M. Forfori, "Hyperstories and Social Interaction in 2D and 3D Edutainment Spaces for Children," Proc. 17th Conf. Hypertext and Hypermedia (HYPERTEXT '06), pp. 57-67, 2006.
[14] J. Hourcade, B. Benderson, A. Druin, and G. Taxen, "KidPad: Collaborative Storytelling for Children," Proc. Extended Abstracts on Human Factors in Computing Systems (CHI '02), pp. 500-501, 2002.
[15] K. Hosoi, V. Dao, A. Mori, and M. Sugimoto, "CoGAME: Manipulation by Projection," Proc. ACM SIGGRAPH, 2007.
[16] K. Howland, J. Good, and J. Robertson, "A Learner-Centered Design Approach to Developing a Visual Language for Interactive Storytelling," Proc. Sixth Int'l Conf. Interaction Design and Children (IDC '07), pp. 45-52, 2007.
[17] T. Ito, G. Nguyen, and M. Sugimoto, "A Storytelling Support System Using Robots and Handheld Projectors," Proc. Seventh Int'l Conf. Interaction Design and Children (IDC '08), pp. 113-116, 2008.
[18] Japanese Ministry of Education, National Curriculum Standards (Nat'l Language), http://www.mext.go.jp/b_menu/shuppan/ sonota/ 990301b990301d.htm (in Japanese), 2008.
[19] MICROVISION Pico Projector Display, http://www.microvision. compico_projector_displays , Mar. 2010.
[20] J. Montemayor et al., "Tools for Children to Create Physical Interactive StoryRooms," Computers in Entertainment, vol. 2, no. 1, pp. 1-24, 2004.
[21] H. Raffle et al., "Jabberstamp: Embedding Sound and Voice in Traditional Drawings," Proc. Sixth Int'l Conf. Interaction Design and Children (IDC '07), pp. 137-144, 2007.
[22] R. Rasker, G. Welch, K. Low, and D. Bandyopadhyay, "Shader Lamps: Animating Real Objects with Image-Based Illumination," Proc. 12th Eurographics Workshop Rendering Techniques, pp. 89-102, 2001.
[23] R. Raskar et al., "RFIG Lamps: Interacting with a Self-Describing World via Photosensing Wireless Tags and Projectors," ACM Trans. Graphics, vol. 23, no. 3, pp. 406-415, 2004.
[24] K. Ryokai and J. Cassel, "StoryMat: A Play Space for Collaborative Storytelling," Proc. Extended Abstract on Human Factors in Computing Systems (CHI '99), pp. 272-273, 2002.
[25] M. Shoji, K. Miura, and A. Konno, "UTsu-Shi-O-Mi: The Virtual Humanoid You Can Reach," Proc. SIGGRAPH Emerging Technologies, 2006.
[26] M. Sugimoto, K. Hosoi, and H. Hashizume, "Caretta: A System for Supporting Face-to-Face Collaboration by Integrating Personal and Shared Spaces," Proc. SIGCHI Conf. Human Factors in Computing Systems (CHI '04), pp. 41-48, 2004.
[27] M. Sugimoto, T. Ito, G. Nguyen, and S. Inagaki, "GENTORO: A System for Supporting Children's Storytelling Using a Handheld Projector and a Robot," Proc. Eighth Int'l Conf. Interaction Design and Children (IDC '09), pp. 214-217, 2009.
[28] M. Sugimoto, M. Kojima, A. Nakamura, G. Kagotani, H. Nii, and M. Inami, "Augmented Coliseum: Display-Based Computing for Augmented Reality Inspiration Computing Robot," Proc. SIGGRAPH Emerging Technologies, 2005.
[29] B. Thang, S.-W. Thiescheffer, and A. Vermeeren, "Comparing the Creativity of Children's Design Solutions Based on Expert Assessment," Proc. Seventh Int'l Conf. Interaction Design and Children (IDC '08), pp. 266-273, 2008.
[30] Wikipedia, "Tokusatsu," http://en.wikipedia.org/wiki Tokusatsu , 2011.
[31] M. Umaschi, "Soft Toys with Computer Hearts: Building Personal Storytelling Environment," Proc. Extended Abstracts on Human Factors in Computing Systems: Looking to the Future Extended Abstracts (CHI EA '97), pp. 20-21, 1997.
[32] C. Vaucelle and T. Jehan, "Dolltalk: A Computational Toy to Enhance Children's Creativity," Proc. Extended Abstracts on Human Factors in Computing Systems (CHI '02), pp. 776-777, 2002.
[33] D. Wagner, "ARToolKitPlus," http://studierstube.icg.tugraz.ac. at/handheld artoolkitplus.php, 2011.
[34] R. Want, K. Fishkin, A. Gujar, and B. Harrison, "Bridging Physical and Virtual Worlds with Electronic Tags," Proc. SIGCHI Conf. Human Factors in Computing Systems: The CHI is the Limit (CHI '99), pp. 370-377, 1999.
[35] A. White and B. Smith, "Assessing Advertising Creativity using the Creative Product Semantic Scale," J. Advertising Research, vol. 41, no. 6, pp. 27-34, 2001.
[36] A. Wright, Creating Stories with Children. Oxford Univ., 1997.
[37] E. Yamaguchi, S. Inagaki, M. Sugimoto, F. Kusunoki, A. Deguchi, Y. Takeuchi, T. Seki, S. Tachibana, and Y. Yamamoto, "Fostering Students' Participation in Face-to-Face Interactions and Deepening Their Understanding by Integrating Personal and Shared Spaces," Trans. Edutainment II, pp. 228-245, 2009.
[38] J. Young, M. Xin, and E. Sharlin, "Robot Expressionism through Cartooning," Proc. ACM/IEEE Int'l Conf. Human-Robot Interaction (HRI '07), pp. 309-316, 2007.
[39] Z. Zhou, A. Cheok, J. Pan, and Y. Li, "An Interactive 3D Exploration Narrative Interface for Storytelling," Proc. Conf. Interaction Design and Children: Building a Community (IDC '04), pp. 155-156, 2004.

Index Terms:
mobile robots,augmented reality,computer aided instruction,physical space,mobile mixed-reality environment,children storytelling activity,handheld projector,robot,GENTORO system,Visualization,Mobile communication,Robot vision systems,Cameras,Rendering (computer graphics),Virtual reality,collaborative learning.,Storytelling,children,handheld projector,robot,mobile mixed-reality,artificial,augmented,and virtual realities
Citation:
M. Sugimoto, "A Mobile Mixed-Reality Environment for Children's Storytelling Using a Handheld Projector and a Robot," IEEE Transactions on Learning Technologies, vol. 4, no. 3, pp. 249-260, July-Sept. 2011, doi:10.1109/TLT.2011.13
Usage of this product signifies your acceptance of the Terms of Use.