The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.04 - Oct.-Dec. (2013 vol.6)
pp: 299-311
Rohit Ranchal , Purdue University, West Lafayette
Teresa Taber-Doughty , Purdue University, West Lafayette
Yiren Guo , Purdue University, West Lafayette
Keith Bain , St. Mary's University, Halifax
Heather Martin , St. Mary's University, Halifax
J. Paul Robinson , Purdue University, West Lafayette
Bradley S. Duerstock , Purdue University, West Lafayette
ABSTRACT
Speech recognition (SR) technologies were evaluated in different classroom environments to assist students to automatically convert oral lectures into text. Two distinct methods of SR-mediated lecture acquisition (SR-mLA), real-time captioning (RTC) and postlecture transcription (PLT), were evaluated in situ life and social sciences lecture courses employing typical classroom equipment. Both methods were compared according to technical feasibility and reliability of classroom implementation, instructors' experiences, word recognition accuracy, and student class performance. RTC provided near-instantaneous display of the instructor's speech for students during class. PLT employed a user-independent SR algorithm to optimally generate multimedia class notes with synchronized lecture transcripts, instructor audio, and class PowerPoint slides for students to access online after class. PLT resulted in greater word recognition accuracy than RTC. During a science course, students were more likely to take optional online quizzes and received higher quiz scores with PLT than when multimedia class notes were unavailable. Overall class grades were also higher when multimedia class notes were available. The potential benefits of SR-mLA for students who have difficulty taking notes accurately and independently were discussed, particularly for nonnative English speakers and students with disabilities. Field-tested best practices for optimizing SR accuracy for both SR-mLA methods were outlined.
INDEX TERMS
Real-time systems, Speech recognition, Multimedia communication, Education courses, Electronic learning,notetaking, Speech recognition, educational technology, electronic learning, multimedia systems
CITATION
Rohit Ranchal, Teresa Taber-Doughty, Yiren Guo, Keith Bain, Heather Martin, J. Paul Robinson, Bradley S. Duerstock, "Using Speech Recognition for Real-Time Captioning and Lecture Transcription in the Classroom", IEEE Transactions on Learning Technologies, vol.6, no. 4, pp. 299-311, Oct.-Dec. 2013, doi:10.1109/TLT.2013.21
REFERENCES
[1] K. Bain, S. Basson, and M. Wald, "Speech Recognition in University Classrooms: Liberated Learning Project," Proc. Fifth Int'l ACM SIGCAPH Conf. Assistive Technologies (ASSETS '02), pp. 192-196, 2002.
[2] M. Wald and K. Bain, "Universal Access to Communication and Learning: the Role of Automatic Speech Recognition," Universal Access in the Information Soc., vol. 6, no. 4, pp. 435-447, 2008.
[3] K. Bain, S. Basson, A. Faisman, and D. Kanevsky, "Accessibility, Transcription, and Access Everywhere," IBM Systems J., vol. 44, no. 3, pp. 589-604, 2005.
[4] D. Leitch and T. MacMillan, "Liberated Learning Initiative Innovative Technology and Inclusion: Current Issues and Future Directions for Liberated Learning Research," Year III Report, Saint Mary's Univ., Nova Scotia, Canada, 2003.
[5] K. Ryba, T. Mcivor, M. Shakir, and D. Paez, "Liberated Learning: Analysis of University Students' Perceptions and Experiences with Continuous Automated Speech Recognition," E-J. Instructional Science and Technology, vol. 9, no. 1, Mar. 2006.
[6] D. Leitch, "GIFT Atlantic Liberated Learning High School Pilot Project: A Study of the Transfer of Speech Recognition Technology from University Classrooms to High School Classrooms," Phase III Report, Saint Mary's Univ., 2008.
[7] S. Repp, A. Grob, and C. Meinel, "Browsing within Lecture Videos Based on the Chain Index of Speech Transcription," IEEE Trans. Learning Technologies, vol. 1, no. 3, pp. 145-156, July-Sept. 2008.
[8] W. Hürst, T. Kreuzer, and M. Wiesenhutter, "A Qualitative Study Towards Using Large Vocabulary Automatic Speech Recognition to Index Recorded Presentations for Search and Access over the Web," Proc. IADIS Int'l Conf. WWW/Internet (ICWI '02), pp. 135-143, 2002.
[9] M. Wald, G. Wills, D. Millard, L. Gilbert, S. Khoja, J. Kajaba, and Y. Li, "Synchronised Annotation of Multimedia," Proc. IEEE Ninth Int'l Conf. Advanced Learning Technologies, pp. 594-596, July 2009.
[10] M. Wald, "Synote: Accessible and Assistive Technology Enhancing Learning for All Students," Proc. 12th Int'l Conf. Computers Helping People with Special Needs (ICCHP '10), pp. 177-184, 2010.
[11] L. Elliot, S. Foster, and M. Stinson, "Student Study Habits Using Notes from a Speech-to-Text Support Service," J. Exceptional Children, vol. 69, no. 1, pp. 25-40, 2002.
[12] D. Stover and N. Pendegraft, "Revisiting Computer-Aided Notetaking Technological Assistive Devices for Hearing-Impaired Students," Clearing House: A J. Educational Strategies, Issues and Ideas, vol. 79, no. 2, pp. 94-97, 2005.
[13] M. Wald, "Captioning for Deaf and Hard of Hearing People by Editing Automatic Speech Recognition in Real Time," Proc. 10th Int'l Conf. Computers Helping People with Special Needs (ICCHP '06), pp. 683-690, 2006.
[14] M.S. Stinson, S. Eisenberg, C. Horn, J. Larson, H. Levitt, and R. Stuckless, "Real-Time Speech-to-Text Services," http://www.ntid. rit.edu/research/cprint/ pdfTFR_RTCaptioning_99.pdf, 1999.
[15] US Dept. of Education, "An Institutional Perspective on Students with Disabilities in Postsecondary Education,"  Nat'l Center for Educational Statistics, Postsecondary Education Quick Information System, Aug. 1999.
[16] J. Robison and C. Jensema, "Computer Speech Recognition as an Assistive Device for Deaf and Hard of Hearing People, Challenge of Change: Beyond the Horizon," Proc. Seventh Biennial Conf. Postsecondary Education Persons Who Are Deaf or Hard of Hearing, Apr. 1996.
[17] S. Watson and L. Johnston, "Assistive Technology in the Inclusive Science Classroom," J. Science Teacher, vol. 74, no. 3, pp. 34-38, 2007.
[18] M. Wald and K. Bain, "Enhancing the Usability of Real-Time Speech Recognition Captioning through Personalised Displays and Real-Time Multiple Speaker Editing and Annotation," Proc. HCI Int'l Conf., vol. 7, pp. 446-452, July 2007.
[19] J. Boyle, "The Process of Note Taking: Implications for Students with Mild Disabilities," Clearing House: A J. Educational Strategies, Issues and Ideas, vol. 80, no. 5, pp. 227-230, 2007.
[20] T. Mortimore and W. Crozier, "Dyslexia and Difficulties with Study Skills in Higher Education," J. Studies Higher Education, vol. 31, no. 2, pp. 235-251, 2006.
[21] C. Hughes and S. Suritsky, "Notetaking Skills and Strategies for Students with Learning Disabilities," J. Preventing School Failure, vol. 38, no. 1, pp. 7-12, 1993.
[22] B. Arons, "SpeechSkimmer: A System for Interactively Skimming Recorded Speech," ACM Trans. Computer-Human Interaction, vol. 4, no. 1, pp. 3-38, 1997.
[23] J. Huang, "The Effects of Academic Skills on Chinese ESL Students' Lecture Comprehension," College Student J., vol. 40, no. 2, pp. 385-392, 2006.
[24] K. Hadjikakou, V. Polycarpou, and A. Hadjilia, "The Experiences of Students with Mobility Disabilities in Cypriot Higher Education Institutions: Listening to Their Voices," Int'l J. Disability, Development and Education, vol. 57, no. 4, pp. 403-426, Dec. 2010.
[25] B. Duerstock, R. Ranchal, Y. Guo, T. Doughty, J. Robinson, and K. Bain, "Assistive Notetaking Using Speech Recognition Technology," Proc. Festival Int'l Conf. Caregiving, Disability, Aging and Technology (FICCDAT '11), 2011.
[26] J. Bonner and W. Holliday, "How College Science Students Engage in Notetaking Strategies," J. Research Science Teaching, vol. 43, no. 8, pp. 786-818, 2006.
[27] S. Peverly, V. Ramaswamy, C. Brown, J. Sumowski, M. Alidoost, and J. Garner, "What Predicts Skill in Lecture Note Taking?" J. Educational Psychology, vol. 99, no. 1, pp. 167-180, 2007.
[28] B. Titsworth and K. Kiewra, "Spoken Organizational Lecture Cues and Student Notetaking as Facilitators of Student Learning," J. Contemporary Educational Psychology, vol. 29, no. 4, pp. 447-461, Oct. 2004.
[29] F. DiVesta and G. Gray, "Listening and Note Taking: II. Immediate and Delayed Recall as Functions of Variations in Thematic Continuity, Note Taking, and Length of Listening-Review Intervals," J. Educational Psychology, vol. 64, no. 3, pp. 278-287, June 1973.
[30] K. Kiewra, "Investigating Notetaking and Review: A Depth of Processing Alternative," J. Educational Psychologist, vol. 20, pp. 23-32, 1985.
[31] P. Van Meter, L. Yokoi, and M. Pressley, "College Students' Theory of Note-Taking Derived from Their Perceptions of Note-Taking," J. Educational Psychology, vol. 86, no. 3, pp. 323-338, Sept. 1994.
[32] N.H. Van Matre and J. Carter, "The Effects of Note-Taking and Review on Retention of Information," Proc. Ann. Meeting Am. Educational Research Assoc., 1975.
[33] H. Lyles, B. Robertson, M. Mangino, and J.R. Cox, "Audio Podcasting in a Tablet PC-Enhanced Biochemistry Course," Biochemistry and Molecular Biology Education, vol. 35, no. 6, pp. 456-461, 2007.
[34] K.E. Brobst, "The Process of Integrating Information from Two Sources: Lecture and Text," Doctoral dissertation, Columbia Univ., Teachers College, Dissertation Abstracts Int'l, vol. 57, p. 217, 1996.
[35] R.A. Palmatier and J.M. Bennett, "Notetaking Habits of College Students," J. Reading, vol. 18, pp. 215-218, 1974.
[36] IBM, "IBM ViaScribe," http://www-03.ibm.com/able/ accessibility_services ViaScribe-accessible.pdf, 2011.
[37] Liberated Learning, "Hosted Transcription Service," http://www.transcribeyourclass.cahts.html , 2012.
[38] D.M. Carey and P. Sale, "Practical Considerations in the Use of Technology to Facilitate the Inclusion of Students with Severe Disabilities," Technology and Disability, vol. 3, pp. 77-86, 1994.
[39] J. Bell, "Enhancing Accessibility through Correction of Speech Recognition Errors," SIGACCESS Newsletter, no. 89, pp. 22-27, Sept. 2007.
[40] B.J. Zimmerman, "A Social Cognitive View of Self-Regulated Academic Learning," J. Educational Psychology, vol. 81, no. 3, pp. 329-339, 1989.
[41] D. Hayden, D. Colbry, J.A. BlackJr., and S. Panchanathan, "Note-Taker: Enabling Students Who Are Legally Blind to Take Notes in Class," Proc. 10th Int'l ACM SIGACCESS Conf. Computers and Accessibility (ASSETS '08), pp. 81-88, 2008.
[42] I. Weiss, "Report of the 2000 National Survey of Science and Mathematics Education," technical report, Horizon Research, 2001.
56 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool