The Community for Technology Leaders
RSS Icon
Issue No.02 - April-June (2012 vol.19)
pp: 48-57
Andrei Popescu-Belis , Idiap Research Institute, Switzerland
Denis Lalanne , University of Fribourg, Switzerland
Hervé Bourlard , Idiap Research Institute and Ecole Polytechnique Federale de Laussane (EPFL), Switzerland
This paper surveys the work carried out within two large consortia, AMI and IM2, on improving access to records of human meetings using multimodal interfaces called meeting browsers. Their design has emerged as an important goal, with both theoretical interest and practical applications. Meeting browsers are assistance tools that help humans navigate through multimedia records (audio, video, documents, and metadata) in order to obtain a general idea about what happened in a meeting or to find specific pieces of information, for discovery or verification. To explain the importance that meeting browsers have gained in time, the paper summarizes findings of user studies, discusses features of meeting browser prototypes developed in AMI/IM2, and outlines the main evaluation protocol proposed (BET). Reference scores are provided for future benchmarking. These achievements in meeting browsing are the result of an iterative software process, from user studies to prototypes and then to products.
multimedia, meeting support technology, meeting browsers, user requirements, evaluation
Andrei Popescu-Belis, Denis Lalanne, Hervé Bourlard, "Finding Information in Multimedia Meeting Records", IEEE MultiMedia, vol.19, no. 2, pp. 48-57, April-June 2012, doi:10.1109/MMUL.2011.21
1. M.M. Bouamrane and S. Luz, "Meeting Browsing: State-of-the-Art Review," Multimedia Systems, vol. 12, nos. 4–5, 2007, pp. 439–457.
2. S. Tucker and S. Whittaker, "Accessing Multimodal Meeting Data: Systems, Problems, and Possibilities," Machine Learning for Multimodal Interaction, S. Bengio, and H. Bourlard eds., LNCS 3361, Springer-Verlag, 2005, pp. 1–11.
3. Z. Yu, and Y. Nakamura, "Smart Meeting Systems: A Survey of State-of-the-Art and Open Issues," ACM Computing Surveys, vol. 42, no. 2, 2010, pp. 11–12.
4. S. Renals et al., Multimodal Signal Processing: Human Interactions in Meetings, Cambridge Univ. Press, 2012.
5. S. Banerjee, C. Rose, and A.I. Rudnicky, "The Necessity of a Meeting Recording and Playback System, and the Benefit of Topic-Level Annotations to Meeting Browsing," Proc. 10th IFIP TC13 Int'l Conf. Human-Computer Interaction (Interact 2005), LNCS 3585, Springer-Verlag, 2005, pp. 643–656.
6. A. Jaimes et al., "Memory Cues for Meeting Video Retrieval," Proc. 1st ACM Workshop Continuous Archival and Retrieval of Personal Experiences (CARPE 2004), ACM Press, 2004, pp. 74–85.
7. S. Whittaker et al., "Design and Evaluation of Systems to Support Interaction Capture and Retrieval," Personal and Ubiquitous Computing, vol. 12, no. 3, 2008, pp. 197–221.
8. A. Cremers et al., "The Project Browser: Supporting Information Access for a Project Team," Proc. 12th Int'l Conf. Human-Computer Interaction (HCII 2007), Human Computer-Interaction, Part IV, LNCS 4553, Springer-Verlag, 2007, pp. 571–580.
9. E. Bertini and D. Lalanne, Total Recall Survey, tech. report, Dept. of Computer Science, Univ. of Fribourg, 2007.
10. A. Lisowska, A. Popescu-Belis, and S. Armstrong, "User Query Analysis for the Specification and Evaluation of a Dialogue Processing and Retrieval System," Proc. 4th Int'l Conf. Language Resources and Evaluation (LREC 2004), European Language Resources Assoc., 2004, pp. 993–996.
11. P. Wellner et al., "A Meeting Browser Evaluation Test," Proc. ACM SIGCHI Conf. Human Factors in Computing Systems (CHI 2005), ACM Press, 2005, pp. 2021–2024.
12. A. Lisowska et al., "Minimizing Modality Bias when Exploring Input Preference for Multimodal Systems in New Domains: The Archivus Case Study," Proc. ACM SIGHI Conf. Human Factors in Computing Systems (CHI 2007), ACM Press, 2007, pp. 1805–1810.
13. A. Popescu-Belis et al., "Towards an Objective Test for Meeting Browsers: The BET4TQB Pilot Experiment," Proc. 4th Workshop Machine Learning for Multimodal Interaction (MLMI 2007), LNCS 4892, Springer-Verlag, 2008, pp. 108–119.
14. A. Waibel et al., "Meeting Browser: Tracking and Summarizing Meetings," Proc. DARPA Broadcast News Transcription and Understanding Workshop, D.E.M. Penrose ed., 1998, pp. 281–286.
15. G. Tur et al., "The CALO Meeting Assistant System," , IEEE Trans. Audio, Speech, and Language Processing, vol. 18, no. 6, 2010, pp. 1601–1611.
16. M. Rigamonti, D. Lalanne, and R. Ingold, "FaericWorld: Browsing Multimedia Events Through Static Documents and Links," Proc. 11th IFIP TC13 Int'l Conf. Human-Computer Interaction (Interact 2007), Part I, LNCS 4662, Springer- Verlag, 2007, pp. 102–115.
17. J. Herr, R. Lougheed, and H. A. Neal, "Lecture Archiving on a Larger Scale at the University of Michigan and CERN," J. Physics: Conference Series, vol. 219, no. 8, 2010, doi:10.1088/ 1742-6596/219/8/082003.
18. S. Whittaker, P. Hyland, and M. Wiley, "Filochat: Handwritten Notes Provide Access to Recorded Conversations," Proc. ACM SIGCHI Conf. Human Factors in Computing Systems (CHI 1994), ACM Press, 1994, pp. 271–277.
19. W. Post et al., "Experimental Comparison of Multimodal Meeting Browsers," Proc. 12th Int'l Conf. Human-Computer Interaction (HCII 2007), Human Interface, Part II, LNCS 4558, Springer-Verlag, 2007, pp. 118–127.
19 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool