2005 IEEE International Conference on Multimedia and Expo
Semi-supervised meeting event recognition with adapted HMMs
Amsterdam, Netherlands
July 06-July 06
ISBN: 0-7803-9331-7
D. Zhang, IDIAP Res. Inst., Swiss Fed. Inst. of Technol., Lausanne, Switzerland
D. Gatica-Perez, IDIAP Res. Inst., Swiss Fed. Inst. of Technol., Lausanne, Switzerland
S. Bengio, IDIAP Res. Inst., Swiss Fed. Inst. of Technol., Lausanne, Switzerland
This paper investigates the use of unlabeled data to help labeled data for audio-visual event recognition in meetings. To deal with situations in which it is difficult to collect enough labeled data to capture event characteristics, but collecting a large amount of unlabeled data is easy, we present a semi-supervised framework using HMM adaptation techniques. Instead of directly training one model for each event, we first train a well-estimated general event model for all events using both labeled and unlabeled data, and then adapt the general model to each specific event model using its own labeled data. We illustrate the proposed approach with a set of eight audio-visual events defined in meetings. Experiments and comparison with the fully-supervised baseline method show the validity of the proposed semi-supervised approach.
Index Terms:
audio-visual event, semisupervised framework, meeting event recognition, HMM adaptation technique
Citation:
D. Zhang, D. Gatica-Perez, S. Bengio, "Semi-supervised meeting event recognition with adapted HMMs," icme, pp.4 pp., 2005 IEEE International Conference on Multimedia and Expo, 2005