The Community for Technology Leaders
RSS Icon
Subscribe
Anchorage, AK, USA
June 23, 2008 to June 28, 2008
ISBN: 978-1-4244-2339-2
pp: 1-8
Yu Horii , Graduate School of Informatics, Kyoto University, Yoshida-Honmachi, Sakyo, 6068501, Japan
Hiroaki Kawashima , Graduate School of Informatics, Kyoto University, Yoshida-Honmachi, Sakyo, 6068501, Japan
Takashi Matsuyama , Graduate School of Informatics, Kyoto University, Yoshida-Honmachi, Sakyo, 6068501, Japan
ABSTRACT
In this paper, we propose a novel approach to speaker detection by an integration of audio-visual information using the cue of timing structure. We first extract feature sequences of lip motion and sound, and segment each of them into temporal intervals. Then, we construct a cross-media timing-structure model of human speech by learning the temporal relations of overlapping intervals. Based on the learned model, we realize speaker detection by evaluating the timing structure of the observed video and audio. Our experimental result shows the effectiveness of using temporal relations of intervals for speaker detection.
CITATION
Yu Horii, Hiroaki Kawashima, Takashi Matsuyama, "Speaker detection using the timing structure of lip motion and sound", CVPRW, 2008, 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops 2008, pp. 1-8, doi:10.1109/CVPRW.2008.4563183
40 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool