2006 IEEE International Conference on Multimedia and Expo
Probabilistic Multimodality Fusion for Event based Home Photo Clustering
Toronto, ON, Canada
July 09-July 12
ISBN: 1-4244-0366-7
Tao Mei, MOE-MS Key Laboratory of Multimedia Computing and Communication, University of Science and Technology of China, Hefei 230027, P.R. China
Bin Wang, MOE-MS Key Laboratory of Multimedia Computing and Communication, University of Science and Technology of China, Hefei 230027, P.R. China
Xian-sheng Hua, Microsoft Research Asia, 5F Sigma Center, 49 Zhichun Road, Beijing 100080, P.R. China
He-qin Zhou, MOE-MS Key Laboratory of Multimedia Computing and Communication, University of Science and Technology of China, Hefei 230027, P.R. China
Shipeng Li, Microsoft Research Asia, 5F Sigma Center, 49 Zhichun Road, Beijing 100080, P.R. China
This paper presents a novel probabilistic approach to fusing multimodal metadata for event based home photo clustering. Photo events are characterized by the coherence of multimodality including time, content and camera settings. We incorporate these multimodal metadata into a unified probabilistic framework, in which event is taken as a latent semantic concept and discovered by fitting a generative model through an Expectation-Maximization (EM) algorithm. This approach is general and unsupervised, without any training procedure or predefined threshold. The experimental evaluations on 14k photos taken by 10 amateur photographers have indicated the effectiveness and efficiency of the proposed framework in browsing and searching personal photo collections.
Citation:
Tao Mei, Bin Wang, Xian-sheng Hua, He-qin Zhou, Shipeng Li, "Probabilistic Multimodality Fusion for Event based Home Photo Clustering," icme, pp.1757-1760, 2006 IEEE International Conference on Multimedia and Expo, 2006
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb