From the November 2013 issue
Markerless Motion Capture of Multiple Characters Using Multiview Image Segmentation
By Yebin Liu, Juergen Gall, Qionghai Dai, Hans-Peter Seidel, and Christian Theobalt
Capturing the skeleton motion and detailed time-varying surface geometry of multiple, closely interacting peoples is a very challenging task, even in a multicamera setup, due to frequent occlusions and ambiguities in feature-to-person assignments. To address this task, we propose a framework that exploits multiview image segmentation. To this end, a probabilistic shape and appearance model is employed to segment the input images and to assign each pixel uniquely to one person. Given the articulated template models of each person and the labeled pixels, a combined optimization scheme, which splits the skeleton pose optimization problem into a local one and a lower dimensional global one, is applied one by one to each individual, followed with surface estimation to capture detailed nonrigid deformations. We show on various sequences that our approach can capture the 3D motion of humans accurately even if they move rapidly, if they wear wide apparel, and if they are engaged in challenging multiperson motions, including dancing, wrestling, and hugging.
Editorials and Announcements
- Get Your Journals as eBooks for Free
- We are pleased to announce that David Forsyth, a professor at the University of Illinois at Urbana-Champaign, is the new Editor in Chief of IEEE Transactions on Pattern and Machine Intelligence starting in 2013. He was previously a member of the advisory board of TPAMI.
- Print on Demand is Now Available for OnlinePlus Titles
- eBooks of issues of TPAMI can now be downloaded from the Computer Society Digital Library
- TPAMI Essential Set now available
- Editor's Note (June 2013)
- Farewall State of the Journal (Jan 2013)
- Editor's Note (Jan 2013)
- Editor's Note (May 2012)
- Editor's Note (February 2012)
- State of the Journal (January 2012)
- Special Section on Learning Deep Architectures (Aug 2013)
- In Memoriam: Mark Everingham (Nov 2012)
- Introduction to the Special Section on IEEE Conference on Computer Vision and Pattern Recognition (September 2012)
Access recently published TPAMI articles
Subscribe to the RSS feed of latest TPAMI content added to the digital library
Sign up for the Transactions Connection newsletter.
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI) is a scholarly archival journal published monthly. This journal covers traditional areas of computer vision and image understanding, all traditional areas of pattern analysis and recognition, and selected areas of machine intelligence.
Read the full scope of TPAMI