IEEE Transactions on Pattern Analysis and Machine Intelligence
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI) is a scholarly archival journal published monthly. This journal covers traditional areas of computer vision and image understanding, all traditional areas of pattern analysis and recognition, and selected areas of machine intelligence. Read the full scope of TPAMI.
Expand your horizons with Colloquium, a monthly survey of abstracts from all CS transactions! Replaces OnlinePlus in January 2017.
From the August 2016 issue
ModDrop: Adaptive Multi-Modal Gesture Recognition
By Natalia Neverova, Christian Wolf, Graham Taylor, and Florian Nebout
We present a method for gesture detection and localisation based on multi-scale and multi-modal deep learning. Each visual modality captures spatial information at a particular spatial scale (such as motion of the upper body or a hand), and the whole system operates at three temporal scales. Key to our technique is a training strategy which exploits: i) careful initialization of individual modalities; and ii) gradual fusion involving random dropping of separate channels (dubbed ModDrop) for learning cross-modality correlations while preserving uniqueness of each modality-specific representation. We present experiments on the ChaLearn 2014 Looking at People Challenge gesture recognition track, in which we placed first out of 17 teams. Fusing multiple modalities at several spatial and temporal scales leads to a significant increase in recognition rates, allowing the model to compensate for errors of the individual classifiers as well as noise in the separate channels. Futhermore, the proposed ModDrop training technique ensures robustness of the classifier to missing signals in one or several channels to produce meaningful predictions from any number of available modalities. In addition, we demonstrate the applicability of the proposed fusion scheme to modalities of arbitrary nature by experiments on the same dataset augmented with audio.
Editorials and Announcements
- We are pleased to announce that Sven Dickinson, a professor in the Department of Computer Science at the University of Toronto, Canada, has been named the new Editor-in-Chief of the IEEE Transactions on Pattern Analysis and Machine Intelligence starting in 2017.
- According to Thomson Reuters' 2013 Journal Citation Report, TPAMI has an impact factor of 5.694.
- Get Your Journals as eBooks for Free
- TPAMI Essential Set now available
- State of the Journal (Feb 2016)
- State of the Journal (Jan 2015)
- Editor's Note (June 2013)
- Farewall State of the Journal (Jan 2013)
- Editor's Note (Jan 2013)
- Editor's Note (May 2012)
- Editor's Note (February 2012)
- State of the Journal (January 2012)
- Special Issue on Multimodal Human Pose Recovery and Behavior Analysis (August 2016)
- Special Section on CVPR 2014 (July 2016)
- Special Section on CVPR 2013 (April 2016)
- Special Issue on Higher Order Graphical Models in Computer Vision (July 2015)
- Special Issue on Bayesian Nonparametrics (Feb 2015)
- TPAMI CVPR Special Section (Dec 2013)
- Special Section on Learning Deep Architectures (Aug 2013)
- In Memoriam: Mark Everingham (Nov 2012)
- Introduction to the Special Section on IEEE Conference on Computer Vision and Pattern Recognition (September 2012)
Access recently published TPAMI articles
Subscribe to the RSS feed of latest TPAMI content added to the digital library
Sign up for the Transactions Connection newsletter.