IEEE Transactions on Pattern Analysis and Machine Intelligence

IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI) is a scholarly archival journal published monthly. This journal covers traditional areas of computer vision and image understanding, all traditional areas of pattern analysis and recognition, and selected areas of machine intelligence. Read the full scope of TPAMI.

Expand your horizons with Colloquium, a monthly survey of abstracts from all CS transactions! Replaces OnlinePlus in January 2017.

From the May 2018 issue

Learning Compositional Sparse Bimodal Models

By Suren Kumar, Vikas Dhiman, Parker A. Koch, and Jason J. Corso

Featured article thumbnail image Various perceptual domains have underlying compositional semantics that are rarely captured in current models. We suspect this is because directly learning the compositional structure has evaded these models. Yet, the compositional structure of a given domain can be grounded in a separate domain thereby simplifying its learning. To that end, we propose a new approach to modeling bimodal perceptual domains that explicitly relates distinct projections across each modality and then jointly learns a bimodal sparse representation. The resulting model enables compositionality across these distinct projections and hence can generalize to unobserved percepts spanned by this compositional basis. For example, our model can be trained on red triangles and blue squares; yet, implicitly will also have learned red squares and blue triangles. The structure of the projections and hence the compositional basis is learned automatically; no assumption is made on the ordering of the compositional elements in either modality. Although our modeling paradigm is general, we explicitly focus on a tabletop building-blocks setting. To test our model, we have acquired a new bimodal dataset comprising images and spoken utterances of colored shapes (blocks) in the tabletop setting. Our experiments demonstrate the benefits of explicitly leveraging compositionality in both quantitative and human evaluation studies.

download PDF View the PDF of this article      csdl View this issue in the digital library

Editorials and Announcements


  • TPAMI now offers authors access to Code Ocean. Code Ocean is a cloud-based executable research platform that allows authors to share their algorithms in an effort to make the world’s scientific code more open and reproducible. Learn more or sign up for free.
  • We are pleased to announce that Sven Dickinson, a professor in the Department of Computer Science at the University of Toronto, Canada, has been named the new Editor-in-Chief of the IEEE Transactions on Pattern Analysis and Machine Intelligence starting in 2017.
  • According to Clarivate Analytics' 2016 Journal Citation Report, TPAMI has an impact factor of 8.329.


Guest Editorials

Reviewers List

Annual Index

Access recently published TPAMI articles

RSS Subscribe to the RSS feed of recently published TPAMI content

mail icon Sign up for e-mail notifications through IEEE Xplore Content Alerts

preprints icon View TPAMI preprints in the Computer Society Digital Library