IEEE Transactions on Pattern Analysis and Machine Intelligence

IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI) is a scholarly archival journal published monthly. This journal covers traditional areas of computer vision and image understanding, all traditional areas of pattern analysis and recognition, and selected areas of machine intelligence. Read the full scope of TPAMI.


Expand your horizons with Colloquium, a monthly survey of abstracts from all CS transactions! Replaces OnlinePlus in January 2017.


From the February 2018 issue

Watch-n-Patch: Unsupervised Learning of Actions and Relations

By Chenxia Wu, Jiemi Zhang, Ozan Sener, Bart Selman, Silvio Savarese, and Ashutosh Saxena

Featured article thumbnail image There is a large variation in the activities that humans perform in their everyday lives. We consider modeling these composite human activities which comprises multiple basic level actions in a completely unsupervised setting. Our model learns high-level co-occurrence and temporal relations between the actions. We consider the video as a sequence of short-term action clips, which contains human-words and object-words. An activity is about a set of action-topics and object-topics indicating which actions are present and which objects are interacting with. We then propose a new probabilistic model relating the words and the topics. It allows us to model long-range action relations that commonly exist in the composite activities, which is challenging in previous works. We apply our model to the unsupervised action segmentation and clustering, and to a novel application that detects forgotten actions, which we call action patching. For evaluation, we contribute a new challenging RGB-D activity video dataset recorded by the new Kinect v2, which contains several human daily activities as compositions of multiple actions interacting with different objects. Moreover, we develop a robotic system that watches and reminds people using our action patching algorithm. Our robotic setup can be easily deployed on any assistive robots.

download PDF View the PDF of this article      csdl View this issue in the digital library


Editorials and Announcements

Announcements

  • We are pleased to announce that Sven Dickinson, a professor in the Department of Computer Science at the University of Toronto, Canada, has been named the new Editor-in-Chief of the IEEE Transactions on Pattern Analysis and Machine Intelligence starting in 2017.
  • According to Clarivate Analytics' 2016 Journal Citation Report, TPAMI has an impact factor of 8.329.

Editorials


Guest Editorials


Reviewers List


Annual Index


Access recently published TPAMI articles

RSS Subscribe to the RSS feed of recently published TPAMI content

mail icon Sign up for e-mail notifications through IEEE Xplore Content Alerts

preprints icon View TPAMI preprints in the Computer Society Digital Library