This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Efficient Subframe Video Alignment Using Short Descriptors
Oct. 2013 (vol. 35 no. 10)
pp. 2371-2386
G. D. Evangelidis, Perception Team, INRIA Rhone-Alpes, Grenoble, France
C. Bauckhage, Fraunhofer IAIS, St. Augustin, Germany
This paper addresses the problem of video alignment. We present efficient approaches that allow for spatiotemporal alignment of two sequences. Unlike most related works, we consider independently moving cameras that capture a 3D scene at different times. The novelty of the proposed method lies in the adaptation and extension of an efficient information retrieval framework that casts the sequences as an image database and a set of query frames, respectively. The efficient retrieval builds on the recently proposed quad descriptor. In this context, we define the 3D Vote Space (VS) by aggregating votes through a multiquerying (multiscale) scheme and we present two solutions based on VS entries; a causal solution that permits online synchronization and a global solution through multiscale dynamic programming. In addition, we extend the recently introduced ECC image-alignment algorithm to the temporal dimension that allows for spatial registration and synchronization refinement with subframe accuracy. We investigate full search and quantization methods for short descriptors and we compare the proposed schemes with the state of the art. Experiments with real videos by moving or static cameras demonstrate the efficiency of the proposed method and verify its effectiveness with respect to spatiotemporal alignment accuracy.
Index Terms:
video signal processing,cameras,dynamic programming,image registration,image sequences,natural scenes,quantisation (signal),spatiotemporal phenomena,synchronisation,video retrieval,static cameras,subframe video alignment,short-image descriptors,sequence spatiotemporal alignment accuracy,3D scene capturing,information retrieval framework,image database,query frames,quaddescriptor,3D vote space,3D VS entries,vote aggregation,multiscale multiquerying scheme,causal solution,online synchronization refinement,global solution,multiscale dynamic programming,ECC image-alignment algorithm,temporal dimension,spatial registration,search methods,quantization methods,moving cameras,Cameras,Synchronization,Accuracy,Trajectory,Visualization,Detectors,Video sequences,short image descriptors,Video synchronization,spatiotemporal alignment,image/video retrieval
Citation:
G. D. Evangelidis, C. Bauckhage, "Efficient Subframe Video Alignment Using Short Descriptors," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 35, no. 10, pp. 2371-2386, Oct. 2013, doi:10.1109/TPAMI.2013.56
Usage of this product signifies your acceptance of the Terms of Use.