This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Simultaneous Video Stabilization and Moving Object Detection in Turbulence
Feb. 2013 (vol. 35 no. 2)
pp. 450-462
O. Oreifej, Univ. of Central Florida, Orlando, FL, USA
Xin Li, Univ. of Central Florida, Orlando, FL, USA
M. Shah, Univ. of Central Florida, Orlando, FL, USA
Turbulence mitigation refers to the stabilization of videos with nonuniform deformations due to the influence of optical turbulence. Typical approaches for turbulence mitigation follow averaging or dewarping techniques. Although these methods can reduce the turbulence, they distort the independently moving objects, which can often be of great interest. In this paper, we address the novel problem of simultaneous turbulence mitigation and moving object detection. We propose a novel three-term low-rank matrix decomposition approach in which we decompose the turbulence sequence into three components: the background, the turbulence, and the object. We simplify this extremely difficult problem into a minimization of nuclear norm, Frobenius norm, and 21 norm. Our method is based on two observations: First, the turbulence causes dense and Gaussian noise and therefore can be captured by Frobenius norm, while the moving objects are sparse and thus can be captured by 21 norm. Second, since the object's motion is linear and intrinsically different from the Gaussian-like turbulence, a Gaussian-based turbulence model can be employed to enforce an additional constraint on the search space of the minimization. We demonstrate the robustness of our approach on challenging sequences which are significantly distorted with atmospheric turbulence and include extremely tiny moving objects.
Index Terms:
video signal processing,atmospheric turbulence,Gaussian noise,image motion analysis,matrix decomposition,object detection,atmospheric turbulence,simultaneous video stabilization,moving object detection,turbulence mitigation,optical turbulence,averaging techniques,dewarping techniques,three-term low-rank matrix decomposition approach,turbulence sequence,background,nuclear norm,Frobenius norm,21 norm,Gaussian noise,Gaussian-like turbulence,Gaussian-based turbulence model,Optimization,Mathematical model,Equations,Minimization,Matrix decomposition,Force,Object detection,restoring force,Three-term decomposition,turbulence mitigation,rank optimization,moving object detection,particle advection
Citation:
O. Oreifej, Xin Li, M. Shah, "Simultaneous Video Stabilization and Moving Object Detection in Turbulence," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 35, no. 2, pp. 450-462, Feb. 2013, doi:10.1109/TPAMI.2012.97
Usage of this product signifies your acceptance of the Terms of Use.