The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.01 - Jan. (2013 vol.35)
pp: 245-251
M. Alterman , Dept. of Electr. Eng., Technion - Israel Inst. of Technol., Haifa, Israel
Y. Y. Schechner , Dept. of Electr. Eng., Technion - Israel Inst. of Technol., Haifa, Israel
P. Perona , Dept. of Electr. Eng., California Inst. of Technol., Pasadena, CA, USA
J. Shamir , Dept. of Electr. Eng., Technion - Israel Inst. of Technol., Haifa, Israel
ABSTRACT
Refraction causes random dynamic distortions in atmospheric turbulence and in views across a water interface. The latter scenario is experienced by submerged animals seeking to detect prey or avoid predators, which may be airborne or on land. Man encounters this when surveying a scene by a submarine or divers while wishing to avoid the use of an attention-drawing periscope. The problem of inverting random refracted dynamic distortions is difficult, particularly when some of the objects in the field of view (FOV) are moving. On the other hand, in many cases, just those moving objects are of interest, as they reveal animal, human, or machine activity. Furthermore, detecting and tracking these objects does not necessitate handling the difficult task of complete recovery of the scene. We show that moving objects can be detected very simply, with low false-positive rates, even when the distortions are very strong and dominate the object motion. Moreover, the moving object can be detected even if it has zero mean motion. While the object and distortion motions are random and unknown, they are mutually independent. This is expressed by a simple motion feature which enables discrimination of moving object points versus the background.
INDEX TERMS
Optical distortion, Cameras, Nonlinear distortion, Covariance matrix, Dynamics, Animals, Vectors,distortion, Motion detection, refraction, random media, classification
CITATION
M. Alterman, Y. Y. Schechner, P. Perona, J. Shamir, "Detecting Motion through Dynamic Refraction", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol.35, no. 1, pp. 245-251, Jan. 2013, doi:10.1109/TPAMI.2012.192
REFERENCES
[1] Y. Adato, Y. Vasilyev, T. Zickler, and O. Ben-Shahar, "Shape from Specular Flow," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 32, no. 11, pp. 2054-2070, Nov. 2010.
[2] S. Agarwal, S. Mallick, D. Kriegman, and S. Belongie, "On Refractive Optical Flow," Proc. European Conf. Computer Vision, 2004.
[3] S. Baglio, C. Faraci, and E. Foti, "Structured Light Approach for Measuring Sea Ripple Characteristics," Proc. Conf. OCEANS, vol. 1, pp. 449-453, 1998.
[4] http://whale.wheelock.edu/whalenet-stuff beaufort.html, 2012.
[5] O. Boiman and M. Irani, "Detecting Irregularities in Images and in Video," Int'l J. Computer Vision, vol. 74, pp. 17-31, 2007.
[6] T. Brox and J. Malik, "Large Displacement Optical Flow: Descriptor Matching in Variational Motion Estimation," IEEE Trans Pattern Analysis and Machine Intelligence, vol. 33, no. 3, pp. 500-513, Mar. 2011.
[7] T. Brox, "Large Displacement Optical Flow Code,$rdquo; http://132.230.167.110/people/brox/resources pami2010Matlab.zip, 2012.
[8] A. Bugeau and P. Pérez, "Detection and Segmentation of Moving Objects in Highly Dynamic Scenes," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2007.
[9] W. Cochran, "The Distribution of Quadratic Forms in a Normal System, with Applications to the Analysis of Covariance," Proc. Cambridge Philosophical Soc., vol. 30, pp. 178-191, 1934.
[10] Y.J. Chang and T. Chen, "Multi-View 3D Reconstruction for Scenes under the Refractive Plane with Known Vertical Direction," Proc. IEEE Int'l Conf. Computer Vision, 2011.
[11] D. Comaniciu and P. Meer, "Mean Shift: A Robust Approach toward Feature Space Analysis," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 24, no. 5, pp. 603-619, May 2002.
[12] D. Comaniciu, V. Ramesh, and P. Meer, "Kernel-Based Object Tracking," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 25, no. 5, pp. 564-575, May 2003.
[13] C. Cox and W. Munk, "Statistics of the Sea Surface Derived from Sun Glitter," J. Marine Research, vol. 13, pp. 198-227, 1954.
[14] D. Dabiri and M. Gharib, "Interaction of a Shear Layer with a Free Surface," Proc. Int'l Symp. Flow Visualization, 2000.
[15] Y. Ding, F. Li, Y. Ji, and J. Yu, "Dynamic 3D Fluid Surface Acquisition Using a Camera Array," Proc. IEEE Int'l Conf. Computer Vision, 2011.
[16] L.S. Dolin, A.G. Luchinin, V.I. Titov, and D.G. Turlaev, "Correcting Images of Underwater Objects Distorted by Sea Surface Roughness," Proc. SPIE, vol. 6615, p. 66150K, 2007.
[17] A. Donate and E. Ribeiro, "Improved Reconstruction of Images Distorted by Water Waves," Proc. Int'l Conf. Computer Vision Theory and Applications, pp. 228-235, 2006.
[18] A. Efros, V. Isler, J. Shi, and M. Visontai, "Seeing through Water," Neural Information Processing Systems, vol. 17, pp. 393-400, 2004.
[19] B. Fishbain, L. Yaroslavsky, and I. Ideses, "Real-Time Stabilization of Long Range Observation System Turbulent Video," J. Real-Time Image Processing, vol. 2, pp. 11-22, 2007.
[20] G. Horváth and D. Varjú, "On the Structure of the Aerial Visual Field of Aquatic Animals Distorted by Refraction," Bull. Math. Biology, vol. 53, pp. 425-441, 1991.
[21] I. Ihrke, K.N. Kutulakos, H.P. Lensch, M.A. Magnor, and W. Heidrich, "State of the Art in Transparent and Specular Object Reconstruction," Proc. Eurographics, 2008.
[22] B. Jähne, J. Klinke, and S. Waas, "Imaging of short Ocean Wind Waves: A Critical Theoretical Review," J. Optical Soc. Am., vol. 11, pp. 2197-2209, 1994.
[23] H. Kleerekoper and T. Malar, Orientation through Sound in Fishes in Hearing Mechanisms in Vertebrates, 1968.
[24] Z. Kalal, J. Matas, and K. Mikolajczyk, "Online Learning of Robust Object Detectors during Unstable Tracking," Proc. On-Line Learning for Computer Vision Workshop, 2009.
[25] G. Katzir and N. Intrator, "Striking of Underwater Prey by a Reef Heron, Egretta Gularis Schistacea," J. Computational Physics A, vol. 160, pp. 517-523, 1987.
[26] T. Ko, S. Soatto, and D. Estrin, "Warping Background Subtraction," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2010.
[27] I.M. Levin, V.V. Savchenko, and V.J. Osadchy, "Correction of an Image Distorted by a Wavy Water Surface: Laboratory Experiment," Applied Optics, vol. 47, pp. 6650-6655, 2008.
[28] R. Liu, Z. Li, and J. Jia, "Image Partial Blur Detection and Classification," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 1-8, 2008.
[29] B. Lucas and T. Kanade, "An Iterative Image Registration Technique with an Application to Stereo Vision," Proc. Seventh Int'l Joint Conf. Artificial Intelligence, vol. 81, pp. 674-679, 1981.
[30] D.M. Milder, P.W. Carter, N.L. Flacco, B.E. Hubbard, N.M. Jones, K.R. Panici, B.D. Platt, R.E. Potter, K.W. Tong, and D.J. Twisselmann, "Reconstruction of Through-Surface Underwater Imagery," Waves in Random Complex Media, vol. 16, no. 4, pp. 521-530, 2006.
[31] D. Miyazaki and K. Ikeuchi, "Shape Estimation of Transparent Objects by Using Inverse Polarization Ray Tracing," IEEE Trans Pattern Analysis and Machine Intelligence, vol. 29, no. 11, pp. 2018-2030, Nov. 2007.
[32] A. Monnet, A. Mittal, N. Paragios, and V. Ramesh, "Background Modeling and Subtraction of Dynamic Scenes," Proc. IEEE Int'l Conf. Computer Vision, 2003.
[33] N.J.W. Morris and K.N. Kutulakos, "Dynamic refraction stereo," Proc. IEEE Int'l Conf. Computer Vision, 2005.
[34] H. Murase, "Surface Shape Reconstruction of a Nonrigid Transport Object Using Refraction and Motion," IEEE Trans Pattern Analysis and Machine Intelligence, vol. 14, no. 10, pp. 1045-1052, Oct. 1992.
[35] O. Oreifej, G. Shu, T. Pace, and M. Shah, "A Two-Stage Reconstruction Approach for Seeing through Water," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2011.
[36] H. Saito, H. Kawamura, and M. Nakajima, "3D Shape Measurement of Underwater Objects Using Motion Stereo," Proc. IEEE 21st Int'l Conf. Industrial Electronics, Control, and Instrumentation, pp. 1231-1235, 2002.
[37] M.S. Schmalz, "Integration of Stereophotogrammetry with Image Restoration Models for Distortion-Tolerant Viewing through the Sea Surface," Proc. SPIE, vol. 1943, pp. 115-128, 1993.
[38] H. Schultz, "Shape Reconstruction from Multiple Images of the Ocean Surface," Surface, Photogrammetric Eng. and Remote Sensing, vol. 62, pp. 93-99, 1994.
[39] H. Schultz and A. Corrada-Emmanuel, "System and Method for Imaging through an Irregular Water Surface," US Patent 7,630,077, 2007.
[40] S. Schuster, S. Rossel, A. Schmidtmann, I. Jager, and J. Poralla, "Archer Fish Learn to Compensate for Complex Optical Distortions to Determine the Absolute Size of Their Aerial Prey," Current Biology, vol. 14, pp. 1565-1568, 2004.
[41] Q. Shan, B. Curless, and T. Kohno, "Seeing through Obscure Glass," Proc. European Conf. Computer Vision, 2010.
[42] J.B. Steen, "The Swim Bladder as a Hydrostatic Organ," Fish Physiology: The Nervous System, Circulation, and Respiration, vol. 4, 1970.
[43] H. Suiter, N. Flacco, P. Carter, K. Tong, R. Ries, and M. Gershenson, "Optics Near the Snell Angle in a Water-to-Air Change of Medium," Proc. Conf. OCEANS, 2008.
[44] Y. Tian and S.G. Narasimhan, "Seeing through Water: Image Restoration Using Model-Based Tracking," Proc. IEEE Int'l Conf. Computer Vision, 2009.
[45] Y. Tian and S.G. Narasimhan, "A Globally Optimal Data-Driven Approach for Image Distortion Estimation," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2010.
[46] Y. Tian and S.G. Narasimhan, "A Globally Optimal Data-Driven Approach for Image Distortion Estimation Code," http:/www.cs.cmu.edu/ ILIM/projects/IM/globalopt/research_globalopt.html, 2012.
[47] T. Treibitz, Y.Y. Schechner, and H. Singh, "Flat Refractive Geometry," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2008.
[48] Z. Wen, A. Lambert, D. Fraser, and H. Li, "Bispectral Analysis and Recovery of Images Distorted by a Moving Water Surface," Applied Optics, vol. 49, pp. 6376-6384, 2010.
[49] R. Westaway, S. Lane, and D. Hicks, "Remote Sensing of Clear-Water, Shallow, Gravel-Bed Rivers Using Digital Photogrammetry," Photogrammetric Eng. and Remote Sensing, vol. 67, pp. 1271-1282, 2001.
[50] L. Wixson, "Detecting Salient Motion by Accumulating Directionally-Consistent Flow," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 22, no. 8, pp. 774-780, Aug. 2002.
[51] Q. Zhu, S. Avidan, and K. Cheng, "Learning a Sparse, Corner-Based Representation for Time-Varying Background Modelling," Proc. IEEE Int'l Conf. Computer Vision, 2005.
[52] M.H. Zweig and G. Campbell, "Receiver-Operating Characteristic (ROC) Plots: A Fundamental Evaluation Tool in Clinical Medicine," Clinical Chemistry, vol. 39, no. 561, 1993.
51 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool