This Article 
 Bibliographic References 
 Add to: 
Are MSER Features Really Interesting?
November 2011 (vol. 33 no. 11)
pp. 2316-2320
Ron Kimmel, Technion, Haifa
Cuiping Zhang, CMART Systems, Inc., Santa Clara
Alexander M. Bronstein, Tel Aviv University, Tel Aviv
Michael M. Bronstein, Universita' della Svizzera Italiana, Lugano
Detection and description of affine-invariant features is a cornerstone component in numerous computer vision applications. In this note, we analyze the notion of maximally stable extremal regions (MSERs) through the prism of the curvature scale space, and conclude that in its original definition, MSER prefers regular (round) regions. Arguing that interesting features in natural images usually have irregular shapes, we propose alternative definitions of MSER which are free of this bias, yet maintain their invariance properties.

[1] J. Sivic and A. Zisserman, "Video Google: A Text Retrieval Approach to Object Matching in Videos," Proc. IEEE Int'l Conf. Computer Vision, 2003.
[2] D.G. Lowe, "Distinctive Image Features from Scale-Invariant Keypoints," Int'l J. Computer Vision, vol. 60, no. 2, pp. 91-110, 2004.
[3] G. Yu and J.M. Morel, "A Fully Affine Invariant Image Comparison Method," Proc. IEEE Int'l Conf. Acoustics, Speech and Signal Processing, pp. 1597-1600, 2009.
[4] J. Matas, O. Chum, M. Urban, and T. Pajdla, "Robust Wide Baseline Stereo from Maximally Stable Extremal Regions," Proc. British Machine Vision Conf., pp. 384-393, 2002.
[5] A. Desolneux, L. Moisan, and J.M. Morel, "Edge Detection by Helmholtz Principle," J. Math. Imaging and Vision, vol. 14, pp. 271-284, 2001.
[6] F. Cao, J. Lisani, J.M. Morel, P. Musé, and F. Sur, A Theory of Shape Identification. Springer, 2008.
[7] A.M. Bruckstein, R.J. Holt, A. Netravali, and T.J. Richardson, "Invariant Signatures for Planar Shape Recognition under Partial Occlusion," CVGIP: Image Understanding, vol. 58, no. 1, pp. 49-65, 1993.
[8] A.M. Bruckstein and D. Shaked, "Skew Symmetry Detection via Invariant Signatures," Pattern Recognition, vol. 31, no. 2, pp. 181-192, 1998.
[9] K. Mikolajczyk, T. Tuytelaars, C. Schmid, A. Zisserman, J. Matas, F. Schaffalitzky, T. Kadir, and L. van Gool, "A Comparison of Affine Region Detectors," Int'l J. Computer Vision, vol. 65, nos. 1/2, pp. 43-72, 2005.
[10] P. Forssèn and D. Lowe, "Shape Descriptors for Maximally Stable Extremal Regions," Proc. IEEE Int'l Conf. Computer Vision, 2007.
[11] Geometric-Driven Diffusion in Computer Vision, B.M. ter Haar Romeny, ed. Kluwer Academic Publishers, 1994.
[12] F. Guichard and J.M. Morel, "Image Analysis and P.D.E.s," IPAM GBM Tutorial, 2001.
[13] B.B. Kimia, "Toward a Computational Theory of Shape," PhD dissertation, Dept. of Electrical Eng., McGill Univ., 1990.
[14] M.A. Grayson, "The Heat Equation Shrinks Embedded Plane Curves to Round Points," J. Differential Geometry, vol. 26, pp. 285-314, 1987.
[15] M. Gage and R.S. Hamilton, "The Heat Equation Shrinking Convex Plane Curves," J. Differential Geometry, vol. 23, pp. 69-96, 1986.
[16] S.J. Osher and J.A. Sethian, "Fronts Propagating with Curvature Dependent Speed: Algorithms Based on Hamilton-Jacobi Formulations," J. Computational Physics, vol. 79, pp. 12-49, 1988.
[17] G. Sapiro, "Topics in Shape Evolution," DSc thesis, Technion-Israel Inst. of Tech nology, 1993.
[18] L. Alvarez, F. Guichard, P.L. Lions, and J.M. Morel, "Axioms and Fundamental Equations of Image Processing," Archive for Rational Mechanics and Analysis, vol. 123, pp. 199-257, 1993.
[19] R. Kimmel, Numerical Geometry of Images. Springer, 2004.
[20] Š. Obdrzálek and J. Matas, "Object Recognition Using Local Affine Frames on Maximally Stable Extremal Regions," Toward Category-Level Object Recognition, pp. 85-108, Springer, 2006.
[21] M. Hu, "Visual Pattern Recognition by Moment Invariants," IEEE Trans. Information Theory, vol. 8, no. 2, pp. 179-187, Feb. 1962.
[22] R. Kimmel, C. Zhang, A.M. Bronstein, and M.M. Bronstein, "Feature-Based Image Alignment via Coupled Hough Transforms," Technical Report 2009-09, Technion, CIS, 2009.
[23] D.G. Kirkpatrick and R. Seidel, "The Ultimate Planar Convex Hull Algorithm," SIAM J. Computing, vol. 15, no. 1, pp. 287-299, 1986.
[24] P. Fua and Y. Leclerc, "Model Driven Edge Detection," Machine Vision and Applications, vol. 3, no. 1, pp. 45-56, 1990.
[25] R. Kimmel and A.M. Bruckstein, "On Edge Detection, Edge Integration and Geometric Active Contours," Proc. Int'l Symp. Math. Morphology, p. 37, 2002.
[26] P.J. Olver, Equivalence, Invariants, and Symmetry. Cambridge Univ. Press, 1995.
[27] R. Kimmel, "Affine Differential Signatures for Gray Level Images of Planar Shapes," Proc. Int'l Conf. Pattern Recognition, 1996.
[28] A. Vedaldi and B. Fulkerson, "VLFeat: An Open and Portable Library of Computer Vision Algorithms," http:/, 2008.

Index Terms:
MSER, feature detector, affine invariance, stable region, correspondence.
Ron Kimmel, Cuiping Zhang, Alexander M. Bronstein, Michael M. Bronstein, "Are MSER Features Really Interesting?," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 33, no. 11, pp. 2316-2320, Nov. 2011, doi:10.1109/TPAMI.2011.133
Usage of this product signifies your acceptance of the Terms of Use.