This Article 
 Bibliographic References 
 Add to: 
Parametric Model Fitting: From Inlier Characterization to Outlier Detection
March 1998 (vol. 20 no. 3)
pp. 263-280

Abstract—Parametric models play an important role in broad areas of science and technology. This paper presents a novel framework for the fitting of multiple parametric models. It comprises of a module for parameter estimation based on a solution for generalized least squares problems and of a procedure for error propagation, which takes both the geometric arrangement of the input data points and their precision into account. The results from error propagation are used to complement each model parameter with a precision estimate, to assign an inlier set of data points supporting the fit to each extracted model, and to determine the a priori unknown total number of meaningful models in the data. Although the models are extracted sequentially, the final result is almost independent of the extraction order. This is achieved by further statistical processing which controls the mutual exchange of inlier data between the models. Consequently, sound data classification as well as robust fitting are guaranteed even in areas where different models intersect or touch each other. Apart from the input data and its precision, the framework relies on only one additional control parameter: the confidence level on which the various statistical tests for data and model classification are carried out. We demonstrate the algorithmic performance by fitting straight lines in 2D and planes in 3D with applications to problems of computer vision and pattern recognition. Synthetic data is used to show the robustness and accuracy of the scheme. Image data and range data are used to illustrate its applicability and relevance in respect of real-world problems, e.g., in the domain of image feature extraction.

[1] W. Grimson, Object Recognition by Computer: The Role of Geometric Constraints. MIT Press, 1990.
[2] F. Stein and G. Medioni, "Recognition of 3-D Objects from 2-D Groupings," DARPA Image Understanding, pp. 667-674, Jan. 1992.
[3] R. Mohan and R. Nevatia, "Perceptual Organization for Scene Segmentation and Description," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 14, no. 6, pp. 616-635, June 1992.
[4] C.J. Taylor and D.J. Kriegman, Structure and Motion from Line Segments in Multiple Images IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 17, no. 11, pp. 1021-1032, Nov. 1995.
[5] G. McLean and D. Kotturi, “Vanishing Point Detection by Line Clustering,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 17, no. 11, pp. 1,090-1,095, Nov. 1995.
[6] G. Klinker, S. Shafer, and T. Kanade, "Using a Color Reflection Model to Separate Highlights from Object Color," Proc. Int'l Conf. Computer Vision '87, pp. 145-150, 1987.
[7] P. Rousseeuw and A. Leroy, Robust Regression and Outlier Detection.New York: John Wiley&Sons, 1987.
[8] G. Danuser and E. Mazza, "Observing Deformations of 20 Nanometer With A Low Numerical Aperture Light Microscope," Optical Inspection and Micromeasurements, vol. 2,782, pp. 180-191, European Optical Soc., SPIE, 1996.
[9] S. Han, D.B. Goldgof, and K.W. Bowyer, “Using Hyperquadrics for Shape Recovery from Range Data,” IEEE Proc. Third Int'l Conf. Computer Vision, pp. 492-496, 1993.
[10] D. Keren,D. Cooper,, and J. Subrahmonia,“Describing complicated objects by implicit polynomials,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 16, no. 1, pp. 38-53, 1994.
[11] A. Matheny and D. Goldgof, "The Use of Three- and Four-Dimensional Surface Harmonics for Rigid and Nonrigid Shape Recovery and Representation," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 17, no. 10, pp. 967-981, Oct. 1995.
[12] J. Illingworth and J. Kittler, "A Survey of the Hough Transform," Computer Vision, Graphics, and Image Processing, vol. 44, pp. 87-116, 1988.
[13] R.C. Bolles and M.A. Fischler, "Random Sample Consenus: A Paradigm for Model Fitting with Applications to Image Analysis and Automated Cartography," Comm. ACM, vol. 24, no. 6, pp. 381-395, 1981.
[14] P. Meer, D. Mintz, and A. Rosenfeld, "Robust Regression Methods for Computer Vision," Int'l J. Computer Vision, vol. 6, no. 1, pp. 59-70, 1991.
[15] C.V. Stewart, “MINPRAN: A New Robust Estimator for Computer Vision,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 17, no. 10, pp. 925-938, Oct. 1995.
[16] J. Kittler and P. Palmer, "Robust and Statistically Efficient Detection of Parametric Curves in 2D Images," Performance Versus Methodology in Computer Vision, pp. 111-123, NFS/ARPA Workshop, Seattle, Wash., June 1994.
[17] D. Ruppert and J. Carrol, "Trimmed Least Squares Estimation in the Linear Model," J. Am. Statistical Assoc., vol. 75, no. 372, pp. 828-838, 1980.
[18] P. Huber, Robust Statistics.New York: John Wiley&Sons, 1981.
[19] F. Hampel, E. Ronchetti, P. Rousseeuw, and W. Stahel, Robust statistics: An Approach Based on Influence Functions.New York: John Wiley&Sons, 1986.
[20] A. Beaton and J. Tukey, "The Fitting of Power Series, Meaning Polynomials, Illustrated on Band-Spectroscopic Data," Technometrics, vol. 16, pp. 147-185, 1974.
[21] I. Weiss, "Line Fitting in a Noisy Image," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 11, no. 3, pp. 325-329, Mar. 1989.
[22] D. Chen, "A Data-Driven Intermediate Level Feature Extraction Algorithm," IEEE Trans. on Pattern Analysis and Machine Intelligence, vol. 11, no. 7, pp. 749-758, July 1989.
[23] A. Leonardis, A. Gupta, and R. Bajcsy, "Segmentation of Range Images as the Search for Geometric Parametric Models," Int'l J. Computer Vision, vol. 14, pp. 253-277, 1995.
[24] G. Roth and M.D. Levine, "Extracting Geometric Primitives," Computer Vision, Graphics, and Image Processing: Image Understanding, vol. 58, pp. 1-22, July 1993.
[25] B. Kamgar-Parsi, B. Kamgar-Parsi, and H. Wechsler, "Simultaneous Fitting of Several Planes to Point Sets Using Neural Networks," Computer Vision, Graphics, and Image Processing, vol. 52, pp. 341-359, 1990.
[26] G. Taubin, "An improved algorithm for algebraic curve and surface fitting," Proc. Fourth Int'l Conf. Computer Vision, pp. 658-665,Berlin, Germany, May 1993.
[27] A. Sen and M. Srivastava, Regression Analysis—Theory, Methods, and Applications. Springer Verlag, 1990.
[28] K.R. Koch, Parameter Estimation and Hypothesis Testing in Linear Models. Springer Verlag, 1988.
[29] W. Baarda, "A Testing Procedure for Use in Geodetic Networks," Publications on Geodesy, vol. 2, no. 5, pp. 1-97, Netherlands Geodetic Commission, 1968.
[30] W. Förstner, "Reliability Analysis of Parameter Estimation in Linear Models with Applications to Mensuration Problems in Computer Vision," Computer Vision, Graphics, and Image Processing, vol. 40, pp. 273-310, 1987.
[31] G. Watson, "The Solution of Generalized Least Squares Problems," Multivariate Approximation Theory III, Int'l S. Numerical Mathematics, vol. 75, pp. 388-400, Birkhäuser, 1985.
[32] H. Schwetlick and V. Tiller, "Numerical Methods for Estimating Parameters in Nonlinear Models with Errors in Variables," Technometrics, vol. 27, no. 1, pp. 17-24, 1985.
[33] O. Faugeras, Three Dimensional Computer Vision: A Geometric Viewpoint, ch. "Modeling and Calibrating Cameras," pp. 33-68. MIT Press, 1993.
[34] W. Gander, G. Golub, and R. Strebel, "Least Squares Fitting of Circles and Ellipses," BIT, vol. 34, no. 4, pp. 556-577, 1994.
[35] P. Gill, W. Murray, and M. Wright, Practical Optimization. Academic Press, 1981.
[36] M. Box, "Bias in Nonlinear Estimation," J. Royal Statistical Soc., vol. B-33, no. 2, pp. 171-202, 1971.
[37] K. Kanatani, "Statistical Optimization for Geometric Computation: Theory and Practice," Machine Intelligence and Pattern Recognition, vol. 18. Elsevier, 1996.
[38] M. O'Neill, I. Sinclair, and F. Smith, "Polynomial Curve Fitting When Abscissas and Ordinates Are Both Subject to Error," The Computer J., vol. 12, pp. 52-56, 1969.
[39] G. Goloub and C. van Loan, "An Analysis of the Total Least Squares Problem," SIAM J. of Numerical Analysis, vol. 17, no. 6, pp. 883-893, 1980.
[40] W. Deming, Statistical Adjustment of Data.New York: John Wiley, 1943.
[41] D. York, "Least-Squares Fitting of a Straight Line," Canadian J. of Physics, vol. 44, pp. 1,079-1,086, 1966.
[42] H. Britt and R. Luecke, "The Estimation of Parameters in Nonlinear Implicit Models," Technometrics, vol. 15, no. 2, pp. 233-247, 1973.
[43] B. Burns, A. Hanson, and E. Riseman, "Extracting Straight Lines," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 8, no. 4, pp. 425-455, July 1986.
[44] J. Canny, "A Computational Approach to Edge Detection," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 8, no. 6, pp. 679-698, Nov. 1986.
[45] F. Heitger, "Feature Detection using Suppression and Enhancement," Technical Report, Image Science Group, ETH Zürich, 1995. http:/
[46] M. Rutishauser, M. Stricker, and M. Trobina, "Merging Range Images of Arbitrarily Shaped Objects," Proc. IEEE Computer Vision and Pattern Recognition, pp. 573-580, 1994.
[47] O. Monga, R. Deriche, and J.-M. Rocchisani, "3D Edge Detection Using Recursive Filtering: Application to Scanner Images," Computer Vision, Graphics, and Image Processing, vol. 53, pp. 76-87, 1991.
[48] H.D. Tagare and R. deFigueiredo, "On the Localization Performance Measure and Optimal Edge Detection," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 12, no. 12, pp. 1,186-1,190, Dec. 1990.
[49] S.-T. Wang and T. Binford, "Generic, Model-Based Estimation and Detection of Discontinuities in Image Surfaces," Image Understanding Workshop, pp. 1,443-1,449, 1994.
[50] M. Stricker and A. Leonardis, "Exsel++: A General Framework to Extract Parametric Models," Proc. Sixth Int'l Conf. Computer Analysis of Images and Patterns, LNCS, no. 970, pp. 90-97, 1995.
[51] G. Danuser and M. Stricker, "Parametric Model Fitting: From Inlier Characterization to Outlier Detection," Technical Report 170, Image Science Lab, ETH Zürich, 1996. http:/
[52] G. Danuser, Quantitative Stereo Vision for the Stereo Light Microscope: An Attempt to Provide Control Feedback for a Nanorobot System. PhD thesis, ETH Zürich, 1997.
[53] C. Rothwell, J. Mundy, W. Hoffman, and V. Nguyen, "Driving Vision by Topology," Int'l Symp. Computer Vision, pp. 395-400, 1995.

Index Terms:
Parametric models, generalized least squares, errors in variables, data snooping, classify-while-fit, self-diagnosis, straight lines, planes.
Gaudenz Danuser, Markus Stricker, "Parametric Model Fitting: From Inlier Characterization to Outlier Detection," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 20, no. 3, pp. 263-280, March 1998, doi:10.1109/34.667884
Usage of this product signifies your acceptance of the Terms of Use.