
This Article  
 
Share  
Bibliographic References  
Add to:  
Digg Furl Spurl Blink Simpy Del.icio.us Y!MyWeb  
Search  
 
ASCII Text  x  
Tron Foss, Erik Stensrud, Barbara Kitchenham, Ingunn Myrtveit, "A Simulation Study of the Model Evaluation Criterion MMRE," IEEE Transactions on Software Engineering, vol. 29, no. 11, pp. 985995, November, 2003.  
BibTex  x  
@article{ 10.1109/TSE.2003.1245300, author = {Tron Foss and Erik Stensrud and Barbara Kitchenham and Ingunn Myrtveit}, title = {A Simulation Study of the Model Evaluation Criterion MMRE}, journal ={IEEE Transactions on Software Engineering}, volume = {29}, number = {11}, issn = {00985589}, year = {2003}, pages = {985995}, doi = {http://doi.ieeecomputersociety.org/10.1109/TSE.2003.1245300}, publisher = {IEEE Computer Society}, address = {Los Alamitos, CA, USA}, }  
RefWorks Procite/RefMan/Endnote  x  
TY  JOUR JO  IEEE Transactions on Software Engineering TI  A Simulation Study of the Model Evaluation Criterion MMRE IS  11 SN  00985589 SP985 EP995 EPD  985995 A1  Tron Foss, A1  Erik Stensrud, A1  Barbara Kitchenham, A1  Ingunn Myrtveit, PY  2003 KW  Mean magnitude of relative error KW  software metrics KW  simulation KW  regression analysis KW  prediction models KW  software cost estimation KW  software engineering KW  empirical software engineering KW  prediction accuracy. VL  29 JA  IEEE Transactions on Software Engineering ER   
Abstract—The Mean Magnitude of Relative Error,
[1] L. Angelis and I. Stamelos, A Simulation Tool for Efficient Analogy Based Cost Estimation Empirical Software Eng., vol. 5, pp. 3568, 2000.
[2] L.C. Briand, V.R. Basili, and W.M. Thomas, "A Pattern Recognition Approach for Software Engineering Data Analysis," IEEE Trans. Software Eng., vol. 18, no. 11, pp. 931942, 1992.
[3] L.C. Briand,V.R. Basili,, and C.J. Hetmanski,“Developing interpretable models with optimized set reduction for identifying highrisk software components,” IEEE Transactions on Software Engineering, vol. 19, no. 11, pp. 1,0281,044, Nov. 1993.
[4] L.C. Briand, K. ElEmam, and F. Bomarius, “COBRA: A Hybrid Method for Software Cost Estimation, Benchmarking and Risk Assessment,” Proc. 20th Int'l Conf. Software Eng., pp. 390399, 1998.
[5] L.C. Briand, K. ElEmam, and I. Wieczorek, A Case Study in Productivity Benchmarking: Methods and Lessons Learned Proc. Ninth European Software Control and Metrics Conf., pp. 414, 1998.
[6] L.C. Briand, K. ElEmam, and I. Wieczorek, Explaining the Cost of European Space and Military Projects Proc. 21st Int'l Conf. Software Eng., pp. 303312, 1999.
[7] L.C. Briand, K. ElEmam, K. Maxwell, D. Surmann, and I. Wieczorek, An Assessment and Comparison of Common Cost Software Project Estimation Methods Proc. 21st Int'l Conf. Software Eng., pp. 313322, 1999.
[8] L.C. Briand, T. Langley, and I. Wieczorek, A Replicated Assessment and Comparison of Common Software Cost Modeling Techniques Proc. Int'l Conf. Software Eng., pp. 377386, 2000.
[9] L.C. Briand and D. Pfahl, Using Simulation for Assessing the Real Impact of Test Coverage on Defect Coverage IEEE Trans. Reliability, vol. 49, no. 1, pp. 6070, 2000.
[10] L.C. Briand and I. Wieczorek, Resource Modeling in Software Engineering Encyclopedia of Software Eng., second ed., J. Marciniak, ed., Wiley, in press.
[11] A.F. Chalmers, What is This Thing Called Science? second ed. Buckingham: Open Univ. Press, 1982.
[12] The COCOMO II Suite,http://sunset.usc.edu/research/cocomosuite index.html, 2002.
[13] S.D. Conte, H.E. Dunsmore, and V.Y. Shen, Software Engineering Metrics and Models.Menlo Park, Calif.: Benjamin/Cummings, 1986.
[14] A. Cuelenaere, M. van Genuchten, and F. Heemstra, "Calibrating a Software Cost Estimation Model: Why and How," Information and Software Technology, vol. 20, no. 10, pp. 558567, 1987.
[15] J.M. Desharnais, Analyse Statistique de la Productivite des Projects de Developpement en Informatique a Partir de la Technique des Points de Fonction Master's thesis, Univ. du Quebec a Montreal, 1989.
[16] J.J. Dolado, On the Problem of the Software Cost Function Information Software Technology, vol. 43, no. 1, pp. 6172, 2001.
[17] Encyclopedia of Statistical Sciences, S. Kotz, N.L. Johnson, and C.B. Read, eds., New York: Wiley, 19821998.
[18] D.V. Ferens, Software Cost Estimation in the DoD Environment Am. Programmer, pp. 2834, July 1996.
[19] G. Finnie and G. Wittig, “A Comparison of Software Effort Estimation Techniques: Using Function Points with Neural Networks, CaseBased Reasoning and Regression Models,” J. Systems and Software, vol. 39, pp. 281289, 1997.
[20] T. Foss, I. Myrtveit, and E. Stensrud, MRE and Heteroscedasticity Proc. 12th European Software Control and Metrics Conf., pp. 157164, 2001.
[21] T. Foss, I. Myrtveit, and E. Stensrud, A Comparison of LAD and OLS Regression for Effort Prediction of Software Projects Proc. 12th European Software Control and Metrics Conf., pp. 915, 2001.
[22] K. ElEmam, The Predictive Validity Criterion for Evaluating Binary Classifiers Proc. Second Int'l Software Metrics Symp., pp. 235244, 1998.
[23] T. Foss, I. Myrtveit, and E. Stensrud, A Comparison of LAD and OLS Regression for Effort Prediction of Software Projects Proc. 12th European Software Control and Metrics Conf., pp. 915, 2001.
[24] A.R. Gray and S.G. MacDonell, Software Metrics Data Analysis Exploring the Relative Performance of Some Commonly Used Modeling Techniques Empirical Software Eng., vol. 4, pp. 297316, 1999.
[25] D.N. Gujarati, Basic Econometrics, third ed. New York: McGrawHill, 1995.
[26] R. Jeffery, M. Ruhe, and I. Wieczorek, “Using Public Domain Metrics to Estimate Software Development Effort,” Proc. Seventh IEEE Int'l Metrics Symp., 2001.
[27] R. Jeffery and F. Walkerden, Analogy, Regression and Other Methods for Estimating Effort and Software Quality Attributes Proc. European Conf. Optimizing Software Development and Maintenance, pp. 3746, 1999.
[28] R.L. Jenson and J.W. Bartley, Parametric Estimation of Programming Effort: An ObjectOriented Model J. Systems and Software, vol. 15, pp. 107114, 1991.
[29] M. Jørgensen, “Experience with the Accuracy of Software Maintenance Task Effort Prediction Models,” IEEE Trans. Software Eng., vol. 21, no. 8, pp. 674–681, Aug. 1995.
[30] C. Kemerer, "An Empirical Validation of Software Cost Estimation Models," Comm. ACM, vol. 30, pp. 416429, May 1987.
[31] B.A. Kitchenham, S.G. MacDonell, L.M. Pickard, and M.J. Shepperd, What Accuracy Statistics Really Measure IEE Proc. Software, vol. 148, no. 3, pp. 8185, 2001.
[32] B.A. Kitchenham and K. Kansala, “InterItem Correlations Among Function Points,” Proc. First Int'l Software Metrics Symp., pp. 1114, 1993.
[33] B. Kitchenham, "A Procedure for Analyzing Unbalanced Datasets," IEEE Trans. Software Eng., vol. 24, no. 4, Apr. 1998, pp. 278—300.
[34] A. Koutsoyiannis, Theory of Econometrics, second ed. London: MacMillan, 1977.
[35] S. Makridakis, S.C. Wheelwright, and R.J. Hyndman, Forecasting Methods and Applications, third ed. John Wiley&Sons Inc., 1998.
[36] R. Martin, "Evaluation of Current Software Costing Tools," Software Eng. Notes, vol. 13, no. 3, pp. 4951, 1988.
[37] Minitab Statistical Software Release 13,www.minitab.com, 2000.
[38] Y. Miyazaki, M. Terakado, K. Ozaki, and H. Nozaki, “Robust Regression for Developing Software Estimation Models,” J. Systems and Software, vol. 27, pp. 316, 1994.
[39] T. Mukhopadhyay, S.S. Vicinanza, and M.J. Prietula, "Examining the Feasibility of a CaseBased Reasoning Model for Software Effort Estimation," MIS Quarterly, vol. 16, pp. 155171, June, 1992.
[40] I. Myrtveit and E. Stensrud, "A Controlled Experiment to Assess the Benefits of Estimating with Analogy and Regression Models," IEEE Trans. Software Engineering, vol. 25, no. 4, Jul./Aug. 1999, pp. 510525.
[41] I. Myrtveit and E. Stensrud, “Benchmarking COTS Projects Using Data Envelopment Analysis,” Proc. METRICS'99, pp. 269278, 1999.
[42] P. Nesi and T. Querci, "Effort Estimation and Prediction of ObjectOriented Systems," J. Systems and Software, to appear, 1998.
[43] L. Pickard, B. Kitchenham, and S.J. Linkman, Using Simulated Data Sets to Compare Data Analysis Techniques Used for Software Cost Modelling IEE Proc. Software, vol. 148, no. 6, pp. 165174, Dec. 2001.
[44] J. Rosenberg, “Some Misconceptions About Lines of Code,” Proc. Fourth Int'l Software Metrics Symp., 1997.
[45] B. Samson, D. Ellison, and P. Dugard, Software Cost Estimation Using and Albus Perceptron (CMAC) Information and Software Technology, vol. 39, pp. 5560, 1997.
[46] M. Shepperd and G. Kadoda, Using Simulation to Evaluate Predition Techniques Proc. Proc. Fifth Int'l Software Metrics Symp., pp. 349359, 2001.
[47] M.J. Shepperd and C. Schofield, “Estimating Software Project Effort Using Analogies,” IEEE Trans. Software Eng., vol. 23, pp. 736743, 1997.
[48] K. Srinivasan and D. Fisher, “Machine Learning Approaches to Estimating Software Development Effort,” IEEE Trans. Software Eng., vol. 21, no. 2, pp. 126–137, Feb. 1995.
[49] E. Stensrud and I. Myrtveit, “Human Performance Estimating with Analogy and Regression Models: An Empirical Validation,” Proc. METRICS'98, pp. 205213, 1998.
[50] E. Stensrud, T. Foss, B. Kitchenham, and I. Myrtveit, A Further Empirical Investigation of the Relationship between MRE and Project Size Empirical Software Eng., 2002.
[51] K. Strike, K. ElEmam, and N. Madhavji, Software Cost Estimation with Incomplete Data IEEE Trans. Software Eng., vol. 27, no. 10, pp. 890908, Oct. 2001.
[52] F. Walkerden and R. Jeffery, An Empirical Study of Analogybased Software Effort Estimation Empirical Software Eng., vol. 4, no. 2, pp. 135158, 1999.