This Article 
 Bibliographic References 
 Add to: 
Evaluating Alternative Software Production Functions
June 1997 (vol. 23 no. 6)
pp. 379-387

Abstract—Software development projects are notorious for cost overruns and schedule delays. While dozens of software cost models have been proposed, few of them seem to have any degree of consistent accuracy. One major factor contributing to this persistent and wide spread problem is an inadequate understanding of the real behavior of software development processes. We believe that software development could be studied as an economic production process and that established economic theories and methods could be used to develop and validate software production and cost models. Here, we present the results of evaluating four alternative software production models using the P-test, a statistical procedure developed specifically for testing the truth of a hypothesis in the presence of alternatives in econometric studies. We found that the truth of the widely used Cobb-Douglas type of software production and cost models (e.g., COCOMO) cannot be maintained in the presence of quadratic or translog models. Overall, the quadratic software production function is shown to be the most plausible model for representing software production processes. Limitations of this study and future directions are also discussed.

[1] A.J. Albrecht and J. Gaffney, "Software Function, Source Lines of Code, and Development Effort Prediction: A Software Science Validation," IEEE Trans. Software Eng., vol. 15, no. 6, pp. 639-648, 1983.
[2] A.C. Atkinson, "A Method for Discriminating Between Models," J. Royal Statistical Soc., vol. 32, pp. 323-344, 1970.
[3] J.W. Bailey and V.R. Basili, ”A Meta Model for Software Development Resource Expenditure,” Proc. Int'l Conf. Software Eng., pp. 107–115, Mar. 1981.
[4] R.D. Banker, "Estimating Most Productive Scale Size Using Data Envelopment Analysis," European J. Operational Research, vol. 17, no. 1, pp. 35-44, 1984.
[5] R.D. Banker, H. Chang, and C.F. Kemerer, "Evidence on Economies of Scale in Software Development," Information and Software Technology, vol. 36, no. 5, pp. 275-282, 1994.
[6] R.D. Banker, S.M. Datar, and C.F. Kemerer, "A Model to Evaluate Variables Impacting the Productivity of Software Maintenance Projects," Management Science, vol. 37, pp. 1-18, Jan. 1991.
[7] R.D. Banker and C.F. Kemerer, "Scale of Economies in New Software Development," IEEE Trans. Software Eng., vol. 15, no. 10, pp. 1,199-1,205, 1989.
[8] L.A. Belady and M.M. Lehman, "The Characteristics of Large Systems," P. Wegner, J. Dennis, M. Hammer, and D. Teichroew, eds., Research Directions in Software Technology.Cambridge, Mass.: MIT Press, 1979.
[9] B. Boehm, Software Engineering Economics, Prentice Hall, Upper Saddle River, N.J., 1981, pp. 533-535.
[10] B.W. Boehm, "Improving Software Productivity," Computer, vol. 20, no. 9, pp. 43-57, 1987.
[11] F.P. Brooks, Jr., The Mythical Man-Month: Essays on Software Engineering, Addison Wesley Longman, Reading, Mass., 1975.
[12] L.R. Christenson, D.W. Jorgenson, and L.J. Lau, "Conjugate Duality and the Transcendental Logarithmic Function," Econometrica, vol. 39, no. 4, pp. 255-256, 1971.
[13] S.D. Conte, H.E. Dunsmore, and V.Y. Shen, Software Engineering Metrics and Models.Menlo Park, Calif.: Benjamin/Cummings, 1986.
[14] D.R. Cox, "Test of Separated Families of Hypotheses," Proc. Fourth Berkeley Symp. Math. Statistics and Probability, vol. 1, Univ. of California Press, 1961.
[15] D.R. Cox, "Further Results on Tests of Separate Families of Hypotheses," J. Royal Statistic Soc., series B, vol. 24, pp. 406-424, 1962.
[16] A. Cuelenaere, M. van Genuchten, and F. Heemstra, "Calibrating a Software Cost Estimation Model: Why and How," Information and Software Technology, vol. 20, no. 10, pp. 558-567, 1987.
[17] R. Davidson and J.G. MacKinnon, "Several Tests for Model Specification in the Presence of Alternative Hypotheses," Econometrica, vol. 49, pp. 781-793, 1981.
[18] M. van Genuchten, Towards a Software Factory.Dordrecht, The Netherlands: Kluwer Academic, 1992.
[19] D.F. Heathfield and S. Wibe, An Introduction to Cost and Production Functions.Atlantic Highlands, N.J.: Humanities Press Int'l, Inc., 1987.
[20] Y.C. Ho and C. McDevitt, "Determination of Optimal Resource Allocation for Software Development—An Application of Software Equation," Information&Management, vol. 18, no. 2, pp. 79-85, 1990.
[21] Q. Hu, "A Theory of Software Production," PhD dissertation, Univ. of Miami, Coral Gables, Fla., 1994.
[22] T.G. James, "Software Cost Estimating Methodology," IEEE Proc. National Aerospace Electronics Conf., pp. 22-28, 1977.
[23] M. Jørgensen, “Experience with the Accuracy of Software Maintenance Task Effort Prediction Models,” IEEE Trans. Software Eng., vol. 21, no. 8, pp. 674–681, Aug. 1995.
[24] C. Kemerer, "An Empirical Validation of Software Cost Estimation Models," Comm. ACM, vol. 30, pp. 416-429, May 1987.
[25] B.A. Kitchenham, "Making Process Predictions," N.E. Fenton, ed., Software Metrics: An Rigorous Approach.London: Chapman&Hall, 1991.
[26] B.A. Kitchenham, "Empirical Studies of Assumptions that Underlie Software Cost-Estimation Models," Information and Software Technology, vol. 34, no. 4, pp. 211-218, 1992.
[27] B.A. Kitchenham and N.R. Taylor, "Software Development Cost Estimation" J. Systems and Software, vol. 5, no. 5, pp. 267-278, 1985.
[28] J.E. Matson, B.E. Barret, and J.M. Mellichamp, “Software Development Cost Estimation Using Function Points,” IEEE Trans. Software Eng., vol. 20, no. 4, pp. 275–287, Apr. 1994.
[29] R. Marouane and A. Mili, "Economics of Software Project Management in Tunisia: Basic TUCOMO," Information and Software Technology, vol. 31, no. 5, pp. 251-257, 1989.
[30] R. Marouane and A. Mili, "Building Tailor-Made Software Cost Model: Intermediate TUCOMO," Information and Software Technology, vol. 33, no. 3, pp. 232-238, 1991.
[31] S.N. Mohanty, "Software Cost Estimation: Present and Future," Software Practice and Experience, vol. 11, no. 2, pp. 103-121, 1981.
[32] M.H. Pesaran, "On the General Problem of Model Selection," Review of Economic Studies, vol. 41, pp. 153-171, 1974.
[33] M.H. Pesaran and A.S. Deaton, "Testing Non-Nested Nonlinear Regression Models," Econometrica, vol. 46, pp. 677-694, 1978.
[34] L.H. Putnam, "A General Empirical Solution to the Macro Software Sizing and Estimating Problem," IEEE Trans. Software Eng., vol. 4, no. 4, pp. 345-361, 1978.
[35] L.H. Putnam and W. Myers, Measures for Excellence: Reliable Software on Time, Within Budget, Yourdon Press, Englewood Cliffs, N.J., 1992.
[36] P.A. Samuelson, Foundations of Economic Analysis.New York: Atheneum, 1965.
[37] V. Schneider, "Prediction of Software Effort and Project Duration—Four New Formulas," SIGPLAN Notices, vol. 13, no. 6, pp. 49-59, 1978.
[38] I. Vessey, "On Program Development Effort and Productivity," Information&Management, vol. 10, no. 5, pp. 255-266, 1986.
[39] C.E. Walston and C.P. Felix, "A Method of Programming Measurement and Estimation," IBM Systems J., vol. 16, no. 1, pp. 54-73, 1977.

Index Terms:
Software engineering economics, software cost models, production functions, software process modeling, software development.
Qing Hu, "Evaluating Alternative Software Production Functions," IEEE Transactions on Software Engineering, vol. 23, no. 6, pp. 379-387, June 1997, doi:10.1109/32.601078
Usage of this product signifies your acceptance of the Terms of Use.