The Community for Technology Leaders
RSS Icon
Issue No.06 - November/December (2010 vol.27)
pp: 66-72
Charles Symons , COSMIC (the Common Software Measurement International Consortium) , Reigate
The software industry's overall performance is uneven and, at first sight, puzzling. Delivery to time and budget is notoriously poor, and productivity shows limited improvement over time, yet quality can be amazingly good. Customers largely bear the costs of the poor aspects of performance. Many factors drive this performance. This article explores whether causal links exist between the overall observed performance and the commonly used performance metrics, estimating methods and processes, and the way these incentivize suppliers. The author proposes a set of possible improvements to current metrics and estimating methods and processes, and concludes that software professionals must educate their customers on the levers that are available to obtain a better all-round performance from their suppliers.
performance measures, cost estimation, productivity, quality
Charles Symons, "Software Industry Performance: What You Measure Is What You Get", IEEE Software, vol.27, no. 6, pp. 66-72, November/December 2010, doi:10.1109/MS.2009.162
1. Standish Group, CHAOS Report, 2009;
2. J. McManus and T. Wood-Harper, "A Study in Project Failure," BCS, June 2008; www.bcs.orgserver.php?show=ConWebDoc.19584.
3. N. Timmins, "Suppliers Agree to Cut IT Costs for Whitehall," Financial Times,1 Dec. 2006.
4. D. Whitfield, Cost Over-Runs, Delays, and Terminations: 105 Outsourced Public Sector ICT Projects, research report 3, European Services Strategy Unit, Dec. 2007.
5. C. Sauer, A. Gemino, and B.H. Reich, "The Impact of Size and Volatility on IT Project Performance," Comm. ACM, vol. 50, no. 11, 2007, pp. 79–84.
6. J. Weber et al., "Industry Outlook 2004," Business Week,12 Jan. 2004; b3865601.htm.
7. R. Groth, "Is the Software Industry's Productivity Declining?" IEEE Software, vol. 21, no. 6, 2004, pp. 92–94.
8. Z. Jiang, P. Naudé, and C. Comstock, "An Investigation on the Variation of Software Development: Productivity," Int'l J. Computer & Information Science & Eng., vol. 1, no. 2, 2007, pp. 72–81.
9. A. Rainer, M. Muhammad, and S. Rule, "Report on a Survey Conducted at the ESEPG Conference 2007," Software Measurement Services, 2008;
10. A.J. Albrecht, "Measuring Application Development Productivity," IBM Applications Development Symp., 1979, pp. 83–92.
11. "The COSMIC Functional Size Measurement Method Version 3.0.1: Measurement Manual," Common Software Measurement Int'l Consortium, May 2009;
12. Practical Project Estimation, 2nd ed., Int'l Software Benchmarking Standards Group, 2004.
13. "Southern SCOPE: Avoiding Software Budget Blowouts," Government of the State of Victoria, e-Government Resource Centre;
14. P.R. Hill, "Software Development Projects in Government: Performance, Practices, and Predictions," Int'l Software Benchmarking Standards Group, Jan. 2004;
14 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool