This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Software Industry Performance: What You Measure Is What You Get
November/December 2010 (vol. 27 no. 6)
pp. 66-72
Charles Symons, COSMIC (the Common Software Measurement International Consortium) , Reigate
The software industry's overall performance is uneven and, at first sight, puzzling. Delivery to time and budget is notoriously poor, and productivity shows limited improvement over time, yet quality can be amazingly good. Customers largely bear the costs of the poor aspects of performance. Many factors drive this performance. This article explores whether causal links exist between the overall observed performance and the commonly used performance metrics, estimating methods and processes, and the way these incentivize suppliers. The author proposes a set of possible improvements to current metrics and estimating methods and processes, and concludes that software professionals must educate their customers on the levers that are available to obtain a better all-round performance from their suppliers.

1. Standish Group, CHAOS Report, 2009; www.standishgroup.com/newsroomchaos_2009.php.
2. J. McManus and T. Wood-Harper, "A Study in Project Failure," BCS, June 2008; www.bcs.orgserver.php?show=ConWebDoc.19584.
3. N. Timmins, "Suppliers Agree to Cut IT Costs for Whitehall," Financial Times,1 Dec. 2006.
4. D. Whitfield, Cost Over-Runs, Delays, and Terminations: 105 Outsourced Public Sector ICT Projects, research report 3, European Services Strategy Unit, Dec. 2007.
5. C. Sauer, A. Gemino, and B.H. Reich, "The Impact of Size and Volatility on IT Project Performance," Comm. ACM, vol. 50, no. 11, 2007, pp. 79–84.
6. J. Weber et al., "Industry Outlook 2004," Business Week,12 Jan. 2004; www.businessweek.com/magazine/content/04_02 b3865601.htm.
7. R. Groth, "Is the Software Industry's Productivity Declining?" IEEE Software, vol. 21, no. 6, 2004, pp. 92–94.
8. Z. Jiang, P. Naudé, and C. Comstock, "An Investigation on the Variation of Software Development: Productivity," Int'l J. Computer & Information Science & Eng., vol. 1, no. 2, 2007, pp. 72–81.
9. A. Rainer, M. Muhammad, and S. Rule, "Report on a Survey Conducted at the ESEPG Conference 2007," Software Measurement Services, 2008; www.measuresw.com/library/Papers/OthersESEPG2007%20QuestionnaireReport%20v1.pdf.
10. A.J. Albrecht, "Measuring Application Development Productivity," IBM Applications Development Symp., 1979, pp. 83–92.
11. "The COSMIC Functional Size Measurement Method Version 3.0.1: Measurement Manual," Common Software Measurement Int'l Consortium, May 2009; www.cosmicon.com/portal/publicCOSMIC%20Method%20v3.0.1%20Measurement%20Manual.pdf.
12. Practical Project Estimation, 2nd ed., Int'l Software Benchmarking Standards Group, 2004.
13. "Southern SCOPE: Avoiding Software Budget Blowouts," Government of the State of Victoria, e-Government Resource Centre; www.egov.vic.gov.au.
14. P.R. Hill, "Software Development Projects in Government: Performance, Practices, and Predictions," Int'l Software Benchmarking Standards Group, Jan. 2004; www.ifpug.org/aboutSoftwareInGovernment.pdf.

Index Terms:
performance measures, cost estimation, productivity, quality
Citation:
Charles Symons, "Software Industry Performance: What You Measure Is What You Get," IEEE Software, vol. 27, no. 6, pp. 66-72, Nov.-Dec. 2010, doi:10.1109/MS.2009.162
Usage of this product signifies your acceptance of the Terms of Use.