Issue No.02 - March-April (2013 vol.30)
pp: 74-79
Estimating software development effort is frequently based on assessing the effort of one task relative to that of another. The author presents empirical results that show how relative estimation can result in biased assessments of similarity and overly optimistic effort estimates. Specifically, tasks tend to be assessed as more similar than they actually are. Furthermore, the similarity of two tasks depends on the direction of the comparison, and a comparison based on difference in work hours is distinct from one based on a ratio. From these results and other evidence, the author suggests ways to improve the accuracy of relative estimation.
software cost estimation, overly optimistic effort estimation, relative software development effort estimation, biased similarity assessments, Software devlopment, Estimation, Costs, Psychology, story points, cost estimation, software psychology, relative estimation
Magne Jorgensen, "Relative Estimation of Software Development Effort: It Matters with What and How You Compare", IEEE Software, vol.30, no. 2, pp. 74-79, March-April 2013, doi:10.1109/MS.2012.70
1. S.W. Frederick and D. Mochon, "A Scale Distortion Theory of Anchoring," J. Experimental Psychology: General, vol. 141, no. 1, 2012, pp. 124–133.
2. D. Yang et al., "A Survey on Software Cost Estimation in the Chinese Software Industry," Proc. ACM/IEEE Int'l Symp. Empirical Software Eng. and Measurement, ACM, 2008, pp. 253–262.
3. K. Mol⊘kken-⊘stvold et al., "A Survey on Software Estimation in the Norwegian Industry," Proc. 10th Int'l Symp. Software Metrics, IEEE CS, 2004, pp. 208–219.
4. M. J⊘rgensen, "Forecasting of Software Development Work Effort: Evidence on Expert Judgement and Formal Models," Int'l J. Forecasting, vol. 23, no. 3, 2007, pp. 449–462.
5. M. Jorgensen and S. Grimstad, "The Impact of Irrelevant and Misleading Information on Software Development Effort Estimates: A Randomized Controlled Field Experiment," IEEE Trans. Software Eng., vol. 37, no. 5, 2011, pp. 695–707.
6. M. J⊘rgensen and G. Carelius, "An Empirical Study of Software Project Bidding," IEEE Trans. Software Eng., vol. 30, no. 12, 2004, pp. 953–969.
7. T. Mussweiler, "Comparison Processes in Social Judgment: Mechanisms and Consequences," Psychological Rev., vol. 110, no. 3, 2003, pp. 472–489.
8. M. Wänke and L. Reutner, "Direction-of-Comparison Effects: How and Why Comparing Apples with Oranges Is Different from Comparing Oranges with Apples," Perspectives on Framing, G. Keren, ed., Psychology Press (Taylor and Francis Group), 2010, pp. 177–194.
9. M. J⊘rgensen and S. Grimstad, "Avoiding Irrelevant and Misleading Information When Estimating Development Effort," IEEE Software, vol. 25, no. 3, 2008, pp. 78–83.
10. M. J⊘rgensen, "Top-Down and Bottom-Up Expert Estimation of Software Development Effort," Information and Software Technology, vol. 46, no. 1, 2004, pp. 3–16.
11. J.S. Armstrong, "Combining Forecasts," in Principles of Forecasting: A Handbook for Researchers and Practitioners, J.S. Armstrong ed., Kluwer Academic Publishers, 2001, pp. 417–440.