Issue No.03 - May-June (2012 vol.38)
pp: 677-693
Magne Jørgensen , University of Oslo, Lysaker
Software development effort estimates are frequently too low, which may lead to poor project plans and project failures. One reason for this bias seems to be that the effort estimates produced by software developers are affected by information that has no relevance for the actual use of effort. We attempted to acquire a better understanding of the underlying mechanisms and the robustness of this type of estimation bias. For this purpose, we hired 374 software developers working in outsourcing companies to participate in a set of three experiments. The experiments examined the connection between estimation bias and developer dimensions: self-construal (how one sees oneself), thinking style, nationality, experience, skill, education, sex, and organizational role. We found that estimation bias was present along most of the studied dimensions. The most interesting finding may be that the estimation bias increased significantly with higher levels of interdependence, i.e., with stronger emphasis on connectedness, social context, and relationships. We propose that this connection may be enabled by an activation of one's self-construal when engaging in effort estimation, and a connection between a more interdependent self-construal and increased search for indirect messages, lower ability to ignore irrelevant context, and a stronger emphasis on socially desirable responses.
Effort estimation, estimation bias, cultural differences, software engineering.
Magne Jørgensen, "Software Development Estimation Biases: The Role of Interdependence", IEEE Transactions on Software Engineering, vol.38, no. 3, pp. 677-693, May-June 2012, doi:10.1109/TSE.2011.40
[1] J.L. Aaker and D. Maheswaran, "The Effect of Cultural Orientation on Persuation," J. Consumer Research, vol. 24, no. 3, pp. 315-328, 1997.
[2] N. Agrawal and D. Maheswaran, "The Effects of Self-Construal and Commitment on Persuasion," J. Consumer Research, vol. 31, pp. 841-849, Mar. 2005.
[3] J. Aranda and S.M. Easterbroook, "Anchoring and Adjustment in Software Estimation," Proc. European Software Eng. Conf./ACM SIGSOFT Symp. the Foundations of Software Eng., 2005.
[4] R. Buehler, Y. Otsubo, D.R. Lehman, S.J. Heine, and D. Griffin, "Culture and Optimism: The Planning Fallacy in Japan and North America," unpublished manuscript, 2010.
[5] J.T. Cacioppi and R.E. Petty, "The Need for Cognition," J. Personality and Social Psychology, vol. 42, no. 1, pp. 116-131, 1982.
[6] J.T. Cacioppo, R.E. Petty, and C.F. Kao, "The Efficient Assessment of Need for Cognition," J. Personality Assessment, vol. 48, no. 3, pp. 306-307, 1984.
[7] I. Choi, R. Dalal, C. Kim-Preto, and H. Park, "Culture and Judgment of Causal Relevance," J. Personality and Social Psychology, vol. 84, no. 1, pp. 46-59, 2003.
[8] I. Choi, M. Koo, and J.A. Choi, "Individual Differences in Analytic versus Holistic Thinking," Personality and Social Pscychology Bull., vol. 33, pp. 691-705, 2007.
[9] I. Choi, R.E. Nisbett, and A. Norenzayan, "Causal Attribution across Cultures: Variation and Universality," Psychological Bull., vol. 125, pp. 47-63, Jan. 1999.
[10] M. Cole, Cultural psychology: A Once and Future Discipline. Harvard Univ. Press, 1996.
[11] H.M. Coon and M. Kemmermeier, "Cultural Orientation in the United States: (Re)Examining Differences among Ethnic Groups," J. Cross-Cultural Psychology, vol. 32, pp. 348-364, 2001.
[12] D.P. Ford, C.E. Connelly, and D.B. Meister, "Information System Research and Hofstede's Culture's Consequences: An Uneasy and Incomplete Partnership," IEEE Trans. Eng. Management, vol. 50, no. 1, pp. 8-25, Feb. 2003.
[13] S.D. Grimm and A.T. Church, "A Cross-Cultural Study of Response Biases in Personality Measures," J. Research in Personality, vol. 33, pp. 415-441, 1999.
[14] S. Grimstad and M. Jørgensen, "The Impact of Irrelevant Information on Estimates of Software Development Effort," Proc. 18th Australian Software Eng. Conf., 2007.
[15] S. Grimstad and M. Jørgensen, "A Preliminary Study of Sequence Effects in Judgment-Based Software Development Work-Effort Estimation," IET Software, 2009.
[16] W.B. Gudykunst, Y. Matsumoto, S. ting-Toomey, T. Nishida, K. Kim, and S. Heyman, "The Influence of Cultural Individualism-Collectivism, Self-Construals, and Individual Values on Communication Styles across Cultures," Human Comm. Research, vol. 22, pp. 510-543, 1996.
[17] B. Hannover, C. Pöhlmann, and A. Springer, "Implications of Independent versus Independent Self-Knowledge for Motivated Social Cognition: The Semantic Procedural Interface Model of the Self," Self and Identity, vol. 4, pp. 159-175, 2005.
[18] K. Hara and M.-S. Kim, "The Effect of Self-Construal on Conversational Indirectness," Int'l J. Intercultural Relations, vol. 28, pp. 1-18, 2004.
[19] S.J. Heine, D.R. Lehman, K. Peng, and J. Greenholtz, "What's Wrong with Cross-Cultural Comparisons of Subjective Likert Scales? The Reference-Group Effect," J. Personality and Social Psychology, vol. 82, no. 6, pp. 903-918, 2002.
[20] G. Hofstede, Culture's Consequences: International Differences in Work-Related Values. Sage, 1980.
[21] M. Jørgensen, "The Effects of the Format of Software Project Bidding Processes," Int'l J. Project Management, vol. 24, no. 6, pp. 522-528, 2006.
[22] M. Jørgensen, "How to Avoid Selecting Providers with Bids Based on Over-Optimistic Cost Estimates," IEEE Software, vol. 26, no. 3, pp. 79-84, May/June 2009.
[23] M. Jørgensen and G.J. Carlelius, "An Empirical Study of Software Project Bidding," IEEE Trans. Software Eng., vol. 30, no. 12, pp. 953-969, Dec. 2004.
[24] M. Jørgensen, B. Faugli, and T. Gruschke, "Characteristics of Software Engineers with Optimistic Predictions," J. Systems and Software, vol. 80, no. 9, pp. 1472-1482, 2007.
[25] M. Jørgensen and S. Grimstad, "Avoiding Irrelevant and Misleading Information When Estimating Development Effort," IEEE Software, vol. 25, no. 3, pp. 78-83, May/June 2008.
[26] M. Jørgensen and S. Grimstad, "The Impact of Irrelevant and Misleading Information on Software Development Effort Estimates: A Randomized Controlled Field Experiment " IEEE Trans. Software Eng., vol. 37, no. 5, pp. 695-707, Sept./Oct. 2011.
[27] M. Jørgensen and T. Halkjelsvik, "The Effects of Request Formats on Judgment-Based Effort Estimation," J. Systems and Software, vol. 83, no. 1, pp. 29-36, 2010.
[28] M. Jørgensen and D.I.K. Sjøberg, "Impact of Effort Estimates on Software Project Work," Information and Software Technology, vol. 43, no. 15, pp. 939-948, 2001.
[29] M. Jørgensen and D.I.K. Sjøberg, "The Impact of Customer Expectation on Software Development Effort Estimates," Int'l J. Project Management, vol. 22, pp. 317-325, 2004.
[30] D. Kahneman, P. Slovic, and A. Tversky, Judgment under Uncertainty: Heuristics and Biases. Cambridge Univ. Press, 1982.
[31] A. Kolstad and S. Horpestad, "Self-Construal in Chile and Norway: Implications for Cultural Differences in Individualism and Collectivism," J. Cross-Cultural Psychology, vol. 40, pp. 274-281, 2009.
[32] A. Krishna, R. Zhou, and S. Zhang, "The Effect of Self-Construal on Spatial Judgments," J. Consumer Research, vol. 35, pp. 337-348, 2008.
[33] J. Kurman, "Measure to the Modesty Response Measured Cross-Cultural Differences in Self-Enhancement and the Sensitivity of the Self-Enhancement," Cross-Cultural Research, vol. 36, no. 1, pp. 73-95, 2002.
[34] A.K. Lalwani, S. Shavitt, and T. Johnson, "What Is the Relation between Cultural Orientation and Socially Desirable Responding," J. Personality and Social Psychology, vol. 90, no. 1, pp. 165-178, 2006.
[35] F. Lee, M. Hallahan, and T. Herzog, "Explaining Real Life Events: How Culture and Domain Shape Attribution," Personality and Social Psychology, vol. 22, no. 7, pp. 732-741, 1996.
[36] D.R. Lehman, C. Chiu, and M. Schaller, "Psychology and Culture," Ann. Rev. of Pscyhology, vol. 55, pp. 690-714, 2004.
[37] D.N. Majumdar, Races and Cultures of India. Asia Pub. House, 1961.
[38] H.R. Markus and S. Kitayama, "Culture and the Self: Implications for Cognition, Emotions and Motivations," Psychological Rev., vol. 98, pp. 224-253, 1991.
[39] T. Masuda and R.E. Nisbett, "Attending Holistically versus Analytically: Comparing the Context Sensitivity of Japanese and Americans," J. Personality and Social Psychology, vol. 81, pp. 922-934, Nov. 2001.
[40] K. Moløkken and M. Jørgensen, "A Review of Software Surveys on Software Effort Estimation," Proc. Int'l Symp. Empirical Software Eng., 2003.
[41] D.A. Moore and D.A. Small, "Error and Bias in Comparative Judgment: On Being Both Better and Worse Than We Think We Are," J. Personality and Social Psychology, vol. 92, no. 6, pp. 972-989, 2007.
[42] J.C. Nunnally, Psychometric Theory, second ed. McGraw-Hill, 1978.
[43] D. Oyserman and S.W.S. Lee, "Does Culture Influence What and How We Think? Effects of Priming Individualism and Collectivism," Psychological Bull., vol. 134, no. 2, pp. 311-342, 2008.
[44] R.E. Petty, K.G. DeMarree, P. Brinol, J. Horcajo, and A.J. Strathman, "Need for Cognition Can Magnify or Attenuate Priming Effects in Social Judgment," Personality and Social Psychology Bull., vol. 34, no. 7, pp. 900-912, 2008.
[45] E. Pronin, "Perception and Misperception of Bias in Human Judgment," TRENDS in Cognitive Sciences, vol. 11, no. 1, pp. 37-43, 2007.
[46] T.M. Singelis, "The Measurement of Independent and Interdependent Self-Construals," Personality and Social Psychology Bull., vol. 20, no. 5, pp. 580-591, 1994.
[47] B.A. Visser, M.C. Ashton, and P.A. Vernon, "What Makes You Think You're so Smart? Measured Abilities, Personality, and Sex Differences in Relation to Self-Estimates of Multiple Intelligences," J. Individual Differences, vol. 29, no. 1, pp. 35-44, 2008.
[48] E.U. Weber and C.K. Hsee, "Culture and Individual Judgement and Decision Making," Applied Psychology: An Int'l Rev., vol. 49, no. 1, pp. 32-61, 2000.