• Publication
  • 2006
  • Issue No. 7 - July
  • Abstract - An Empirical Study of the Complex Relationships between Requirements Engineering Processes and Other Processes that Lead to Payoffs in Productivity, Quality, and Risk Management
 This Article 
 Bibliographic References 
 Add to: 
An Empirical Study of the Complex Relationships between Requirements Engineering Processes and Other Processes that Lead to Payoffs in Productivity, Quality, and Risk Management
July 2006 (vol. 32 no. 7)
pp. 433-453
Requirements engineering is an important component of effective software engineering, yet more research is needed to demonstrate the benefits to development organizations. While the existing literature suggests that effective requirements engineering can lead to improved productivity, quality, and risk management, there is little evidence to support this. We present empirical evidence showing how requirements engineering practice relates to these claims. This evidence was collected over the course of a 30-month case study of a large software development project undergoing requirements process improvement. Our findings add to the scarce evidence on RE payoffs and, more importantly, represent an in-depth explanation of the role of requirements engineering processes in contributing to these benefits. In particular, the results of our case study show that an effective requirements process at the beginning of the project had positive outcomes throughout the project lifecycle, improving the efficacy of other project processes, ultimately leading to improvements in project negotiation, project planning, and managing feature creep, testing, defects, rework, and product quality. Finally, we consider the role collaboration had in producing the effects we observed and the implications of this work to both research and practice.

[1] D. Berry, D. Damian, A. Finkelstein, D. Gause, R. Hall, and A. Wassyng, “To Do or Not to Do: If the Requirements Engineering Payoff Is So Good, Why Aren't More Companies Doing It?” Proc. Requirements Eng., 2005.
[2] A. Borjesson and L. Mathiassen, “Successful Process Implementation,” IEEE Software, pp. 35-44, July/Aug. 2004.
[3] J. Broadman and D. Johnson, “Return on Investment from Software Process Improvement as Measured by U.S. Industry,” Crosstalk, vol. 9, no. 4, pp. 23-29, 1996.
[4] F. Brooks, “No Silver Bullet: Essence and Accidents of Software Engineering,” Computer, vol. 20, no. 4, pp. 10-19, Apr. 1987.
[5] C. Claus, M. Freund, M. Kaiser, and R. Kneuper, “Implementing Systematic Requirements Management in a Large Software Development Programme,” Proc. Fifth Int'l Workshop Requirements Eng.: Foundation of Software Quality, pp. 33-42, 1999.
[6] D. Damian, D. Zowghi, L. Vaidyanathasamy, and Y. Pal, “An Industrial Case Study of Immediate Benefits of Requirements Engineering Process Improvement at the Australian Center for Unisys Software,” Int'l J. Empirical Software Eng., vol. 9, nos. 1-2, pp. 45-75, Mar. 2004.
[7] D. Damian, J. Chisan, L. Vaidyanathasamy, and Y. Pal, “Requirements Engineering and Downstream Software Development: Findings from a Case Study,” Int'l J. Empirical Software Eng., vol. 10, no. 3, 2005.
[8] K.E. El-Emam and A. Birk, “Validating the ISO/IEC 15504 Measure of Software Requirements Analysis Process Capability,” IEEE Trans. Software Eng., vol. 26, no. 6, pp. 541-566, Nov./Dec. 2000.
[9] K. Fosberg and H. Mooz, “System Engineering Overview,” Software Requirements Eng., R. Thayer and M. Dorfman, eds., pp. 44-72, 2000.
[10] A.F. Hutchings and S.T. Knox, “Creating Products: Customers Demand,” Comm. ACM, vol. 38, no. 5, pp. 72-80, 1995.
[11] T. Hall, S. Beecham, and A. Rainer, “Requirements Problems in Twelve Software Companies: An Empirical Analysis,” IEE Proc.— Software, vol. 149, no. 5, 2002.
[12] J. Herbsleb and D. Goldenson, “A Systematic Survey of CMM Experience and Results,” Proc. Int'l Conf. Software Eng., pp. 323-330, 1996.
[13] W. Humphrey, T. Snyder, and R. Willis, “Software Process Improvement at Hughes Aircraft,” IEEE Software, vol. 8, no. 4, pp. 11-23, 1991.
[14] ISO/IEC TR 15504-1:1998, Information Technology— Software Process Assessment, ISO, 1998.
[15] C. Jones, “Strategies for Managing Requirements Creep,” Computer, vol. 29, no. 6, pp. 92-94, June 1996.
[16] S. Jacobs, “Introducing Measurable Quality Requirements: A Case Study,” Proc. Fourth Int'l Symp. Requirements Eng., pp. 172-179, 1999.
[17] M. Jirotka and J. Goguen, Requirements Engineering: Social and Technical Issues. Academic Press, 1994.
[18] M. Kauppinen and S. Kujala, “Starting Improvement of Requirements Engineering Processes: An Experience Report,” Proc. Third Int'l Conf. Product Focused Software Process Improvement (Profes), pp. 196-209, 2001.
[19] M. Kauppinen, S. Kujala, T. Aaltio, and L. Lehtola, “Introducing Requirements Engineering: How to Make a Cultural Change Happen in Practice,” Proc. IEEE Joint Int'l Requirements Eng. Conf. (RE '02), pp. 43-51, 2002.
[20] M. Kauppinen, M. Vartiainen, J. Kontio, S. Kujala, and R. Sulonen, “Implementing Requirements Engineering Processes throughout Organizations: Success Factors and Challenges,” Information and Software Technology, vol. 46, no. 14, pp. 937-953, 2004.
[21] H. Kaindl, S. Brinkkemper, J.A. Bunenko, B. Farbey, S. Greenspan, C. Heitmeyer, J.C. Leite, N. Mead, J. Mylopolous, and J. Siddiqi, “Requirements Engineering and Technology Transfer: Obstacles, Incentives and an Improvement Agenda,” Requirements Eng. J., vol. 7, pp. 113-123, 2002.
[22] S. Lauesen and O. Vinter, “Preventing Requirement Defects: An Experiment in Process Improvement,” Requirements Eng. J., vol. 6, pp. 37-50, 2001.
[23] R. Likert and J.G. Likert, New Ways of Managing Conflict, p. 165. New York: McGraw-Hill, 1976.
[24] K.R. Linberg, “Software Developer Perceptions about Sofware Project Failure: A Case Study,” Systems and Software, vol. 49, pp. 177-192, 1999.
[25] E. Mayo, The Human Problems of an Industrial Civilization. New York: Macmillan Co., 1933.
[26] B.A. Nuseibeh and S.M. Easterbrook, “Requirements Engineering: A Roadmap,” The Future of Software Eng., A.C.W. Finkelstein, ed., IEEE CS Press, 2000.
[27] M. Paulk, “A Comparison of ISO 9001 and the Capability Maturity Model for Software,” CMU/SEI-94-TR-12, 1994.
[28] J. Procaccino, J. Verner, S. Overmyer, and M. Darter, “Case Study: Factors for Early Prediction of Software Development Success,” Information and Software Technology, vol. 44, pp. 53-62, 2002.
[29] B. Regnell, P. Beremark, and O. Eklundh, “A Market-Driven Requirements Engineering Process— Results from an Industrial Process Improvement Programme,” Requirements Eng. J., vol. 3, no. 2, pp. 121-129, 1998.
[30] S. Robertson and J. Robertson, Mastering the Requirements Process. Addison-Wesley, 1999.
[31] SEI, 1995: Software Eng. Inst., The Capability Maturity Model: Guidelines for Improving the Software Process. Addison Wesley, 1995.
[32] I. Sommerville and P. Sawyer, Requirements Engineering: A Good Practice Guide. John Wiley & Sons, 1997.
[33] T.S. Group, “The CHAOS Report,” The Standish Group International, 2003, www.standishgroup.com.
[34] W. Trochim, “Research Methods Knowledge Base,” http://www. socialresearchmethods.netkb/, 17 May 2006.
[35] J.A. Villanlon, G.C. Augustin, T.G. San Feliu, and A.A. Seco, “Experiences in the Application of Software Process Improvement in SMEs,” Software Quality J., vol. 10, no. 3, pp. 261-273, 2002.
[36] H. Wohlwend and S. Rosenbaum, “Software Process Improvement in an International Company,” Proc. Int'l Conf. Software Eng., pp. 212-220, 1993.
[37] R.K. Yin, Case Study Research: Design and Methods. Thousand Oaks, Calif.: Sage Publications, 1994.

Index Terms:
Requirements engineering, process improvement, process interactions, empirical investigation.
Daniela Damian, James Chisan, "An Empirical Study of the Complex Relationships between Requirements Engineering Processes and Other Processes that Lead to Payoffs in Productivity, Quality, and Risk Management," IEEE Transactions on Software Engineering, vol. 32, no. 7, pp. 433-453, July 2006, doi:10.1109/TSE.2006.61
Usage of this product signifies your acceptance of the Terms of Use.