The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.02 - March-April (2012 vol.38)
pp: 398-424
Chow Kian Cheng , Healthcare IT, Gen. Electrics Healthcare, Freiburg, Germany
ABSTRACT
BACKGROUND-Software Process Improvement (SPI) is a systematic approach to increase the efficiency and effectiveness of a software development organization and to enhance software products. OBJECTIVE-This paper aims to identify and characterize evaluation strategies and measurements used to assess the impact of different SPI initiatives. METHOD-The systematic literature review includes 148 papers published between 1991 and 2008. The selected papers were classified according to SPI initiative, applied evaluation strategies, and measurement perspectives. Potential confounding factors interfering with the evaluation of the improvement effort were assessed. RESULTS-Seven distinct evaluation strategies were identified, wherein the most common one, “Pre-Post Comparison,” was applied in 49 percent of the inspected papers. Quality was the most measured attribute (62 percent), followed by Cost (41 percent), and Schedule (18 percent). Looking at measurement perspectives, “Project” represents the majority with 66 percent. CONCLUSION-The evaluation validity of SPI initiatives is challenged by the scarce consideration of potential confounding factors, particularly given that “Pre-Post Comparison” was identified as the most common evaluation strategy, and the inaccurate descriptions of the evaluation context. Measurements to assess the short and mid-term impact of SPI initiatives prevail, whereas long-term measurements in terms of customer satisfaction and return on investment tend to be less used.
INDEX TERMS
software process improvement, return on investment, software process improvement, SPI, software development organization, customer satisfaction, Software, Software measurement, Systematics, Current measurement, Data mining, Organizations, systematic literature review., Process implementation and change, process measurement, metrics/measurement
CITATION
Chow Kian Cheng, "Evaluation and Measurement of Software Process Improvement—A Systematic Literature Review", IEEE Transactions on Software Engineering, vol.38, no. 2, pp. 398-424, March-April 2012, doi:10.1109/TSE.2011.26
REFERENCES
[1] P. Abrahamsson, "Measuring the Success of Software Process Improvement: The Dimensions," Proc. European Software Process Improvement Conf., http://www.iscn.at/select_newspaper/ measurement oulu.html, 2000.
[2] D.M. Ahern, R. Turner, and A. Clouse, CMMI(SM) Distilled: A Practical Introduction to Integrated Process Improvement. Addison-Wesley, 2001.
[3] S. Anderson, A. Auquier, W.W. Hauck, D. Oakes, W. Vandaele, and H.I. Weisberg, Statistical Methods for Comparative Studies: Techniques for Bias Reduction. John Wiley, 1980.
[4] R. Atkinson, "Project Management: Cost, Time and Quality, Two Best Guesses and a Phenomenon, It's Time to Accept Other Success Criteria," Int'l J. Project Management, vol. 17, no. 6, pp. 337-342, Dec. 1999.
[5] M.A. Babar and I. Gorton, "Software Architecture Review: The State of Practice," Computer, vol. 42, no. 7, pp. 26-32, July 2009.
[6] D. Baccarini, "The Logical Framework Method for Defining Project Success," Project Management J., vol. 30, no. 4, pp. 25-32, Dec. 1999.
[7] V. Basili, "The Experience Factory and Its Relationship to Other Improvement Paradigms," Proc. European Software Eng. Conf., pp. 68-83, 1993.
[8] V. Basili and G. Caldiera, "Improve Software Quality by Reusing Knowledge and Experience," Sloan Management Rev., vol. 37, no. 1, pp. 55-64, Oct. 1995.
[9] V. Basili and D. Weiss, "A Methodology for Collecting Valid Software Engineering Data," IEEE Trans. Software Eng., vol. 10, no. 6, pp. 728-738, Nov. 1984.
[10] C.G.P. Bellini, R.C.F. Pereira, and J.L. Becker, "Measurement in Software Engineering: From the Roadmap to the Crossroads," Int'l J. Software Eng. and Knowledge Eng., vol. 18, no. 1, pp. 37-64, Feb. 2008.
[11] M. Berry, R. Jeffery, and A. Aurum, "Assessment of Software Measurement: An Information Quality Study," Proc. 10th Int'l Symp. Software Metrics, pp. 314-325, 2004.
[12] N. Bevan, "Quality in Use: Meeting User Needs for Quality," J. Systems and Software, vol. 49, no. 1, pp. 89-96, Dec. 1999.
[13] N. Bevan and M. MacLeod, "Usability Measurement in Context," Behaviour and Information Technology, vol. 13, no. 1, pp. 132-45, 1994.
[14] R. Biehl, "Six Sigma for Software," IEEE Software, vol. 21, no. 2, pp. 68-70, Mar./Apr. 2004.
[15] B. Boehm, "A View of 20th and 21st Century Software Engineering," Proc. 28th Int'l Conf. Software Eng., pp. 12-29, 2006.
[16] P. Brereton, B.A. Kitchenham, D. Budgen, M. Turner, and M. Khalil, "Lessons from Applying the Systematic Literature Review Process within the Software Engineering Domain," J. Systems and Software, vol. 80, no. 4, pp. 571-583, Apr. 2007.
[17] M. Brown and D. Goldenson, "Measurement and Analysis: What Can and Does Go Wrong?," Proc. 10th Int'l Symp. Software Metrics, pp. 131-138, 2004.
[18] T. Bruckhaus, "A Quantitative Approach for Analyzing the Impact of Tools on Software Productivity," PhD dissertation, McGill Univ., 1997.
[19] M. Bruntink and A. van Deursen, "An Empirical Study into Class Testability," J. Systems and Software, vol. 79, no. 9, pp. 1219-1232, Sept. 2006.
[20] L. Buglione and A. Abran, "ICEBERG: A Different Look at Software Project Management," Proc. 12th Int'l Workshop Software Measurement, pp. 153-167, 2002.
[21] P. Byrnes and M. Phillips, "Software Capability Evaluation Version 3.0 Method Description," Technical Report CMU/SEI-96-TR-002, Software Eng. Inst., Carnegie Mellon, ftp://ftp.sei. cmu.edu/public/documents/ 96.reports/pdftr002.96.pdf, 1996.
[22] D. Caivano, "Continuous Software Process Improvement through Statistical Process Control," Proc. Ninth European Conf. Software Maintenance and Reeng., pp. 288-293. 2005.
[23] J.P. Campbell, V.A. Maxey, and W.A. Watson, "Hawthorne Effect: Implications for Prehospital Research," Annals of Emergency Medicine, vol. 26, no. 5, pp. 590-594, Nov. 1995.
[24] P. Carbone, L. Buglione, L. Mari, and D. Petri, "A Comparison between Foundations of Metrology and Software Measurement," IEEE Trans. Instrumentation and Measurement, vol. 57, no. 2, pp. 235-241, Feb. 2008.
[25] D.N. Card, "Research Directions in Software Process Improvement," Proc. 28th Ann. Int'l Computer Software and Applications Conf., p. 238, 2004.
[26] S. Chidamber and C. Kemerer, "A Metrics Suite for Object Oriented Design," IEEE Trans. Software Eng., vol. 20, no. 6, pp. 476-493, June 1994.
[27] P.B. Crosby, Quality without Tears. McGraw-Hill, 1984.
[28] G. Cugola and C. Ghezzi, "Software Processes: A Retrospective and a Path to the Future," Software Process: Improvement and Practice, vol. 4, no. 3, pp. 101-123, Sept. 1998.
[29] R. Davison, M.G. Martinsons, and N. Kock, "Principles of Canonical Action Research," Information Systems J., vol. 14, no. 1, pp. 65-86, Jan. 2004.
[30] J.C. de Almeida Biolchini, P.G. Mian, A.C.C. Natali, T.U. Conte, and G.H. Travassos, "Scientific Research Ontology to Support Systematic Review in Software Engineering," Advanced Eng. Informatics, vol. 21, no. 2, pp. 133-151, Apr. 2007.
[31] W.E. Deming, Out of the Crisis. MIT Press, 1986.
[32] D.K. Dunaway and S. Masters, "CMM®-Based Appraisal for Internal Process Improvement (CBA IPI) Version 1.2 Method Description," Technical Report CMU/SEI-2001-TR-033, Software Eng. Inst., Carnegie Mellon Univ., http://www.sei.cmu.edu/reports01tr033.pdf , 2001.
[33] T. Dyba, "An Empirical Investigation of the Key Factors for Success in Software Process Improvement," IEEE Trans. Software Eng., vol. 31, no. 5, pp. 410-424, May 2005.
[34] S. Easterbrook, J. Singer, M. Storey, and D. Damian, "Selecting Empirical Methods for Software Engineering Research," Guide to Advanced Empirical Software Eng., pp. 285-311, Springer, 2008.
[35] K. El Emam, J. Drouin, and W. Melo, SPICE: The Theory and Practice of Software Process Improvement and Capability Determination. IEEE CS Press, 1998.
[36] K. El Emam, S. Benlarbi, N. Goel, and S.N. Rai, "The Confounding Effect of Class Size on the Validity of Object-Oriented Metrics," IEEE Trans. Software Eng., vol. 27, no. 7, pp. 630-650, July 2001.
[37] W. Evanco, "Comments on 'The Confounding Effect of Class Size on the Validity of Object-Oriented Metrics'," IEEE Trans. Software Eng., vol. 29, no. 7, pp. 670-672, July 2003.
[38] B. Fitzgerald and T. O'Kane, "A Longitudinal Study of Software Process Improvement," IEEE Software, vol. 16, no. 3, pp. 37-45, May/June 1999.
[39] R. Fitzpatrick and C. Higgins, "Usable Software and Its Attributes: A Synthesis of Software Quality," Proc. HCI on People and Computers XIII, pp. 3-21. 1998.
[40] J. Fleiss, "Measuring Nominal Scale Agreement among Many Raters," Psychological Bull., vol. 76, no. 5, pp. 378-382, Nov. 1971.
[41] W.A. Florac and A.D. Carleton, Measuring the Software Process. Addison-Wesley, 1999.
[42] D. Flynn, J. Vagner, and O.D. Vecchio, "Is CASE Technology Improving Quality and Productivity in Software Development?" Logistics Information Management, vol. 8, no. 2, pp. 8-21, 1995.
[43] C. Fox and W. Frakes, "The Quality Approach: Is It Delivering?" Comm. ACM, vol. 40, no. 6, pp. 24-29, June 1997.
[44] A. Fuggetta, "Software Process: A Roadmap," Proc. Conf. Future of Software Eng., pp. 25-34, 2000.
[45] F. Garcia, M.F. Bertoa, C. Calero, A. Vallecillo, F. Ruiz, M. Piattini, and M. Genero, "Towards a Consistent Terminology for Software Measurement," Information and Software Technology, vol. 48, no. 8, pp. 631-644, Aug. 2006.
[46] D. Goldenson and D. Gibson, "Demonstrating the Impact and Benefits of CMMI: An Update and Preliminary Results," Technical Report CMU/SEI-2003-SR-009, Software Eng. Inst., Carnegie Mellon Univ., http://www.sei.cmu.edu/library/ abstracts/ reports03sr009.cfm, 2003.
[47] D. Goldenson, K.E. Emam, J. Herbsleb, and C. Deephouse, "Empirical Studies of Software Process Assessment Methods," Technical Report ISERN-97-09, Kaiserslautern: Fraunhofer—Inst. of Experimental Software Eng., http://www.ehealthinformation. ca/documents isern-97-09.pdf, 1996.
[48] O. Gómez, H. Oktaba, M. Piattini, and F. Garcia, "A Systematic Review Measurement in Software Engineering: State-of-the-Art in Measures," Software and Data Technologies, vol. 10, pp. 165-176, Springer, 2008.
[49] T. Gorschek and C. Wohlin, "Packaging Software Process Improvement Issues: A Method and a Case Study," Software: Practice and Experience, vol. 34, no. 14, pp. 1311-1344, Nov. 2004.
[50] E. Gray and W. Smith, "On the Limitations of Software Process Assessment and the Recognition of a Required Re-Orientation for Global Process Improvement," Software Quality J., vol. 7, no. 1, pp. 21-34, Mar. 1998.
[51] S. Grimstad, M. Jørgensen, and K. Moløkken-Østvold, "Software Effort Estimation Terminology: The Tower of Babel," Information and Software Technology, vol. 48, no. 4, pp. 302-310, Apr. 2006.
[52] T. Hall, N. Baddoo, and D. Wilson, "Measurement in Software Process Improvement Programmes: An Empirical Study," New Approaches in Software Measurement, pp. 73-82, Springer, 2001.
[53] M. Hitz and B. Montazeri, "Chidamber and Kemerer's Metrics Suite: A Measurement Theory Perspective," IEEE Trans. Software Eng., vol. 22, no. 4, pp. 267-271, Apr. 1996.
[54] J. Ho-Won, K. Seung-Gweon, and C. Chang-Shin, "Measuring Software Product Quality: A Survey of ISO/IEC 9126," IEEE Software, vol. 21, no. 5, pp. 88-92, Sept./Oct. 2004.
[55] W. Humphrey, "CASE Planning and the Software Process," J. Systems Integration, vol. 1, no. 3, pp. 321-337, Nov. 1991.
[56] W.S. Humphrey, "Introduction to Software Process Improvement," Technical Report CMU/SEI-92-TR7, Software Eng. Inst., Carnegie Mellon Univ., ftp://ftp.sei.cmu.edu/public/documents/92.reports/ pdftr07.92.pdf, 1993.
[57] S. Jarzabek and R. Huang, "The Case for User-Centered CASE Tools," Comm. ACM, vol. 41, no. 8, pp. 93-99, Aug. 1998.
[58] C. Kaner and W.P. Bond, "Software Engineering Metrics: What Do They Measure and How Do We Know," Proc. 10th Int'l Software Metrics Symp., 2004.
[59] H. Kerzner, Project Management: A Systems Approach to Planning, Scheduling, and Controlling, 10th ed. John Wiley, 2009.
[60] B. Kitchenham, "What's Up with Software Metrics?—A Preliminary Mapping Study," J. Systems and Software, vol. 83, no. 1, pp. 37-51, Jan. 2010.
[61] B. Kitchenham and S. Charters, "Guidelines for Performing Systematic Literature Reviews in Software Engineering," Technical Report EBSE-2007-01, Software Eng. Group, Keele Univ. and Dept. of Computer Science, Univ. of Durham, UK, 2007.
[62] B. Kitchenham and S. Pfleeger, "Software Quality: The Elusive Target," IEEE Software, vol. 13, no. 1, pp. 12-21, Jan. 1996.
[63] B. Kitchenham, L. Pickard, and S. Pfleeger, "Case Studies for Method and Tool Evaluation," IEEE Software, vol. 12, no. 4, pp. 52-62, July 1995.
[64] B. Kitchenham, S.L. Pfleeger, L.M. Pickard, P.W. Jones, D.C. Hoaglin, K.E. Emam, and J. Rosenberg, "Preliminary Guidelines for Empirical Research in Software Engineering," IEEE Trans. Software Eng., vol. 28, no. 8, pp. 721-734, Aug. 2002.
[65] J.R. Landis and G.G. Koch, "The Measurement of Observer Agreement for Categorical Data," Biometrics, vol. 33, no. 1, pp. 159-174, Mar. 1977.
[66] G. Low and V. Leenanuraksa, "Software Quality and CASE Tools," Proc. Software Technology and Eng. Practice, pp. 142-150, 1999.
[67] L. Mathiassen, O. Ngwenyama, and I. Aaen, "Managing Change in Software Process Improvement," IEEE Software, vol. 22, no. 6, pp. 84-91, Nov./Dec. 2005.
[68] J. McColl-Kennedy and U. Schneider, "Measuring Customer Satisfaction: Why, What and How," Total Quality Management, vol. 11, no. 7, pp. 883-896, Sept. 2000.
[69] N. McNamara and J. Kirakowski, "Functionality, Usability, and User Experience: Three Areas of Concern," Interactions, vol. 13, no. 6, pp. 26-28, Nov. 2006.
[70] A. Mockus, P. Zhang, and P.L. Li, "Predictors of Customer Perceived Software Quality," Proc. 27th Int'l Conf. Software Eng., pp. 225-233, 2005.
[71] P. Mohagheghi and R. Conradi, "An Empirical Investigation of Software Reuse Benefits in a Large Telecom Product," ACM Trans. Software Eng. and Methodology, vol. 17, no. 3, pp. 1-31, June 2008.
[72] W.J. Orlikowski, "CASE Tools as Organizational Change: Investigating Incremental and Radical Changes in Systems Development," MIS Quarterly, vol. 17, no. 3, pp. 309-340, Sept. 1993.
[73] R. Patnayakuni and A. Rai, "Development Infrastructure Characteristics and Process Capability," Comm. ACM, vol. 45, no. 4, pp. 201-210, Apr. 2002.
[74] M.C. Paulk, C.V. Weber, S.M. Garcia, M.B. Chrissis, and M. Bush, "Key Practices of the Capability Maturity Model SM, Version 1.1," Technical Report CMU/SEI-93-TR-025, Software Eng. Inst., Carnegie Mellon Univ., ftp://ftp.sei.cmu.edu/pub/documents/93.reports/ pdftr25.93.pdf, 1993.
[75] M.C. Paulk, B. Curtis, M.B. Chrissis, and C.V. Weber, "Capability Maturity Model for Software Version 1.1," Technical Report CMU/SEI-93-TR-024, Software Eng. Inst., Carnegie Mellon Univ., ftp://ftp.sei.cmu.edu/pub/documents/93.reports/ pdftr24.93.pdf, 1993.
[76] M.C. Paulk, C.V. Weber, B. Curtis, and M.B. Chrissis, The Capability Maturity Model: Guidelines for Improving the Software Process. Addison-Wesley, 1995.
[77] J. Pearl, "Why There Is No Statistical Test for Confounding, Why Many Think There Is, and Why They Are Almost Right," Dept. of Statistics, Univ. of California Los Angeles, July 1998.
[78] D.E. Perry, A.A. Porter, and L.G. Votta, "Empirical Studies of Software Engineering: A Roadmap," Proc. Conf. Future of Software Eng., pp. 345-355, 2000.
[79] K. Petersen and C. Wohlin, "Context in Industrial Software Engineering Research," Proc. Third Int'l Symp. Empirical Software Eng. and Measurement, pp. 401-404, 2009.
[80] F. Pettersson, M. Ivarsson, T. Gorschek, and P. Öhman, "A Practitioner's Guide to Light Weight Software Process Assessment and Improvement Planning," The J. Systems and Software, vol. 81, no. 6, pp. 972-995, June 2008.
[81] S. Pfleeger, "Experimentation in Software Engineering," Advances in Computers, vol. 44, pp. 127-167, Academic Press, 1997.
[82] S.L. Pfleeger and B. Kitchenham, "Principles of Survey Research: Part 1: Turning Lemons into Lemonade," ACM SIGSOFT Software Eng. Notes, vol. 26, no. 6, pp. 16-18, Nov. 2001.
[83] G. Premkumar and M. Potter, "Adoption of Computer Aided Software Engineering (CASE) Technology: An Innovation Adoption Perspective," ACM SIGMIS Database, vol. 26, nos. 2/3, pp. 105-124, May 1995.
[84] R.S. Pressman, Software Engineering: A Practitioner's Approach, fifth ed. McGraw-Hill, 2001.
[85] D. Raffo, "The Role of Process Improvement in Delivering Customer and Financial Value," Proc. Portland Int'l Conf. Management and Technology, pp. 589-592, 1997.
[86] V. Raghavan, P. Bollmann, and G.S. Jung, "A Critical Investigation of Recall and Precision as Measures of Retrieval System Performance," ACM Trans. Information Systems, vol. 7, no. 3, pp. 205-229, July 1989.
[87] D.F. Rico, ROI of Software Process Improvement. J. Ross Publishing, 2004.
[88] D.J. Rocha, "Strengthening the Validity of Software Process Improvement Measurements through Statistical Analysis: A Case Study at Ericsson AB," http://hdl.handle.net/207710529, http://hdl.handle.net/207710529, 2011.
[89] J.A. Rozum, "Concepts on Measuring the Benefits of Software Process Improvements," Technical Report CMU/SEI-93-TR-009, Software Eng. Inst., Carnegie Mellon Univ., http://www.sei. cmu.edu/reports93tr009.pdf , 1993.
[90] P. Runeson and M. Höst, "Guidelines for Conducting and Reporting Case Study Research in Software Engineering," Empirical Software Eng., vol. 14, no. 2, pp. 131-164, Apr. 2009.
[91] G. Santos, M. Montoni, J. Vasconcellos, S. Figueiredo, R. Cabral, C. Cerdeiral, A. Katsurayama, P. Lupo, D. Zanetti, and A. Rocha, "Implementing Software Process Improvement Initiatives in Small and Medium-Size Enterprises in Brazil," Proc. Sixth Int'l Conf. Quality of Information and Comm. Technology, pp. 187-198, 2007.
[92] T. Saracevic, "Evaluation of Evaluation in Information Retrieval," Proc. 18th Ann. Int'l ACM SIGIR Conf. Research and Development in Information Retrieval, pp. 138-146, 1995.
[93] W. Scacchi, "Process Models in Software Engineering," Encyclopedia of Software Eng., pp. 993-1005, 2001.
[94] C. Seaman, "Qualitative Methods in Empirical Studies of Software Engineering," IEEE Trans. Software Eng., vol. 25, no. 4, pp. 557-72, July/Aug. 1999.
[95] A. Seffah, M. Donyaee, R. Kline, and H. Padda, "Usability Measurement and Metrics: A Consolidated Model," Software Quality J., vol. 14, no. 2, pp. 159-178, June 2006.
[96] S. Sharma and A. Rai, "CASE Deployment in IS Organizations," Comm. ACM, vol. 43, no. 1, pp. 80-88, Jan. 2000.
[97] M. Shaw, "Prospects for an Engineering Discipline of Software," IEEE Software, vol. 7, no. 6, pp. 15-24, Nov. 1990.
[98] D.I.K. Sjoberg, T. Dyba, and M. Jorgensen, "The Future of Empirical Methods in Software Engineering Research," Proc. Future of Software Eng., pp. 358-378, 2007.
[99] M. Staples and M. Niazi, "Experiences Using Systematic Review Guidelines," J. Systems and Software, vol. 80, no. 9, pp. 1425-1437, Sept. 2007.
[100] M. Staples and M. Niazi, "Systematic Review of Organizational Motivations for Adopting CMM-Based SPI," Information and Software Technology, vol. 50, nos. 7/8, pp. 605-620, June 2008.
[101] D. Stavrinoudis and M. Xenos, "Comparing Internal and External Software Quality Measurements," Proc. 2008 Conf. Knowledge-Based Software Eng., pp. 115-124, 2008.
[102] M. Thomas and F. McGarry, "Top-Down vs. Bottom-Up Process Improvement," IEEE Software, vol. 11, no. 4, pp. 12-13, July 1994.
[103] J. Trienekens, R. Kusters, and R. van Solingen, "Product Focused Software Process Improvement: Concepts and Experiences from Industry," Software Quality J., vol. 9, no. 4, pp. 269-81, Dec. 2001.
[104] M. Unterkalmsteiner, T. Gorschek, A.K.M.M. Islam, C.K. Cheng, R.B. Permadi, and R. Feldt, "Extended Material to 'Evaluation and Measurement of Software Process Improvement—A Systematic Literature Review'," http://www.bth.se/com/mun.nsf/pagesspi-sysrev-material , 2010.
[105] R. van Solingen, D.F. Rico, and M.V. Zelkowitz, "Calculating Software Process Improvement's Return on Investment," Advances in Computers. vol. 66, pp. 1-41, 2006.
[106] N. Wirth, "A Brief History of Software Engineering," IEEE Annals of the History of Computing vol. 30, no. 3, pp. 32-39, July 2008.
[107] C. Wohlin, P. Runeson, M. Höst, M.C. Ohlsson, B. Regnell, and A. Wesslén, Experimentation in Software Engineering: An Introduction. Kluwer Academic Publishers, 2000.
[108] C. Wohlin, M. Höst, and K. Henningsson, "Empirical Research Methods in Software Engineering," Empirical Methods and Studies in Software Eng., pp. 7-23, Springer, 2003.
[109] M.V. Zelkowitz and D. Wallace, "Experimental Validation in Software Engineering," Information and Software Technology, vol. 39, no. 11, pp. 735-743, 1997.
[110] Y. Zhou, H. Leung, and B. Xu, "Examining the Potentially Confounding Effect of Class Size on the Associations between Object-Oriented Metrics and Change-Proneness," IEEE Trans. Software Eng., vol. 35, no. 5, pp. 607-623, Sept./Oct. 2009.
[111] "ISO/IEC TR2 15504Software Process Assessment-Part 7: Guide for Use in Process Improvement," Technical Report ISO/IEC TR2 15504, ISO, Geneva, Switzerland, 1998.
[112] "ISO/IEC TR2 15504 - Software Process Assessment: Part 1-Part 9," Technical Report ISO/IEC TR2 15504, ISO, Geneva, Switzerland, 1998.
[113] "Capability Maturity Model Integration (CMMI), Version 1.1 (Continuous Representation)," Technical Report CMU/SEI-2002-TR-011, Software Eng. Inst., Carnegie Mellon Univ., http://www.sei.cmu.edu/library/abstracts/ reports02tr011.cfm, 2002.
[114] "Capability Maturity Model Integration (CMMI), Version 1.1 (Staged Representation)," Technical Report CMU/SEI-2002-TR-012, Software Eng. Inst., Carnegie Mellon Univ., http://www.sei.cmu.edu/library/abstracts/ reports02tr012.cfm, 2002.
[115] "Improving Processes in Small Settings (IPSS)—a White Paper," technical report, Int'l Process Research Consortium (IPRC), Pittsburgh, http://www.sei.cmu.edu/iprcipss-white-paper-v1-1.pdf , 2006.
[116] "Appraisal Requirements for CMMI, Version 1.2 (ARC, v1.2)," Technical Report CMU/SEI-2006-TR-011, Software Eng. Inst., Carnegie Mellon Univ., http://www.sei.cmu.edu/library/ abstracts/ reports06tr011.cfm, 2006.
[117] "2008 Annual Report," Motorola, Inc., Ann. Report Motorola, Inc., 2008 Form 10-K, http://investor.motorola.comannuals.cfm, 2009.
[118] "Enterprise-SME Definition," http://ec.europa.eu/enterprise/ enterprise_policy/ sme_definitionindex_en.htm, Aug. 2009.
[119] P. Abrahamsson and K. Kautz, "The Personal Software Process: Experiences from Denmark," Proc. 28th Euromicro Conf., pp. 367-74, 2002.
[120] P. Abrahamsson and K. Kautz, "Personal Software Process: Classroom Experiences from Finland," Proc. Software Quality-ESCQ '02, pp. 175-85, Springer, 2002.
[121] R. Achatz and F. Paulisch, "Industrial Strength Software and Quality: Software and Engineering at Siemens," Proc. Third Int'l Conf. Quality Software, pp. 321-6, 2003.
[122] A. Ahmed, M. Fraz, and F. Zahid, "Some Results of Experimentation with Extreme Programming Paradigm," Proc. Seventh Int'l Multi-Topic Conf., pp. 387-90, 2004.
[123] S.A. Ajila and D. Wu, "Empirical Study of the Effects of Open Source Adoption on Software Development Economics," J. Systems and Software, vol. 80, no. 9, pp. 1517-1529, Sept. 2007.
[124] K. Alagarsamy, S. Justus, and K. Iyakutti, "The Knowledge Based Software Process Improvement Program: A Rational Analysis," Proc. Int'l Conf. Software Eng. Advances, p. 61, 2007.
[125] B. Anda, E. Angelvik, and K. Ribu, "Improving Estimation Practices by Applying Use Case Models," Product Focused Software Process Improvement, pp. 383-397, Springer, 2002.
[126] J. Andrade, J. Ares, O. Dieste, R. Garcia, M. Lopez, S. Rodriguez, and L. Verde, "Creation of an Automated Management Software Requirements Environment: A Practical Experience," Proc. 10th Int'l Workshop Database and Expert Systems Applications, pp. 328-335, 1999.
[127] M.T. Baldassarre, A. Bianchi, D. Caivano, and G. Visaggio, "An Industrial Case Study on Reuse Oriented Development," Proc. 21st Int'l Conf. Software Maintenance, pp. 283-92, 2005.
[128] V. Basili, M. Zelkowitz, F. McGarry, J. Page, S. Waligora, and R. Pajerski, "SEL's Software Process Improvement Program," IEEE Software, vol. 12, no. 6, pp. 83-7, Nov. 1995.
[129] J. Batista and A.D. de Figueiredo, "SPI in a Very Small Team: A Case with CMM," Software Process Improvement and Practice, vol. 5, no. 4, pp. 243-50, Dec. 2000.
[130] E. Bellini and C. lo Storto, "CMM Implementation and Organizational Learning: Findings from a Case Study Analysis," Proc. Technology Management for the Global Future Conf., pp. 1256-71, 2006.
[131] S. Biffl and M. Halling, "Software Product Improvement with Inspection. A Large-Scale Experiment on the Influence of Inspection Processes on Defect Detection in Software Requirements Documents," Proc. 26th Euromicro Conf., pp. 262-269, 2000.
[132] A. Birk, P. Derks, D. Hamann, J. Hirvensalo, M. Oivo, E. Rodenbach, R. van Solingen, and J. Taramaa, "Applications of Measurement in Product-Focused Process Improvement: A Comparative Industrial Case Study," Proc. Fifth Int'l Software Metrics Symp., pp. 105-108, 1998.
[133] A. Borjesson, "Improve by Improving Software Process Improvers," Int'l J. Business Information Systems, vol. 1, no. 3, pp. 310-38, Jan. 2006.
[134] T. Bruckhaus, N.H. Madhavii, I. Janssen, and J. Henshaw, "The Impact of Tools on Software Productivity," IEEE Software, vol. 13, no. 5, pp. 29-38, Sept. 1996.
[135] C. Buchman, "Software Process Improvement at AlliedSignal Aerospace," Proc. 29th Hawaii Int'l Conf. System Sciences, pp. 673-80, 1996.
[136] A. Calio, M. Autiero, and G. Bux, "Software Process Improvement by Object Technology (ESSI PIE 27785-SPOT)," Proc. 22nd Int'l Conf. Software Eng., pp. 641-647, 2000.
[137] G. Canfora, F. Garcia, M. Piattini, F. Ruiz, and C. Visaggio, "Applying a Framework for the Improvement of Software Process Maturity," Software—Practice and Experience, vol. 36, no. 3, pp. 283-304, Mar. 2006.
[138] A. Cater-Steel, M. Toleman, and T. Rout, "Process Improvement for Small Firms: An Evaluation of the RAPID Assessment-Based Method," Information and Software Technology, vol. 48, no. 5, pp. 323-334, May 2006.
[139] G. Cuevas, J.C. Manzano, T.S. Feliu, J. Mejia, M. Munoz, and S. Bayona, "Impact of TSPi on Software Projects," Proc. Fourth Conf. Electronics, Robotics and Automotive Mechanics, pp. 706-711, 2007.
[140] D. Damian and J. Chisan, "An Empirical Study of the Complex Relationships between Requirements Engineering Processes and Other Processes that Lead to Payoffs in Productivity, Quality, and Risk Management," IEEE Trans. Software Eng., vol. 32, no. 7, pp. 433-453, July/Aug. 2006.
[141] D. Damian, J. Chisan, L. Vaidyanathasamy, and Y. Pal, "Requirements Engineering and Downstream Software Development: Findings from a Case Study," Empirical Software Eng., vol. 10, no. 3, pp. 255-283, July 2005.
[142] L. Damm and L. Lundberg, "Results from Introducing Component-Level Test Automation and Test-Driven Development," J. Systems and Software, vol. 79, no. 7, pp. 1001-1014, July 2006.
[143] M.K. Daskalantonakis, "A Practical View of Software Measurement and Implementation Experiences within Motorola," IEEE Trans. Software Eng., vol. 18, no. 11, pp. 998-1010, Nov. 1992.
[144] N. Davis, J. Mullaney, and D. Carrington, "Using Measurement Data in a TSPSM Project," Software Process Improvement, pp. 91-101, Springer, 2004.
[145] C. Debou and A. Kuntzmann-Combelles, "Linking Software Process Improvement to Business Strategies: Experiences from Industry," Software Process Improvement and Practice, vol. 5, no. 1, pp. 55-64, Mar. 2000.
[146] M. Diaz and J. Sligo, "How Software Process Improvement Helped Motorola," IEEE Software, vol. 14, no. 5, pp. 75-80, Sept. 1997.
[147] J. Dick and E. Woods, "Lessons Learned from Rigorous System Software Development," Information and Software Technology, vol. 39, no. 8, pp. 551-560, Aug. 1997.
[148] R. Dion, "Elements of a Process-Improvement Program," IEEE Software, vol. 9, no. 4, pp. 83-85, July 1992.
[149] R. Dion, "Process Improvement and the Corporate Balance Sheet," IEEE Software, vol. 10, no. 4, pp. 28-35, July 1993.
[150] F. Downey and G. Coleman, "Using SPI to Achieve Delivery Objectives in E-Commerce Software Development," Software Process Improvement and Practice, vol. 13, no. 4, pp. 327-333, July 2008.
[151] C. Ebert, "The Quest for Technical Controlling," Software Process Improvement and Practice, vol. 4, no. 1, pp. 21-31, Mar. 1998.
[152] C. Ebert, "Technical Controlling and Software Process Improvement," J. Systems and Software, vol. 46, no. 1, pp. 25-39, Apr. 1999.
[153] C. Ebert, "Understanding the Product Life Cycle: Four Key Requirements Engineering Techniques," IEEE Software, vol. 23, no. 3, pp. 19-25, May/June 2006.
[154] C. Ebert, "The Impacts of Software Product Management," J. Systems and Software, vol. 80, no. 6, pp. 850-861, June 2007.
[155] C. Ebert and J.D. Man, "e-R&D—Effectively Managing Process Diversity," Annals of Software Eng., vol. 14, nos. 1-4, pp. 73-91, Dec. 2002.
[156] C. Ebert, C.H. Parro, R. Suttels, and H. Kolarczyk, "Improving Validation Activities in a Global Software Development," Proc. 23rd Int'l Conf. Software Eng., pp. 545-554, 2001.
[157] K. El Emam and A. Birk, "Validating the ISO/IEC 15504 Measure of Software Requirements Analysis Process Capability," IEEE Trans. Software Eng., vol. 26, no. 6, pp. 541-66, June 2000.
[158] K. El Emam and N. Madhavji, "Does Organizational Maturity Improve Quality?" IEEE Software, vol. 13, no. 5, pp. 109-110, Sept. 1996.
[159] D. Escala and M. Morisio, "A Metric Suite for a Team PSP," Proc. Fifth Int'l Software Metrics Symp., pp. 89-92, 1998.
[160] A. Ferreira, G. Santos, R. Cerqueira, M. Montoni, A. Barreto, A.S. Barreto, and A. Rocha, "Applying ISO 9001:2000, MPS.BR and CMMI to Achieve Software Process Maturity: BL Informatica's Pathway," Proc. 29th Int'l Conf. Software Eng., pp. 642-651, 2007.
[161] A.I.F. Ferreira, G. Santos, R. Cerqueira, M. Montoni, A. Barreto, A.R. Rocha, A.O.S. Barreto, and R.C. Silva, "ROI of Software Process Improvement at BL Informatica: SPIdex Is Really Worth It," Software Process Improvement and Practice, vol. 13, no. 4, pp. 311-318, July 2008.
[162] B. Freimut, C. Denger, and M. Ketterer, "An Industrial Case Study of Implementing and Validating Defect Classification for Process Improvement and Quality Management," Proc. 11th Int'l Software Metrics Symp., pp. 165-174, 2005.
[163] V. French, "Applying Software Engineering and Process Improvement to Legacy Defence System Maintenance: An Experience Report," Proc. 11th Int'l Conf. Software Maintenance, pp. 337-43, 1995.
[164] T. Galinac and Z. Car, "Software Verification Process Improvement Proposal Using Six Sigma," Product Focused Software Process Improvement, pp. 51-64, Springer, 2007.
[165] G. Giraudo and P. Tonella, "Designing and Conducting an Empirical Study on Test Management Automation," Empirical Software Eng., vol. 8, no. 1, pp. 59-81, Mar. 2003.
[166] S. Golubic, "Influence of Software Development Process Capability on Product Quality," Proc. Eighth Int'l Conf. Telecomm., pp. 457-63, 2005.
[167] T. Gorschek and A. Davis, "Requirements Engineering: In Search of the Dependent Variables," Information and Software Technology, vol. 50, nos. 1/2, pp. 67-75, Jan. 2008.
[168] L. Gou, Q. Wang, J. Yuan, Y. Yang, M. Li, and N. Jiang, "Quantitatively Managing Defects for Iterative Projects: An Industrial Experience Report in China," Making Globally Distributed Software Development a Success Story, pp. 369-380, Springer, 2008.
[169] R. Grable, J. Jernigan, C. Pogue, and D. Divis, "Metrics for Small Projects: Experiences at the SED," IEEE Software, vol. 16, no. 2, pp. 21-29, Mar./Apr. 1999.
[170] T.J. Haley, "Software Process Improvement at Raytheon," IEEE Software, vol. 13, no. 6, pp. 33-41, Nov. 1996.
[171] W. Harrison, D. Raffo, J. Settle, and N. Eicklemann, "Technology Review: Adapting Financial Measures: Making a Business Case for Software Process Improvement," Software Quality J., vol. 8, no. 3, pp. 211-30, Nov. 1999.
[172] S.I. Hashmi and J. Baik, "Quantitative Process Improvement in XP Using Six Sigma Tools," Proc. Seventh Int'l Conf. Computer and Information Science, pp. 519-524, 2008.
[173] J. Haugh, "Never Make the Same Mistake Twice-Using Configuration Control and Error Analysis to Improve Software Quality," Proc. IEEE/AIAA 10th Digital Avionics Systems Conf., pp. 220-225, 1991.
[174] J.H. Hayes, N. Mohamed, and T.H. Gao, "Observe-Mine-Adopt (OMA): An Agile Way to Enhance Software Maintainability," J. Software Maintenance and Evolution, vol. 15, no. 5, pp. 297-323, Sept. 2003.
[175] L. He and J. Carver, "PBR vs. Checklist: A Replication in the n-Fold Inspection Context," Proc. Fifth Int'l Symp. Empirical Software Eng., pp. 95-104, 2006.
[176] J. Henry, A. Rossman, and J. Snyder, "Quantitative Evaluation of Software Process Improvement," J. Systems and Software, vol. 28, no. 2, pp. 169-177, Feb. 1995.
[177] J.D. Herbsleb and D.R. Goldenson, "A Systematic Survey of CMM Experience and Results," Proc. 18th Int'l Conf. Software Eng., pp. 323-330, 1996.
[178] C. Hollenbach and D. Smith, "A Portrait of a CMMISM Level 4 Effort," Systems Eng., vol. 5, no. 1, pp. 52-61, 2002.
[179] C. Hollenbach, R. Young, A. Pflugrad, and D. Smith, "Combining Quality and Software Improvement," Comm. ACM, vol. 40, no. 6, pp. 41-45, June 1997.
[180] J. Hössler, O. Kath, M. Soden, M. Born, and S. Saito, "Significant Productivity Enhancement through Model Driven Techniques: A Success Story," Proc. 10th Int'l Enterprise Distributed Object Computing Conf., pp. 367-373, 2006.
[181] M. Höst and C. Johansson, "Evaluation of Code Review Methods through Interviews and Experimentation," J. Systems & Software, vol. 52, nos. 2/3, pp. 113-20, June 2000.
[182] W. Humphrey, "Using a Defined and Measured Personal Software Process," IEEE Software, vol. 13, no. 3, pp. 77-88, May 1996.
[183] S. Hwang and H. Kim, "A Study on Metrics for Supporting the Software Process Improvement Based on SPICE," Software Eng. Research and Applications, pp. 71-80, Springer, 2005.
[184] K. Hyde and D. Wilson, "Intangible Benefits of CMM-Based Software Process Improvement," Software Process Improvement and Practice, vol. 9, no. 4, pp. 217-228, Oct. 2004.
[185] J. Iversen and L. Mathiassen, "Cultivation and Engineering of a Software Metrics Program," Information Systems J., vol. 13, no. 1, pp. 3-19, Jan. 2003.
[186] J. Iversen and O. Ngwenyama, "Problems in Measuring Effectiveness in Software Process Improvement: A Longitudinal Study of Organizational Change at Danske Data," Int'l J. Information Management, vol. 26, no. 1, pp. 30-43, Feb. 2006.
[187] J. Jarvinen and R. van Solingen, "Establishing Continuous Assessment Using Measurements," Proc. First Int'l Conf. Product Focused Software Process Improvement, pp. 49-67, 1999.
[188] J. Jarvinen, D. Hamann, and R. van Solingen, "On Integrating Assessment and Measurement: Towards Continuous Assessment of Software Engineering Processes," Proc. Sixth Int'l Software Metrics Symp., pp. 22-30, 1999.
[189] A. Johnson, "Software Process Improvement Experience in the DP/MIS Function," Proc. 16th Int'l Conf. Software Eng., pp. 323-329, 1994.
[190] D. Karlström, P. Runeson, and S. Norden, "A Minimal Test Practice Framework for Emerging Software Organizations," Software Testing, Verification and Reliability, vol. 15, no. 3, pp. 145-166, Sept. 2005.
[191] K. Kautz, "Making Sense of Measurement for Small Organizations," IEEE Software, vol. 16, no. 2, pp. 14-20, Mar./Apr. 1999.
[192] H. Kihara, "Quality Assurance Activities in the Software Development Center, Hitachi Ltd," Proc. 16th Ann. Pacific Northwest Software Quality Conf. Joint ASQ Software Division's Eighth Int'l Conf. Software Quality, pp. 372-384, 1998.
[193] H. Krasner and G. Scott, "Lessons Learned from an Initiative for Improving Software Process, Quality and Reliability in a Semiconductor Equipment Company," Proc. 29th Ann. Hawaii Int'l Conf. System Sciences, pp. 693-702, 1996.
[194] J. Kuilboer and N. Ashrafi, "Software Process Improvement Deployment: An Empirical Perspective," J. Information Technology Management, vol. 10, nos. 3/4, pp. 35-47, 1999.
[195] A. Kuntzmann-Combelles, "Quantitative Approach to Software Process Improvement," Objective Software Quality, pp. 16-30, Springer, 1995.
[196] J.A. Lane and D. Zubrow, "Integrating Measurement with Improvement: An Action-Oriented Approach," Proc. 19th Int'l Conf. Software Eng., pp. 380-389, 1997.
[197] J. Larsen and H. Roald, "Introducing ClearCase as a Process Improvement Experiment," System Configuration Management, pp. 1-12, Springer, 1998.
[198] L. Lazic and N. Mastorakis, "Cost Effective Software Test Metrics," WSEAS Trans. Computers, vol. 7, no. 6, pp. 599-619, June 2008.
[199] E. Lee and M. Lee, "Development System Security Process of ISO/IEC TR 15504 and Security Considerations for Software Process Improvement," Computational Science and Its Applications, pp. 363-372, Springer, 2005.
[200] J.W. Lee, S.H. Jung, S.C. Park, Y.J. Lee, and Y.C. Jang, "System Based SQA and Implementation of SPI for Successful Projects," Proc. Int'l Conf. Information Reuse and Integration, pp. 494-499, 2005.
[201] H. Leung, "Improving Defect Removal Effectiveness for Software Development," Proc. Second Euromicro Conf. Software Maintenance and Reeng., pp. 157-64, 1998.
[202] B. List, R. Bruckner, and J. Kapaun, "Holistic Software Process Performance Measurement from the Stakeholders' Perspective," Proc. 16th Int'l Workshop Database and Expert Systems Applications, pp. 941-947, 2005.
[203] D. Macke and T. Galinac, "Optimized Software Process for Fault Handling in Global Software Development," Making Globally Distributed Software Development a Success Story, pp. 395-406, Springer, 2008.
[204] F. McGarry, "What Is a Level 5?," Proc. 26th Ann. NASA Goddard Software Eng. Workshop, pp. 83-90, 2002.
[205] F. McGarry and B. Decker, "Attaining Level 5 in CMM Process Maturity," IEEE Software, vol. 19, no. 6, pp. 87-96, Nov./Dec. 2002.
[206] F. McGarry, S. Burke, and B. Decker, "Measuring the Impacts Individual Process Maturity Attributes Have on Software Products," Proc. Fifth Int'l Software Metrics Symp., pp. 52-60, 1998.
[207] K.A. McKeown and E.G. McGuire, "Evaluation of a Metrics Framework for Product and Process Integrity," Proc. 33rd Hawaii Int'l Conf. System Sciences, p. 4046, 2000.
[208] P. Miller, "An SEI Process Improvement Path to Software Quality," Proc. Sixth Int'l Conf. Quality of Information and Comm. Technology, pp. 12-18, 2007.
[209] J. Momoh and G. Ruhe, "Release Planning Process Improvement— An Industrial Case Study," Software Process Improvement and Practice, vol. 11, no. 3, pp. 295-307, May 2006.
[210] S. Morad and T. Kuflik, "Conventional and Open Source Software Reuse at Orbotech—An Industrial Experience," Proc. IEEE Int'l Conf. Software—Science, Technology and Eng., pp. 110-117, 2005.
[211] B. Moreau, C. Lassudrie, B. Nicolas, O. I'Homme, C. d'Anterroches, and G.L. Gall, "Software Quality Improvement in France Telecom Research Center," Software Process Improvement and Practice, vol. 8, no. 3, pp. 135-144, July 2003.
[212] M. Murugappan and G. Keeni, "Quality Improvement—the Six Sigma Way," Proc. First Asia-Pacific Conf. Quality Software, pp. 248-257, 2000.
[213] M. Murugappan and G. Keeni, "Blending CMM and Six Sigma to Meet Business Goals," IEEE Software, vol. 20, no. 2, pp. 42-48, Mar./Apr. 2003.
[214] K. Nelson and M. Ghods, "Evaluating the Contributions of a Structured Software Development and Maintenance Methodology," Information Technology & Management, vol. 3, nos. 1/2, pp. 11-23, Jan. 2002.
[215] K. Nelson, M. Buche, and H. Nelson, "Structural Change and Change Advocacy: A Study in Becoming a Software Engineering Organization," Proc. 34th Ann. Hawaii Int'l Conf. System Sciences, p. 9, 2001.
[216] T. Nishiyama, K. Ikeda, and T. Niwa, "Technology Transfer Macro-Process. A Practical Guide for the Effective Introduction of Technology," Proc. 22nd Int'l Conf. Software Eng., pp. 577-586, 2000.
[217] A. Nolan, "Learning from Success," IEEE Software, vol. 16, no. 1, pp. 97-105, Jan./Feb. 1999.
[218] S. Otoya and N. Cerpa, "An Experience: A Small Software Company Attempting to Improve Its Process," Proc. Ninth Int'l Workshop Software Technology and Eng. Practice, pp. 153-60, 1999.
[219] D.J. Paulish and A.D. Carleton, "Case Studies of Software-Process-Improvement Measurement," Computer, vol. 27, no. 9, pp. 50-57, Sept. 1994.
[220] S. Pfleeger, "Maturity, Models, and Goals: How to Build a Metrics Plan," J. Systems and Software, vol. 31, no. 2, pp. 143-55, Nov. 1995.
[221] L. Pracchia, "TheAV-8B Team Learns Synergy of EVM and TSP Accelerates Software Process Improvement," J. CrossTalk, vol. 17, no. 1, pp. 20-22, 2004.
[222] L. Prechelt and B. Unger, "An Experiment Measuring the Effects of Personal Software Process (PSP) Training," IEEE Trans. Software Eng., vol. 27, no. 5, pp. 465-472, May 2001.
[223] J. Ramil and M. Lehman, "Defining and Applying Metrics in the Context of Continuing Software Evolution," Proc. Seventh Int'l Software Metrics Symp., pp. 199-209, 2000.
[224] C. Redzic and J. Baik, "Six Sigma Approach in Software Quality Improvement," Proc. Fourth Int'l Conf. Software Eng. Research, Management and Applications, pp. 396-406, 2006.
[225] B. Regnell, P. Beremark, and O. Eklundh, "A Market-Driven Requirements Engineering Process: Results from an Industrial Process Improvement Programme," Requirements Eng., vol. 3, no. 2, pp. 121-129, June 1998.
[226] A. Roan and P. Hebrard, "A PIE One Year After: APPLY," Proc. Int'l Conf. Product Focused Software Process Improvement, pp. 606-619, 1999.
[227] J. Rooijmans, H. Aerts, and M. van Genuchten, "Software Quality in Consumer Electronics Products," IEEE Software, vol. 13, no. 1, pp. 55-64, Jan. 1996.
[228] M. Russ and J. McGregor, "A Software Development Process for Small Projects," IEEE Software, vol. 17, no. 5, pp. 96-101, Sept./Oct. 2000.
[229] K. Sakamoto, N. Niihara, T. Tanaka, K. Nakakoji, and K. Kishida, "Analysis of Software Process Improvement Experience Using the Project Visibility Index," Proc. Third Asia-Pacific Software Eng. Conf., pp. 139-48, 1996.
[230] O. Salo and P. Abrahamsson, "An Iterative Improvement Process for Agile Software Development," Software Process Improvement and Practice, vol. 12, no. 1, pp. 81-100, Jan. 2007.
[231] K. Sargut and O. Demirors, "Utilization of Statistical Process Control (SPC) in Emergent Software Organizations: Pitfalls and Suggestions," Software Quality J., vol. 14, no. 2, pp. 135-157, June 2006.
[232] E. Savioja and M. Tukiainen, "Measurement Practices in Financial Software Industry," Software Process Improvement and Practice, vol. 12, no. 6, pp. 585-595, Nov. 2007.
[233] J. Schalken, S. Brinkkemper, and H. van Vliet, "Using Linear Regression Models to Analyse the Effect of Software Process Improvement," Product-Focused Software Process Improvement, pp. 234-248, Springer, 2006.
[234] N. Schneidewind, "Measuring and Evaluating Maintenance Process Using Reliability, Risk, and Test Metrics," IEEE Trans. Software Eng., vol. 25, no. 6, pp. 769-781, Nov./Dec. 1999.
[235] L. Scott, R. Jeffery, L. Carvalho, J. D'Ambra, and P. Rutherford, "Practical Software Process Improvement—The IMPACT Project," Proc. 13th Australian Software Eng. Conf., pp. 182-189, 2001.
[236] R. Seacord, J. Elm, W. Goethert, G. Lewis, D. Plakosh, J. Robert, L. Wrage, and M. Lindvall, "Measuring Software Sustainability," Proc. Int'l Conf. Software Maintenance, pp. 450-459, 2003.
[237] G. Seshagiri and S. Priya, "Walking the Talk: Building Quality into the Software Quality Management Tool," Proc. Third Int'l Conf. Quality Software, pp. 67-74, 2003.
[238] S. Shah and J. Sutton, "Crafting a TQM-Oriented Software Development Lifecycle: Program Experience," Proc. IEEE Nat'l Aerospace and Electronics Conf., pp. 643-649, 1992.
[239] B. Shen and D. Ju, "On the Measurement of Agility in Software Process," Software Process Dynamics and Agility, pp. 25-36, Springer, 2007.
[240] I. Sommerville and J. Ransom, "An Empirical Study of Industrial Requirements Engineering Process Assessment and Improvement," ACM Trans. Software Eng. and Methodology, vol. 14, no. 1, pp. 85-117, Jan. 2005.
[241] G. Spork and U. Pichler, "Establishment of a Performance Driven Improvement Programme," Software Process Improvement and Practice, vol. 13, no. 4, pp. 371-382, July 2008.
[242] L. Suardi, "How to Manage Your Software Product Life Cycle with MAUI," Comm. ACM, vol. 47, no. 3, pp. 89-94, Mar. 2004.
[243] T. Lee, D. Baik, and H. In, "Cost Benefit Analysis of Personal Software Process Training Program," Proc. IEEE Eighth Int'l Conf. Computer and Information Technology Workshops, pp. 631-636, 2008.
[244] T. Tanaka, K. Sakamoto, S. Kusumoto, K. Matsumoto, and T. Kikuno, "Improvement of Software Process by Process Description and Benefit Estimation," Proc. 17th Int'l Conf. Software Eng., pp. 123-132, 1995.
[245] K. Taneike, H. Okada, H. Ishigami, and H. Mukaiyama, "Quality Assurance Activities for Enterprise Application Software Packages," Fujitsu Scientific and Technical J., vol. 44, no. 2, pp. 106-113, Apr. 2008.
[246] C. Tischer, A. Müller, M. Ketterer, and L. Geyer, "Why Does It Take That Long? Establishing Product Lines in the Automotive Domain," Proc. 11th Int'l Software Product Line Conf., pp. 269-274, 2007.
[247] F. Titze, "Improvement of a Configuration Management System," Proc. 22nd Int'l Conf. Software Eng., pp. 618-625, 2000.
[248] J. Trienekens, R. Kusters, and R. van Solingen, "Product Focused Software Process Improvement: Concepts and Experiences from Industry," Software Quality J., vol. 9, no. 4, pp. 269-81, Dec. 2001.
[249] J. Trienekens, R. Kusters, M. van Genuchten, and H. Aerts, "Targets, Drivers and Metrics in Software Process Improvement: Results of a Survey in a Multinational Organization," Software Quality J., vol. 15, no. 2, pp. 135-53, June 2007.
[250] J.D. Valett, "Practical Use of Empirical Studies for Maintenance Process Improvement," Empirical Software Eng., vol. 2, no. 2, pp. 133-142, June 1997.
[251] M. van Genuchten, C. van Dijk, H. Scholten, and D. Vogel, "Using Group Support Systems for Software Inspections," IEEE Software, vol. 18, no. 3, pp. 60-65, May/June 2001.
[252] R. van Solingen, "Measuring the ROI of Software Process Improvement," IEEE Software, vol. 21, no. 3, pp. 32-38, May/June 2004.
[253] G. Visaggio, P. Ardimento, M. Baldassarre, and D. Caivano, "Assessing Multiview Framework (MF) Comprehensibility and Efficiency: A Replicated Experiment," Information and Software Technology, vol. 48, no. 5, pp. 313-22, May 2006.
[254] M. Visconti and L. Guzman, "A Measurement-Based Approach for Implanting SQA and SCM Practices," Proc. 20th Int'l Conf. the Chilean Computer Science Soc., pp. 126-34, 2000.
[255] B.R.V. Konsky and M. Robey, "A Case Study: GQM and TSP in a Software Engineering Capstone Project," Proc. 18th Software Eng. Education Conf., pp. 215-222, 2005.
[256] C. von Wangenheim, S. Weber, J. Hauck, and G. Trentin, "Experiences on Establishing Software Processes in Small Companies," Information and Software Technology, vol. 48, no. 9, pp. 890-900, Sept. 2006.
[257] Q. Wang and M. Li, "Measuring and Improving Software Process in China," Proc. Int'l Symp. Empirical Software Eng., pp. 183-192, 2005.
[258] D. Weiss, D. Bennett, J. Payseur, P. Tendick, and P. Zhang, "Goal-Oriented Software Assessment," Proc. 24th Int'l Conf. Software Eng., pp. 221-231, 2002.
[259] D. Winkler, B. Thurnher, and S. Biffl, "Early Software Product Improvement with Sequential Inspection Sessions: An Empirical Investigation of Inspector Capability and Learning Effects," Proc. 33rd Euromicro Conf. Software Eng. and Advanced Applications, pp. 245-254, 2007.
[260] M. Winokur, A. Grinman, I. Yosha, and R. Gallant, "Measuring the Effectiveness of Introducing New Methods in the Software Development Process," Proc. 24th EUROMICRO Conf., pp. 800-807, 1998.
[261] C. Wohlin and A. Wesslen, "Understanding Software Defect Detection in the Personal Software Process," Proc. Ninth Int'l Symp. Software Reliability Eng., pp. 49-58, 1998.
[262] H. Wohlwend and S. Rosenbaum, "Schlumberger's Software Improvement Program," IEEE Trans. Software Eng., vol. 20, no. 11, pp. 833-839, Nov. 1994.
[263] Z. Xiaosong, H. Zhen, G. Fangfang, and Z. Shenqing, "Research on the Application of Six Sigma in Software Process Improvement," Proc. Fourth Int'l Conf. Intelligent Information Hiding and Multimedia Signal Processing, pp. 937-940, 2008.
[264] Z. Xiaosong, H. Zhen ZhangMin, W. Jing, and Y. Dainuan, "Process Integration of Six Sigma and CMMI," Proc. Sixth Int'l Conf. Industrial Informatics, pp. 1650-1653, 2008.
[265] R. Xu, Y. Xue, P. Nie, Y. Zhang, and D. Li, "Research on CMMI-Based Software Process Metrics," Proc. First Int'l Computer and Computational Sciences, pp. 391-397, 2006.
[266] J. Zettell, F. Maurer, J. Münch, and L. Wong, "LIPE: A Lightweight Process for E-Business Startup Companies Based on Extreme Programming," Product Focused Software Process Improvement, pp. 255-70, Springer, 2001.
23 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool