Issue No.02 - March-April (2012 vol.38)
pp: 439-452
Jose L. Salmeron , University Pablo de Olavide, Seville
Cristina Lopez , Pablo de Olavide University, Seville
Worldwide, firms have made great efforts to implement Enterprise Resource Planning (ERP) systems. Despite these efforts, ERP adoption success is not guaranteed. Successful adoption of an ERP system also depends on proper system maintenance. For this reason, companies should follow a maintenance strategy that drives the ERP system toward success. However, in general, ERP maintenance managers do not know what conditions they should target to successfully maintain their ERP systems. Furthermore, numerous risks threaten these projects, but they are normally dealt with intuitively. To date, there has been limited literature published regarding ERP maintenance risks or ERP maintenance success. To address this need, we have built a dynamic simulation tool that allows ERP managers to foresee the impact of risks on maintenance goals. This research would help professionals manage their ERP maintenance projects. Moreover, it covers a significant gap in the literature.
ERP, fuzzy cognitive maps, risk management, simulation, software maintenance.
Jose L. Salmeron, Cristina Lopez, "Forecasting Risk Impact on ERP Maintenance with Augmented Fuzzy Cognitive Maps", IEEE Transactions on Software Engineering, vol.38, no. 2, pp. 439-452, March-April 2012, doi:10.1109/TSE.2011.8
[1] D. Chand, G. Hachey, J. Hunton, V. Owhoso, and S. Vasudevan, "A Balanced Scorecard Based Framework for Assessing the Strategic Impacts of ERP Systems," Computers in Industry, vol. 56, no. 6, pp. 558-572, 2005.
[2] V. Botta-Genoulaz and P.A. Millet, "An Investigation into the Use of ERP Systems in the Service Sector," Int'l J. Production Economics, vol. 99, nos. 1/2, pp. 202-221, 2006.
[3] D. ÓLeary, Enterprise Resource Planning Systems, Life Cycle, Electronic Commerce and Risk. Cambridge Univ. Press, 2000.
[4] M. Al-Mashari, "Enterprise Resource Planning (ERP) Systems: A Research Agenda," Industrial Management and Data Systems, vol. 102, no. 3, pp. 165-170, 2002.
[5] Booz Allen & Hamilton, "Insights Enterprise Resource Planning, Big Money Down the Drain?" Information Technology Group, 658713, 2000.
[6] A.I. Nicolaou, "Quality of Postimplementation Review for Enterprise Resource Planning Systems," Int'l J. Accounting Information Systems, vol. 5, no. 1, pp. 25-49, 2004.
[7] C.-S. Yu, "Causes Influencing the Effectiveness of the Post-Implementation System," Industrial Management and Data Systems, vol. 105, no. 1, pp. 115-132, 2005.
[8] C.S.P. Ng, G. Gable, and T. Chan, "A ERP Client-Benefits-Oriented Maintenance Taxonomy," J. Systems and Software, vol. 64, no. 2, pp. 87-109, 2002.
[9] S. Jaconson, J. Sheperd, M. D'Aquila, and C. Carter, "The Enterprise Resource Planning Spending Report 2006-2011," AMR Research, http:/, 2007.
[10] V. Botta-Genoulaz, P.A. Millet, and B. Grabot, "A Survey on the Recent Research Literature on ERP Systems," Computers in Industry, vol. 56, no. 6, pp. 510-522, 2005.
[11] J.M. Esteves and V. Bohorquez, "An Updated ERP Systems Annotated Bibliography: 2001-2005," Comm. Assoc. for Information Systems, vol. 19, no. 8, pp. 386-446, 2007.
[12] S.G. Hirt and E.B. Swanson, "Emergent Maintenance of ERP: New Roles and Relationships," J. Software Maintenance and Evolution: Research and Practice, vol. 13, no. 6, pp. 373-397, 2001.
[13] C.S.P. Ng, G. Gable, and T. Chan, "A Revelatory Case Study into the Adequacy of Standard Maintenance Models in an ERP Context," Proc. Seventh Pacific Asia Conf. Information Systems, pp. 1039-1054, 2003.
[14] B. McNurlin, "Will Users of ERP Stay Satisfied?" MIT Sloan Management Rev., vol. 42, no. 2, p. 13, 2001.
[15] A. Dorofee and C. Alberts, "Rethinking Risk Management," Proc. NDIA Systems Eng. Conf., risk/uploaddorofeetutorialndia09_8819.pdf , 2009.
[16] T.H. Davenport, "Putting the Enterprise into the Enterprise System," Harvard Business Rev., vol. 76, no. 4, pp. 121-133, 1998.
[17] C.S.P. Ng, G.G. Gable, and T. Chan, "An ERP Maintenance Model," Proc. 36th Ann. Hawaii Int'l Conf. System Science, pp. 1-10, 2003, doi:10.1109/HICSS.2003.1174609.
[18] J.M. Esteves and J.A. Pastor, "An ERP Life-Cycle-Based Research Agenda," Proc. First Int'l Workshop in Enterprise Management and Resource Planning, pp. 359-371, 1999.
[19] T.C. McGinnis and Z. Huang, "Rethinking ERP Success: A New Perspective from Knowledge Management and Continuous Improvement," Information and Management, vol. 44, no. 7, pp. 626-634, 2007.
[20] T.H. Willis and A.H. Willis-Brown, "Extending the Value of ERP," Industrial Management and Data Systems, vol. 102, no. 1, pp. 35-38, 2002.
[21] S. Baldwin, "ERP's Second Wave: Maximizing the Value of ERP-Enabled Processes," Deloitte Consulting Study, http://www. wp01/downloaderp2w.pdf, 1999.
[22] C.C.H. Law, C.C. Chen, and B.J.P. Wu, "Managing the Full ERP Life-Cycle: Considerations of Maintenance and Support Requirements and IT Governance Practice as Integral Elements of the Formula for Successful ERP Adoption," Computers in Industry, vol. 61, no. 3, pp. 297-308, 2010.
[23] K. Bakker, A. Boonstra, and H. Wortmann, "Does Risk Management Contribute to IT Project Success? A Meta-Analysis of Empirical Evidence," Int'l J. Project Management, vol. 28, no. 5, pp. 493-503, 2010.
[24] G.G. Gable, D. Sedera, and T. Chan, "Re-Conceptualizing Information System Success: The IS-Impact Measurement Model" J. Assoc. for Information Systems, vol. 9, no. 7, pp. 377-408, 2008.
[25] T.F. Gattiker and D.L. Goodhue, "What Happens after ERP Implementation: Understanding the Impact of Interdependence and Differentiation on Plant-Level Outcomes," MIS Quarterly, vol. 29, no. 3, pp. 559-585, 2005.
[26] J.L. Salmeron and C. Lopez, "A Multicriteria Approach for Risks Assessment in ERP Maintenance" J. Systems and Software, vol. 83, no. 10, pp. 1941-1953, 2010.
[27] C.S.P. Ng, "A Decision Framework for Enterprise Resource Planning Maintenance and Upgrade: A Client Perspective," J. Software Maintenance and Evolution: Research and Practice, vol. 13, no. 6, pp. 431-468, 2001.
[28] C.S.P. Ng, P.-Y. Hsu, and W.-H. Tsai, "Salient Factors for Maintenance Standard Adoption in Enterprise Resource Planning Context: An Exploratory Study," Proc. 39th Ann. Hawaii Int'l Conf. System Science, vol. 8, pp. 1-10, 2006, doi: 10.1109/HICSS.2006.426.
[29] O.B. Kwon and J.J. Lee, "A Multi-Agent Intelligent System for Efficient ERP Maintenance," Expert System with Applications, vol. 21, no. 4, pp. 191-202, 2001.
[30] M.R. Imtihan, M.S. Ngadiman, and H. Haron, "An Alternative Model for ERP Maintenance Strategy," Proc. Ninth ACIS Int'l Conf. Software Eng., Artificial Intelligence, Networking, and Parallel/Distributed Computing, pp. 785-793, 2008, doi: 10.1109/SNPD.2008. 135.
[31] J. Whanga, M.-B. Lee, and K. Kim, "A Case Study on the Successful Upgrade of ERP System," Proc. Seventh Pacific Asia Conf. Information Systems, pp. 1030-1038, 2003.
[32] D.L. Olson and F. Zhao, "CIOs' Perspectives of Critical Success Factors in ERP Upgrade Projects," Enterprise Information Systems, vol. 1, no. 1, pp. 129-138, 2007.
[33] Project Management Inst. (PMI), A Guide to the Project Management Body of Knowledge (PMBOK Guide), fourth ed. Project Management Inst. (PMI), Pennsylvania, EE.UU 2008.
[34] R. Mookerjee, "Maintaining Enterprise Software Applications," Comm. ACM, vol. 48, no. 11, pp. 75-79, 2005.
[35] A. Teltumbde, "A Framework for Evaluating ERP Projects," Int'l J. Production Research, vol. 38, no. 17, pp. 4507-4520, 2000.
[36] F.W. McFarlan, "Portfolio Approach to Information Systems," Harvard Business Rev., vol. 59, no. 5, pp. 142-150, 1981.
[37] J. Rong, L. Hongzhi, Y. Jiankun, F. Tao, Z. Chenggui, and L. Junlin, "A Model Based on Information Entropy to Measure Developer Turnover Risk on Software Project," Proc. Second IEEE Int'l Conf. Computer Science and Information Technology, pp. 419-422, 2009, doi: 10.1109/ICCSIT.2009.5234813.
[38] P.L. Bannerman, "Risk and Risk Management in Software Projects: A Reassessment," J. Systems and Software, vol. 81, no. 12, pp. 2118-2133, 2008.
[39] F. Fui-Hoon Nah, S. Faja, and T. Cata, "Characteristics of ERP Software Maintenance: A Multiple Case Study," J. Software Maintenance and Evolution: Research and Practice, vol. 13, no. 6, pp. 399-414, 2001.
[40] M. Sumner, "Risk Factors in Enterprise-Wide/ERP Projects," J. Information Technology, vol. 15, no. 4, pp. 317-327, 2000.
[41] D. Aloini, R. Dulmin, and V. Mininno, "Risk Management in ERP Project Introduction: Review of the Literature," Information and Management, vol. 44, no. 6, pp. 547-567, 2007.
[42] S.-M. Huang, I.-C. Chang, S.-H. Li, and M.-T. Lin, "Assessing in ERP Projects: Identify and Prioritize the Factors," Industrial Management and Data Systems, vol. 8, no. 8, pp. 681-688, 2004.
[43] P. Poba-Nzaou, L. Raymond, and B. Fabi, "Adoption and Risk of ERP Systems in Manufacturing SMEs: A Positivist Case Study," Business Process Management J., vol. 14, no. 4, pp. 530-550, 2008.
[44] J.D. Scott and I. Vessey, "Managing Risks in Enterprise Systems Implementations," Comm. ACM, vol. 45, no. 4, pp. 74-81, 2002.
[45] I. Zafeiropoulos, K. Metaxiotis, and D. Askounis, "Dynamic Risk Management System for the Modeling, Optimal Adaptation and Implementation of an ERP System," Information Management and Computer Security, vol. 13, no. 3, pp. 212-234, 2005.
[46] C. Peng and M.B. Nunes, "Identification and Assessment of Risks Associated with ERP Post-Implementation in China," J. Enterprise Information Management, vol. 22, no. 5, pp. 587-614, 2009.
[47] G.C. Peng and M.B. Nunes, "Surfacing ERP Exploitation Risks through a Risk Ontology," Industrial Management and Data Systems, vol. 109, no. 7, pp. 926-942, 2009.
[48] Y.H. Kwak and J. Stoddard, "Project Risk Management: Lessons Learned from Software Development Environment," Technovation, vol. 24, no. 11, pp. 915-920, 2004.
[49] A.J. Dorofee, J.A. Walker, C.J. Alberts, R.P. Higuera, and R.L. Murphy, Continuous Risk Management Guidebook. SEI, Carnegie Mellon Univ., 1996.
[50] R. Axelrod, Structure of Decision: The Cognitive Maps of Political Elites. Princeton, 1976.
[51] B. Kosko, "Fuzzy Cognitive Maps," Int'l J. Man-Machine Studies, vol. 24, no. 1, pp. 65-75, 1986.
[52] E.I. Papageorgiou, C. Stylios, and P.P. Groumpos, "Unsupervised Learning Techniques for Fine-Tuning Fuzzy Cognitive Map Causal Links," Int'l J. Human-Computer Studies, vol. 64, no. 8, pp. 727-743, 2006.
[53] K-M. Osei-Bryson, "Generating Consistent Subjective Estimates of the Magnitudes of Causal Relationships in Fuzzy Cognitive maps," Computers and Operations Research, vol. 31, no. 8, pp. 1165-1175, 2004.
[54] L.M. Fu, "CAUSIM: A Rule-Based Causal Simulation System," Simulation, vol. 56, no. 4, pp. 251-256, 1991.
[55] I. Kang, S. Lee, and J. Choi, "Using Fuzzy Cognitive Map for the Relationship Management in Airline Service," Expert Systems with Applications, vol. 26, no. 4, pp. 545-555, 2004.
[56] S. Lee and I. Han, "Fuzzy Cognitive Map for the Design of EDI Controls," Information and Management, vol. 37, no. 1, pp. 37-50, 2000.
[57] G. Xirogiannis and M. Glykas, "Intelligent Modeling of E-Business Maturity," Expert Systems with Applications, vol. 32, no. 2, pp. 687-702, 2007.
[58] S. Nahmiasj and H. Rivera, "A Deterministic Model for a Repairable Item Inventory System with a Finite Repair Rate," Int'l J. Production Research, vol. 17, no. 3, pp. 215-221, 1979.
[59] B. Kitchenham, L.M. Pickard, S. Linkman, and P.W. Jones, "Modeling Software Bidding Risks," IEEE Trans. Software Eng., vol. 29, no. 6, pp. 542-554, June 2003.
[60] J.L. Salmeron, "Modelling Grey Uncertainty with Fuzzy Grey Cognitive Maps," Expert Systems with Applications, vol. 37, no. 12, pp. 7581-7588, 2010.
[61] G. Xirogiannis and M. Glykas, "Fuzzy Cognitive Maps in Business Analysis and Performance-Driven Change," IEEE Trans. Eng. Management, vol. 51, no. 3, pp. 334-351, Aug. 2004.
[62] T. Yi and G. Xiao, "Applying System Dynamics to Analyze the Impact of Incentive Factors' Allocation on Construction Cost And Risk," Proc. Int'l Conf. Machine Learning and Cybernetics, pp. 676- 680, 2008, doi: 10.1109/ICMLC. 2008. 46204 90.
[63] E. Lee, Y. Park, and J.G. Shin, "Large Engineering Project Risk Management Using a Bayesian Belief Network," Expert Systems with Applications, vol. 36, no. 3, pp. 5880-5887, 2009.
[64] C.-F. Fan and Y.-C. Yu, "BBN-Based Software Project Risk Management," J. Systems and Software, vol. 73, no. 2, pp. 193-203, 2004.
[65] D.E. Neumann, "An Enhanced Neural Network Technique for Software Risk Analysis," IEEE Trans. Software Eng., vol. 28, no. 9, pp. 904-912, Sept. 2002.
[66] B. Kosko, Fuzzy Engineering. Prentice Hall, 1996.
[67] U. Özesmi and S.L. Özesmi, "Ecological Models Based on People's Knowledge: A Multi-Step Fuzzy Cognitive Mapping Approach" Ecological Modelling, vol. 176, nos. 1/2, pp. 43-64, 2004.
[68] L. Rodriguez-Repiso, R. Setchi, and J.L. Salmeron, "Modelling IT Projects Success: Emerging Methodologies Reviewed," Technovation, vol. 27, no. 10, pp. 582-594, 2007.
[69] J.L. Salmeron, "Augmented Fuzzy Cognitive Maps for Modelling LMS Critical Success Factors," Knowledge-Based Systems, vol. 22, no. 4, pp. 275-278, 2009.
[70] M.J. Clayton, "Delphi: A Technique to Harness Expert Opinion for Critical Decision-Making Tasks in Education," Educational Psychology, vol. 17, no. 4, pp. 373-387, 1997.
[71] C. Okoli and S. Pawlowski, "The Delphi Method as a Research Tool: An Example, Design Considerations and Applications," Information and Management, vol. 42, no. 1, pp. 15-29, 2004.
[72] D. Grant and K. Osei-Bryson, "Using Fuzzy Cognitive Maps to Assess MIS Organizational Change Impact," Proc. 38th Ann. Hawaii Int'l Conf. System Sciences, pp. 1-11, 2005, doi 10.1109/HICSS.2005.658.
[73] J. Dikerson and B. Kosko, "Virtual Worlds as Fuzzy Cognitive Maps," Presence, vol. 3, no. 2, pp. 173-189, 1994.
[74] L.A. Zadeh, "Fuzzy Sets," Information Control, vol. 8, pp. 338-353, 1965.
[75] R.E. Bellman and L.A. Zadeh, "Decision-Making in a Fuzzy Environment," Management Science, vol. 17, no. 4, pp. 141-164, 1970.
[76] G. Xirogiannis, P. Chytas, M. Glykas, and G. Valiris, "Intelligent Impact Assessment of HRM to the Shareholder Value," Expert Systems with Applications, vol. 35, no. 4, pp. 2017-2031, 2008.
[77] N. Bryson, A. Mobolurin, and A. Joseph, "Generating Consensus Fuzzy Cognitive Maps," Intelligent Information Systems, vol. 8, no. 10, pp. 231-235, 1997.
[78] H.A. Linstone and M. Turoff, The Delphi Method, Techniques and Applications. Addison-Wesley, 1975.
[79] H.K. Cho, M. Turoff, and S.R. Hiltz, "The Impacts of Delphi Communication Structure on Small and Medium Sized Asynchronous Groups: Preliminary Results," Proc. 36th Ann. Hawaii Int'l Conf. System Sciences, pp. 17-26, 2002, doi: 10.1109/HICSS.2003.1173659.
[80] S. Bueno and J.L. Salmeron, "Benchmarking Main Activation Functions in Fuzzy Cognitive Maps," Expert Systems with Applications, vol. 36, no. 3, pp. 5221-5229, 2009.
[81] O. Feyzioglu, G. Buyukozkan, and M.S. Ersoy, "Supply Chain Risk Analysis with Fuzzy Cognitive Maps," Proc. IEEE Int'l Conf. Industrial Eng. and Eng. Management, pp. 1447-1451, 2007, doi:10.1109/IEEM.2007.4419432.
[82] B.P. Lientz and E.B. Swanson, "Problems in Application Software Maintenance," Comm. ACM, vol. 24, no. 1, pp. 763-769, 1981.
[83] B.W. Boehm, "Software Risk Management: Principles and Practices," IEEE Software, vol. 8, no. 1, pp. 32-41, Jan. 1991.
[84] S. Dekleva, "Delphi Study of Software Maintenance Problems," Proc. Conf. Software Maintenance, pp. 10-17, 1992.
[85] S.A. Sherer, "The Three Dimensions of Software Risk: Technical, Organizational, and Environmental," Proc. 28th Hawaii Int'l Conf. Systems Science, pp. 369-378, 1995, doi: 10.1109/HICSS.1995. 375618.
[86] M. Keil, P. Cule, K. Lyytimen, and R. Schmidt, "A Framework for Identifying Software Project Risk," Comm. ACM, no. 41, vol. 11, pp. 76-83, 1998.
[87] P. Cule, R. Schmidt, K. Lyytinen, and M. Keil, "Strategies for Heading Off IS Project Failure," Information Systems Management, vol. 17, no. 2, pp. 1-9, 2000.
[88] D.X. Houston, G.T. Mackulak, and J.S. Collofello, "Stochastic Simulation of Risk Factor Potential Effects for Software Development Risk Management," J. Systems and Software, vol. 59, no. 33, pp. 247-257, 2001.
[89] A. Mursu, K. Lyytinen, H.A. Soriyan, and M. Korpela, "Identifying Software Project Risks in Nigeria: An International Comparative Study," European J. Information Systems, vol. 12, no. 3, pp. 182-194, 2003.
[90] L. Wallace, M. Keil, and A. Rai, "Understanding Software Project Risk: A Cluster Analysis," Information and Management, vol. 42, no. 1, pp. 115-125, 2004.
[91] X.N. Lu and Q.C. Ma, "Risk Analysis in Software Development Project with Owners and Contractors," Proc. Conf. Eng. Management, pp. 789-793, 2004, doi: 10.1109/IEMC.2004.1407488.
[92] K.P. Batista, K.M. de Olivera, and N. Anquetil, "A Risk Taxonomy Proposal for Software Maintenance," Proc. 21st IEEE Int'l Conf. Software Maintenance, pp. 453-461, 2006, doi:10.1109/ICSM.2005.14.
[93] W.-M. Han and S.-J. Huang, "An Empirical Analysis of Risk Components and Performance on Software Projects," J. Systems and Software, vol. 80, no, 1, pp. 42-50, 2007.
[94] L. Zhou, A. Vasconcelos, and M. Nunes, "Supporting Decision Making in Risk Management through an Evidence-Based Information Systems Project Risk Checklist," Information Management and Computer Security, vol. 6, no. 2, pp. 166-186, 2008.
[95] J.-C. Chen and S.-J. Huang, "An Empirical Analysis of the Impact of Software Development Problem Factors on Software Maintainability," J. Systems and Software, vol. 82, no. 6, pp. 981-992, 2009.
[96] S.S. Yau and J.S. Collofello, "Some Stability Measures for Software Maintenance," IEEE Trans. Software Eng., vol. 6, no. 6, pp. 545-552, Nov. 1980.
[97] S.L. Pfleeger and S.A. Bohner, "A Framework for Software Maintenance Metrics," Proc. Conf. Software Maintenance, pp. 320-327, 1990, doi: 10.1109/ICSM.1990.131381.
[98] E. Stark, "Measurements for Managing Software Maintenance," Proc. Int'l Conf. Software Maintenance, pp. 152-161, 1996, doi:10.1109/ICSM.1996.565000.
[99] L. Wallace, M. Keil, and R. Arun, "How Software Project Risk Affects Project Performance: An Investigation of the Dimensions of Risk and an Exploratory Model," Decision Sciences, vol. 35, no. 2, pp. 289-321, 2004.
[100] H.M. Sneed and P. Brossler, "Critical Success Factors in Software Maintenance: A Case Study," Proc. Int'l Conf. Software Maintenance, pp. 190-198, 2003, doi: 10.1109/ICSM.2003.1235421.
[101] M. Schneider, E. Shnaider, A. Kandel, and G. Chew, "Automatic Construction of FCMs," Fuzzy Sets and Systems, vol. 93, no. 2, pp. 161-172, 1998.
[102] S. Lee and H. Ahn, "Fuzzy Cognitive Map Based on Structural Equation Modeling for the Design of Controls in Business-to-Consumer E-Commerce Web-Based Systems," Expert Systems with Applications, vol. 36, no. 7, pp. 10447-10460, 2009.
[103] C. Cobelli and E. Carson, Introduction to Modeling in Physiology and Medicine. Elsevier, 2008.
[104] J.P.C. Kleijen, "Validation of Models: Statistical Techniques and Data Availability," Proc. Winter Simulation Conf., pp. 647-654 1999, doi: 10.1109/WSC.1999.823147.
[105] Ö. Pala, J.A.M. Vennix, and J.P.C. Kleijnen, "Validation in Soft OR, Hard OR and System Dynamics: A Critical Comparison and Contribution to the Debate," Proc. 17th Int'l Conf. System Dynamic Soc., 1999.
[106] S. Leye, J. Himmelspach, and A.M. Uhrmacher, "A Discussion on Experimental Model Validation," Proc. 11th Int'l Conf. Computer Modelling and Simulation, pp. 161-167, 2009, doi: 10.1109/UKSIM. 2009.20.
[107] M. Landry, J.-L. Malouin, and M. Oral, "Model Validation in Operations Research," European J. Operational Research, vol. 14, no. 3, pp. 207-220, 1983.
[108] M. Oral and O. Kettani, "The Facets of the Modeling and Validation Process in Operations Research," European J. Operational Research, vol. 66, no. 2, pp. 216-234, 1993.
[109] G. Büyüközkan and D. Ruan, "Choquet Integral Based Aggregation Approach to Software Development Risk Assessment," Information Sciences, vol. 180, no. 3, pp. 441-451, 2010.
[110] L. Wallace and M. Keil, "Software Project Risks and Their Effect on Outcomes," Comm. ACM, vol. 47, no. 4, pp. 68-73, 2004.
[111] C.D. Stylios and P.P. Groumpos, "Mathematical Formulation of Fuzzy Cognitive Maps," Proc. Seventh Mediterranean Conf. Control and Automation, pp. 2251-2261, 1999.