This Article 
 Bibliographic References 
 Add to: 
FSM-Based Incremental Conformance Testing Methods
July 2004 (vol. 30 no. 7)
pp. 425-436

Abstract—The development of appropriate test cases is an important issue for conformance testing of protocol implementations and other reactive software systems. A number of methods are known for the development of a test suite based on a specification given in the form of a finite state machine. In practice, the system requirements evolve throughout the lifetime of the system and the specifications are modified incrementally. In this paper, we adapt four well-known test derivation methods, namely, the HIS, W, Wp, and UIOv methods, for generating tests that would test only the modified parts of an evolving specification. Some application examples and experimental results are provided. These results show significant gains when using incremental testing in comparison with complete testing, especially when the modified part represents less than 20 percent of the whole specification.

[1] G.v. Bochmann and A. Petrenko, Protocol Testing: Review of Methods and Relevance for Software Testing Proc. Int'l Symp. Software Testing and Analysis, pp. 109-123, 1994.
[2] T.S. Chow, Test Design Modeled by Finite-State Machines IEEE Trans. Software Eng., vol. 4, no. 3, pp. 178-187, 1978.
[3] K. El-Fakih, N. Yevtushenko, and G.v. Bochmann, FSM Based Re-Testing Methods Proc. IFIP TC6 14th Int'l Conf. Testing of Comm. Systems (TestCom), pp. 373-389, 2002.
[4] S. Fujiwara, V.G. Bochmann, F. Khendek, M. Amalou, and A. Ghedamsi, “Test Selection Based on Finite State Machine Model,” IEEE Trans. Software Eng., vol. 17, no. 6, pp. 591-603, June 1991.
[5] A. Gill, Introduction to the Theory of Finite-State Machines. McGraw-Hill, 1962.
[6] I. Koufareva, A. Petrenko, and N. Yevtushenko, Test Generation Driven by User-Defined Fault Models Proc. 11th IFIF TestCom Conf., pp. 215-233, 1999.
[7] A. Petrenko, Checking Experiments with Protocol Machines Proc. Fourth Int'l Workshop Protocol Test Systems (IWPTS), pp. 83-94, 1991.
[8] A. Petrenko and N. Yevtushenko, Test Suite Generation for a FSM with a Given Type of Implementation Errors Proc. 12th Int'l Workshop Protocol Specification, Testing and Verification, pp. 229-243, 1992.
[9] A. Petrenko, N. Yevtushenko, A. Lebedev, and A. Das, NonDeterministic State Machines in Protocol Conformance Testing Proc. IFIP Sixth IWPTS Conf., pp. 363-378, 1993.
[10] K. Sabnani and A. Dahbura, A Protocol Test Generation Procedure Computer Networks and ISDN Systems, vol. 15, no. 4, pp. 285-297, 1988.
[11] D.P. Sidhu and T.K. Leung, Formal Methods for Protocol Testing: A Detailed Study IEEE Trans. Software Eng., vol. 15, no. 4, pp. 413-426, Apr. 1991.
[12] M.P. Vasilevskii, Failure Diagnosis of Automata Kibernetika, no. 4, pp. 98-108, 1973.
[13] S.T. Vuong, W.W.L. Chan, and M.R. Ito, The UIOv-Method for Protocol Test Sequence Generation Proc. Second Int'l Workshop Protocol Test Systems, pp. 161-175, 1989.
[14] M. Yannakakis and D. Lee, Testing Finite State Machines: Fault Detection J. Computer and System Sciences, vol. 50, pp. 209-227, 1995.
[15] N. Yevtushenko and A. Petrenko, Test Derivation Method for an Arbitrary Deterministic Automaton, Automatic Control and Computer Sciences. Allerton Press Inc., 1990.
[16] S.T. Chanson, A.A.F. Loureiro, and S.T. Vuong, On Tools Supporting the Use of Formal Description Techniques in Protocol Development Computer Networks and ISDN Systems, vol. 25, 1993.
[17] D. Lee and M. Yannakakis, Principles and Methods of Testing Finite State Machines, a Survey Proc. IEEE, vol. 84, no. 8, pp. 1090-1123, Aug. 1996.
[18] R. Lai, A Survey of Communication Protocol Testing The J. Systems and Software, vol. 62, pp. 21-46, 2002.
[19] F.C. Hennie, Fault Detecting Experiments for Sequential Circuits Proc. Fifth Ann. Symp. Switching Circuit Theory and Logical Design, pp. 95-110, 1964.
[20] H. Ural, Formal Methods for Test Sequence Generation Computer Comm., vol. 15, no. 5, pp. 311-325, 1992.
[21] S. Naito and M. Tsunoyama, Fault Detection for Sequential Machines by Transition Tours Proc. IEEE Fault Tolerant Conf., 1981.
[22] G. Gonenc, A Method for the Design of Fault Detection Experiments IEEE Trans. Computers, vol. 19, no. 6, pp. 551-558, June 1969.
[23] H. Ural, X. Wu, and F. Zhang, “On Minimizing the Lengths of Checking Sequences,” IEEE Trans. Computers, vol. 46, pp. 93-99, 1997.

Index Terms:
Protocol conformance testing, finite state machines, test derivation, incremental testing.
Khaled El-Fakih, Nina Yevtushenko, Gregor v. Bochmann, "FSM-Based Incremental Conformance Testing Methods," IEEE Transactions on Software Engineering, vol. 30, no. 7, pp. 425-436, July 2004, doi:10.1109/TSE.2004.31
Usage of this product signifies your acceptance of the Terms of Use.