This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Strategic Testing Environment with Formal Description Techniques
April 1991 (vol. 40 no. 4)
pp. 514-525

The authors describe the design of a testing environment, called FOREST (formal environment for systematic testing), for communication systems. The proposed method integrates three major strategies: (1) the use of formal description techniques (FDTs), for their formal semantics, which makes them unambiguous; (2) a stepwise approach to generate appropriate test cases for different test stages; and (3) the systematic support of the testing process, from test development to test execution. FOREST consists of four major subsystems. TENT (test sequence generation tool) is a subsystem that generates test cases from the formal specification of the behavior of a given protocol. APRICOT (ASN.1 pre-compiler, coder and test-debugger) is a subsystem that generates test data from the protocol data structures definition. TESPEC (test specification editor) is a tool producing some test specification based on a standardized formalism. The last subsystem, TEXEC (test executor), is a test execution system which consists of an upper tester and a lower tester, and a simulator of the communication medium.

[1] D. Rayner, "OSI conformance testing,"Comput. Networks ISDN Syst., North-Holland, no. 14, pp. 79-98, 1987.
[2] S. Naito and M. Tsunoyama, "Fault detection for sequential machines by transition tour," inProc. IEEE Comput. Conf., 1981, pp. 283-243.
[3] T. S. Chow, "Testing software design modeled by finite state machine,"IEEE Trans. Software Eng., vol. SE-4, no. 3, pp. 178-187, 1978.
[4] G. Gonenc, "A method for the design of fault detection experiment,"IEEE Trans. Comput., vol. C-19, pp. 551-558, 1970.
[5] K. Sabnani and A. Dahbura, "A protocol test generation procedure,"Comput. Networks ISDN Syst., North-Holland, no. 15, pp. 285-297, 1988.
[6] A. V. Aho, A. T. Dahbura, D. Lee, and M. U. Uyar, "An optimization technique for protocol conformance test generation based on UIO sequences and rural Chinese postman tours," inProtocol Specification, Testing and Verification VIII. Amsterdam, The Netherlands, North-Holland, 1988, pp. 75-86.
[7] J. P. Favreau and R. J. Linn, "Automatic generation of test scenario skeleton from protocol specifications written in Estelle," inProtocol Specification, Testing and Verification VI. Amsterdam, The Netherlands, North-Holland, 1986, pp. 191-202.
[8] B. Forghani and B. Sarikaya, "Automatic dynamic behavior generation in TTCN format from Estelle specifications," inProc. 2nd Int. Workshop Protocol Test Syst., 1989, pp. 73-90.
[9] T. T. Boyce and R. Probert, "Phase-directed testing of Estelle specifications," inProc. 2nd Int. Workshop Protocol Test Syst., 1989, pp. 171-182.
[10] R. Ahooja, J. Burmeister, J. D. Meer, and A. Rennoch, "A method for open systems testing and implementation of test sequence in a conformance testing tool," inProc. 2nd Int. Workshop Protocol Test Syst., 1989, pp. 183-202.
[11] J. P. Favreau, R. J. Linn, and S. Noghtingale, "A formal multi-layer test methodology and its application to OSI," inProc. 2nd Int. Conf. Formal Description Techniques for Distributed Syst. Commun. Protocols (FORTE'89), 1989.
[12] A. Iwabuchi, R. J. Linn, and J. P. Favreau, "Application of formal specification techniques to the specification of the MHS system," inProc Second Int. Symp. Interoperable Inform. Syst., 1988, pp. 255-262.
[13] CCITT, "Functional Specification and Description Language," Recommendation Z.100, 1988.
[14] ISO, "Information Processing Systems--Open Systems Interconnection--LOTOS--A Formal Description Technique Based on the Temporal Ordering of Observational Behavior," ISO 8807 1988.
[15] ISO, "Information Processing Systems--Open Systems Interconnection--Estelle--A Formal Description Technique Based on an Extended State Transition Model," ISO 9074, 1988.
[16] ISO, "Information Processing Systems--Open Systems Interconnection-Specification of Abstract Syntax Notation One (ASN. 1)," ISO 8824, 1988.
[17] ISO, "Information Processing Systems--Open Systems Interconnection--Specification of Encoding Rules for Abstract Syntax Notation One (ASN. 1)," ISO 8825, 1988.
[18] ISO, "Information Processing Systems--OSI Conformance Testing Methodology and Framework," ISO/DIS 9646, 1989.
[19] ISO, "Management plan for Q. 58--Formal methods in conformance testing," ISO/IEC JTC1/SC21 N3242, 1988.
[20] G. v. Bochmann, "Usage of protocol development tools: The result of a survey," inProtocol Specification, Testing and Verification VII. Amsterdam, The Netherlands: North-Holland, 1987, pp. 147-170.
[21] F. Sato, K. Katsuyama, and T. Mizuno, "TENT: Test Sequence Generation Tool for communication systems," inProc. 2nd Int Conf. Formal Description Techniques for Distributed Syst. Commun. Protocols (FORTE'89), 1989.
[22] T. Nakakawaji, K. Katsuyama, N. Miyauchi, and T. Mizuno, "Development and evaluation of APRICOT (Tools for Abstract Syntax Notation One)," inProc. Second Int. Symp. Interoperable Inform. Syst., 1988, pp. 55-62.
[23] ISO, "Information Processing Systems--Commitment, Concurrency and Recovery," DIS 9804-9805/2, 1987.
[24] Y. Tohma, K. Tokunaga, S. Nagase, and Y. Murata, "Structural approach to the estimation of the number of residual software faults based on the hyper-geometric distribution,"IEEE Trans. Software Eng., vol. 15, no. 3, pp. 345-355, 1989.
[25] G. v. Bochmann and C. S. He, "Ferry approaches to protocol testing and service interface," inProc. Second Int. Symp. Interoperable Inform. Syst., 1988, pp. 303-309.

Index Terms:
formal description techniques; design; FOREST; formal environment for systematic testing; communication systems; formal semantics; stepwise approach; test development; test execution; TENT; test sequence generation tool; protocol; APRICOT; ASN.1 pre-compiler; coder; test-debugger; data structures; test specification editor; upper tester; lower tester; simulator; formal specification; programming environments; protocols.
Citation:
K. Katsuyama, S. Sato, T. Nakakawaji, T. Mizuno, "Strategic Testing Environment with Formal Description Techniques," IEEE Transactions on Computers, vol. 40, no. 4, pp. 514-525, April 1991, doi:10.1109/12.88470
Usage of this product signifies your acceptance of the Terms of Use.