This Article 
 Bibliographic References 
 Add to: 
A Hierarchical Adaptive Distributed System-Level Diagnosis Algorithm
January 1998 (vol. 47 no. 1)
pp. 34-45

Abstract—Consider a system composed of N nodes that can be faulty or fault-free. The purpose of distributed system-level diagnosis is to have each fault-free node determine the state of all nodes of the system. This paper presents a Hierarchical Adaptive Distributed System-level Diagnosis (Hi-ADSD) algorithm, which is a fully distributed algorithm that allows every fault-free node to achieve diagnosis in, at most, (log2N)2 testing rounds. Nodes are mapped into progressively larger logical clusters, so that tests are run in a hierarchical fashion. Each node executes its tests independently of the other nodes, i.e., tests are run asynchronously. All the information that nodes exchange is diagnostic information. The algorithm assumes no link faults, a fully-connected network and imposes no bounds on the number of faults. Both the worst-case diagnosis latency and correctness of the algorithm are formally proved. As an example application, the algorithm was implemented on a 37-node Ethernet LAN, integrated to a network management system based on SNMP (Simple Network Management Protocol). Experimental results of fault and repair diagnosis are presented. This implementation by itself is also a significant contribution, for, although fault management is a key functional area of network management systems, currently deployed applications often implement only rudimentary diagnosis mechanisms. Furthermore, experimental results are given through simulation of the algorithm for large systems of 64 nodes and 512 nodes.

[1] M. Rose and K. McCloghrie, "Structure and Identification of Management Information for TCP/IP-Based Internets," RFC 1155, 1990.
[2] J.D. Case, M.S. Fedor, M.L. Schoffstall, and J.R. Davin, "A Simple Network Management Protocol," RFC 1157, 1990.
[3] K. McCloghtie and M.T. Rose, "Management Information Base for Network Management of TCP/IP-Based Internets," RFC 1213, 1991.
[4] L. Steinberg, "Techniques for Managing Asynchronously Generated Alerts," RFC 1224, 1991.
[5] R. Bianchini Jr. and R. Buskens, "An Adaptive Distributed System-Level Diagnosis Algorithm and Its Implementation," Proc. 21st Int'l Symp. Fault-Tolerant Computing (FTCS-21), pp. 222-229, 1991.
[6] R. Bianchini and R. Buskens, “Implementation of On-Line Distributed System-Level Diagnosis Theory,” IEEE Trans. Computers, vol. 41, no. 5, pp. 616-626, May 1992.
[7] P. Jalote, Fault Tolerance in Distributed Systems. Prentice Hall, 1994.
[8] F. Preparata, G. Metze, and R.T. Chien, "On The Connection Assignment Problem of Diagnosable Systems," IEEE Trans. Electronic Computers, vol. 16, pp. 848-854, 1968.
[9] S.L. Hakimi and A.T. Amin, "Characterization of Connection Assignments of Diagnosable Systems," IEEE Trans. Computers, vol. 23, pp. 86-88, 1974.
[10] S.L. Hakimi and K. Nakajima, "On Adaptive System Diagnosis" IEEE Trans. Computers, vol. 33, pp. 234-240, 1984.
[11] J.G. Kuhl and S.M. Reddy, "Distributed Fault Tolerance for Large Multiprocessor Systems," Proc. 1980 Computer ArchitectureSymp., pp. 222-229, May 1980.
[12] J.G. Kuhl and S.M. Reddy, "Fault-Diagnosis in Fully Distributed Systems," Proc. FTCS-11, pp. 100-105, 1981.
[13] S.H. Hosseini, J.G. Kuhl, and S.M. Reddy, "A Diagnosis Algorithm for Distributed Computing Systems with Failure and Repair," IEEE Trans. Computers, vol. 33, pp. 223-233, 1984.
[14] R. Bianchini, K. Goodwin, and D. Nydick, “Practical Application and Implementation of Distributed System-Level Diagnosis Theory,” Digest 20th Int'l Symp. Fault-Tolerant Computing, pp.332-339, 1990.
[15] C.-L. Yang and G.M. Masson, "Hybrid Fault-Diagnosability with Unreliable Communication Links," Proc. FTCS-16, pp. 226-231, 1986.
[16] S. Rangarajan, A.T. Dahbura, and E.A. Ziegler, "A Distributed System-Level Diagnosis Algorithm for Arbitrary Network Topologies," IEEE Trans. Computers, vol. 44, pp. 312-333, 1995.
[17] M. Stahl, R. Buskens, and R. Bianchini, "Simulation of the Adapt On-Line Diagnosis Algorithm for General Topology Networks," Proc. IEEE 11th Symp. Reliable Distributed Systems, Oct. 1992.
[18] A. Bagchi and S.L. Hakimi, "An Optimal Algorithm for Distributed System Level Diagnosis," Proc. IEEE CS 21st Int'l Symp. Fault-Tolerant Computing, pp. 214-221, 1991.
[19] G. Masson, D. Blough, and G. Sullivan, "System Diagnosis," Fault-Tolerant Computer System Design, D.K. Pradhan, ed. Prentice Hall, 1996.
[20] E.P. Duarte Jr. and T. Nanya, "Multi-Cluster Adaptive Distributed System-Level Diagnosis Algorithms," IEICE Technical Report FTS 95-73, 1995.
[21] M. MacDougall, Simulating Computer Systems: Techniques and Tools,Cambridge, Mass.: MIT Press, 1987.
[22] M. Malek and J. Maeng, "Partitioning of Large Multicomputer Systems for Efficient Fault Diagnosis," Proc. FTCS-12, pp. 341-348, 1982.
[23] A. Bagchi, "A Distributed Algorithm for System-Level Diagnosis in Hypercubes," Proc. 1992 IEEE Workshop Fault-Tolerant Parallel and Distributed Systems, pp. 106-113, 1992
[24] M. Barborak and M. Malek, "Partitioning for Efficient Consensus," Proc. 26th Hawaii Int'l Conf. System Sciences, vol. II, pp. 438-446, 1993.
[25] J. Altman, F. Balbach, and A. Hein, "An Approach for Hierarchical System-Level Diagnosis of Massively Parallel Computers Combined with a Simulation-Based Method for Dependability Analysis," Proc. First European Dependable Computing Conf., Lecture Notes in Computer Science, vol. 852, pp. 371-385, 1994.
[26] M.T. Rose, The Simple Book—An Introduction to Internet Management, second ed. Englewood Cliffs, N.J.: Prentice Hall, 1994.
[27] J. Swoboda et al. distWILMA/.
[28] W. Stallings, SNMP, SNMPv2, and RMON: Practical Network Management, second ed. Reading, Mass.: Addison Wesley, 1996.

Index Terms:
System-level diagnosis, adaptive diagnosis, distributed diagnosis, network management, fault management, SNMP.
Elias Procópio Duarte Jr., Takashi Nanya, "A Hierarchical Adaptive Distributed System-Level Diagnosis Algorithm," IEEE Transactions on Computers, vol. 47, no. 1, pp. 34-45, Jan. 1998, doi:10.1109/12.656078
Usage of this product signifies your acceptance of the Terms of Use.