Issue No. 12 - December (1998 vol. 9)
DOI Bookmark: http://doi.ieeecomputersociety.org/10.1109/71.737699
<p><b>Abstract</b>—We have developed a distributed parallel storage system that employs the aggregate bandwidth of multiple data servers connected by a high-speed wide-area network to achieve scalability and high data throughput. This paper studies different schemes to enhance the reliability and availability of such network-based distributed storage systems. The general approach of this paper employs "erasure" error-correcting codes that can be used to reconstruct missing information caused by hardware, software, or human faults. The paper describes the approach and develops optimized algorithms for the encoding and decoding operations. Moreover, the paper presents techniques for reducing the communication and computation overhead incurred while reconstructing missing data from the redundant information. These techniques include clustering, multidimensional coding, and the full two-dimensional parity schemes. The paper considers trade-offs between redundancy, fault tolerance, and complexity of error recovery.</p>
Storage systems, availability, scalability, RAID, high performance, distributed systems, error-correcting codes.
Qutaibah M. Malluhi, William E. Johnston, "Coding for High Availability of a Distributed-Parallel Storage System", IEEE Transactions on Parallel & Distributed Systems, vol. 9, no. , pp. 1237-1252, December 1998, doi:10.1109/71.737699