Proceedings of 16th International Conference on Distributed Computing Systems (1996)
May 27, 1996 to May 30, 1996
Chungmin Chen , Dept. of Comput. Sci., Maryland Univ., College Park, MD, USA
K. Salem , Dept. of Comput. Sci., Maryland Univ., College Park, MD, USA
M. Livny , Dept. of Comput. Sci., Maryland Univ., College Park, MD, USA
We present the Distributed Batch Controller (DBC), a system built to support batch processing of large scientific datasets. The DBC implements a federation of autonomous workstation pools, which may be widely distributed. Individual batch jobs are executed using idle workstations in these pools. Input data are staged to the pool before processing begins. We describe the architecture and implementation of the DBC, and present the results of experiments in which it is used to perform image compression.
batch processing (computers); data compression; image coding; scientific information systems; scientific data processing; Internet; DEC; Distributed Batch Controller; batch processing; large scientific datasets; autonomous workstation pools; idle workstations; image compression
K. Salem, C. Chen and M. Livny, "The DEC: processing scientific data over the Internet," Proceedings of 16th International Conference on Distributed Computing Systems(ICDCS), Hong Kong, 1996, pp. 673.