The Community for Technology Leaders
Performance, Computing, and Communications Conference, 2002. 21st IEEE International (2006)
Phoenix, AZ, USA
Apr. 10, 2006 to Apr. 12, 2006
ISBN: 1-4244-0198-4
pp: 46
J. Nunez , Los Alamos Nat. Lab., NM, USA
S. Poole , Los Alamos Nat. Lab., NM, USA
P. Fields , Los Alamos Nat. Lab., NM, USA
R. Martinez , Los Alamos Nat. Lab., NM, USA
R. Wacha , Los Alamos Nat. Lab., NM, USA
P. Martinez , Los Alamos Nat. Lab., NM, USA
G. Grider , Los Alamos Nat. Lab., NM, USA
S. Khalsa , Los Alamos Nat. Lab., NM, USA
H. Chen , Los Alamos Nat. Lab., NM, USA
ABSTRACT
This paper presents the design and implementation of a new I/O networking infrastructure, named PaScal (parallel and scalable I/O networking framework). PaScal is used to support high data bandwidth IP based global storage systems for large scale Linux clusters. PaScal has several unique properties. It employs (1) Multi-level switch-fabric interconnection network by combining high speed interconnects for computing inter-process communication (IPC) requirements and low-cost Gigabit Ethernet interconnect for global IP based storage/file access, (2) A bandwidth on demand scaling I/O networking architecture, (3) open-standard IP networks (routing and switching), (4) multipath routing for load balancing and failover, (5) open shortest path first (OSPF) routing software, and (6) Supporting a global file system in multi-cluster and multi-platform environments. We describe both the hardware and software components of our proposed PaScal. We have implemented the PaScal I/O infrastructure on several large-size Linux clusters at LANL. We have conducted a sequence of parallel MPI-IO assessment benchmarks on LANL's Pink 1024 node Linux cluster and the Panasas global parallel file system. Performance results from our parallel MPI-IO benchmarks on the Pink cluster demonstrate that the PaScal I/O Infrastructure is robust and capable of scaling in bandwidth on large-size Linux clusters.
INDEX TERMS
load balancing, PaScal, parallel and scalable server, IO networking infrastructure, global storage-file system, Linux cluster, IP based global storage system, multilevel switch-fabric interconnection network, inter-process communication, IPC computing, gigabit Ethernet, open-standard IP network, multipath routing
CITATION
J. Nunez, S. Poole, A. Matthews, P. Fields, G. Gibson, R. Martinez, R. Wacha, P. Martinez, G. Grider, S. Khalsa, H. Chen, "PaScal - a new parallel and scalable server IO networking infrastructure for supporting global storage/file systems in large-size Linux clusters", Performance, Computing, and Communications Conference, 2002. 21st IEEE International, vol. 00, no. , pp. 46, 2006, doi:10.1109/.2006.1629424
89 ms
(Ver 3.3 (11022016))