The Community for Technology Leaders
2010 19th International Conference on Parallel Architectures and Compilation Techniques (PACT) (2010)
Vienna, Austria
Sept. 11, 2010 to Sept. 15, 2010
ISBN: 978-1-5090-5032-1
pp: 353-364
Gregory Diamos , School of Electrical and Computer Engineering, Georgia Institute of Technology, Atlanta, 30332-0250, USA
Andrew Kerr , School of Electrical and Computer Engineering, Georgia Institute of Technology, Atlanta, 30332-0250, USA
Sudhakar Yalamanchili , School of Electrical and Computer Engineering, Georgia Institute of Technology, Atlanta, 30332-0250, USA
Nathan Clark , College of Computing, Georgia Institute of Technology, Atlanta, 30332-0250, USA
ABSTRACT
Ocelot is a dynamic compilation framework designed to map the explicitly data parallel execution model used by NVIDIA CUDA applications onto diverse multithreaded platforms. Ocelot includes a dynamic binary translator from Parallel Thread eXecution ISA (PTX) to many-core processors that leverages the Low Level Virtual Machine (LLVM) code generator to target x86 and other ISAs. The dynamic compiler is able to execute existing CUDA binaries without recompilation from source and supports switching between execution on an NVIDIA GPU and a many-core CPU at runtime. It has been validated against over 130 applications taken from the CUDA SDK, the UIUC Parboil benchmarks [1], the Virginia Rodinia benchmarks [2], the GPU-VSIPL signal and image processing library [3], the Thrust library [4], and several domain specific applications. This paper presents a high level overview of the implementation of the Ocelot dynamic compiler highlighting design decisions and trade-offs, and showcasing their effect on application performance. Several novel code transformations are explored that are applicable only when compiling explicitly parallel applications and traditional dynamic compiler optimizations are revisited for this new class of applications. This study is expected to inform the design of compilation tools for explicitly parallel programming models (such as OpenCL) as well as future CPU and GPU architectures.
INDEX TERMS
Performance, Design, Experimentation
CITATION
Gregory Diamos, Andrew Kerr, Sudhakar Yalamanchili, Nathan Clark, "Ocelot: A dynamic optimization framework for bulk-synchronous applications in heterogeneous systems", 2010 19th International Conference on Parallel Architectures and Compilation Techniques (PACT), vol. 00, no. , pp. 353-364, 2010, doi:
103 ms
(Ver 3.3 (11022016))