DOI Bookmark: http://doi.ieeecomputersociety.org/10.1109/L-CA.2013.19
Youngsok Kim , POSTECH, POHANG
Jaewon Lee , POSTECH, POHANG
Donggyu Kim , POSTECH, POHANG
Jangwoo Kim , POSTECH, Pohang
Programmer-managed GPU memory is a major challenge in writing GPU applications. Programmers must rewrite and optimize an existing code for a different GPU memory size for both portability and performance. Alternatively, they can achieve only portability by disabling GPU memory at the cost of significant performance degradation. In this paper, we propose ScaleGPU, a novel GPU architecture to enable high-performance memory-unaware GPU programming. ScaleGPU uses GPU memory as a cache of CPU memory to provide programmers a view of CPU memory-sized programming space. ScaleGPU also achieves high performance by minimizing the amount of CPU-GPU data transfers and by utilizing the GPU memory&#8217;s high bandwidth. Our experiments show that ScaleGPU can run a GPU application on any GPU memory size and also improves performance significantly. For example, ScaleGPU improves the performance of the hotspot application by ~48% using the same size of GPU memory and reduces its memory size requirement by ~75% maintaining the target performance.
Graphics processing units, Memory management, Data transfer, Programming, Random access memory, Instruction sets, C.1.5.e Memory hierarchy, I.3.1.a Graphics processors, C.1.2.j SIMD processors, C.1.4.e Multi-core/single-chip multiprocessors
Youngsok Kim, Jaewon Lee, Donggyu Kim, Jangwoo Kim, "ScaleGPU: GPU Architecture for Memory-Unaware GPU Programming", IEEE Computer Architecture Letters, vol. , no. , pp. 0, 5555, doi:10.1109/L-CA.2013.19