L.K. John, Dept. of Comput. Sci. & Eng., Univ. of South Florida, Tampa, FL, USA
V. Reddy, Dept. of Comput. Sci. & Eng., Univ. of South Florida, Tampa, FL, USA
P.T. Hulina, Dept. of Comput. Sci. & Eng., Univ. of South Florida, Tampa, FL, USA
L.D. Coraor, Dept. of Comput. Sci. & Eng., Univ. of South Florida, Tampa, FL, USA
Software oriented techniques to hide memory latency in superscalar and superpipelined machines include loop unrolling, software pipelining, and software cache prefetching. Issuing the data fetch request prior to actual need for data allows overlap of accessing with useful computations. Loop unrolling and software pipelining do not necessitate microarchitecture or instruction set architecture changes, whereas software controlled prefetching does. While studies on the benefits of the individual techniques have been done, no study evaluates all of these techniques within a consistent framework. This paper attempts to remedy this by providing a comparative evaluation of the features and benefits of the techniques. Loop, unrolling and static scheduling of loads is seen to produce significant improvement in performance at lower latencies. Software pipelining is observed to be better than software controlled prefetching at lower latencies, but at higher latencies, software prefetching outperforms software pipelining. Aggressive prefetching beyond conditional branches can detrimentally affect performance by increasing the memory bandwidth requirements and bus traffic.
Index Terms:
software performance evaluation; pipeline processing; parallel machines; cache storage; processor scheduling; program compilers; comparative software evaluation; memory latency; software oriented techniques; superscalar machines; superpipelined machines; loop unrolling; software pipelining; software cache prefetching; data fetch request; microarchitecture; instruction set architecture; software controlled prefetching; static scheduling; aggressive prefetching; conditional branches; performance; memory bandwidth requirements; bus traffic
Citation:
L.K. John, V. Reddy, P.T. Hulina, L.D. Coraor, "A comparative evaluation of software techniques to hide memory latency," hicss, pp.229, 28th Hawaii International Conference on System Sciences (HICSS'95), 1995