International Parallel and Distributed Processing Symposium (IPDPS'03)
Using Incorrect Speculation to Prefetch Data in a Concurrent Multithreaded Processor
Nice, France
April 22-April 26
ISBN: 0-7695-1926-1
Concurrent multithreaded architectures exploit both instruction-level and thread-level parallelism through a combination of branch prediction and thread-level control speculation. The resulting speculative issuing of load instructions in these architectures can significantly impact the performance of the memory hierarchy as the system exploits higher degrees of parallelism. In this study, we investigate the effects of executing the mispredicted load instructions on the cache performance of a scalable multithreaded architecture. We show that the execution of loads from the wrongly-predicted branch path within a thread, or from a wrongly-forked thread, can result in an indirect prefetching effect for later correctly-executed paths. By continuing to execute the mispredicted load instructions even after the instruction- or thread-level control speculation is known to be incorrect, the cache misses for the correctly predicted paths and threads can be reduced, typically by 42-73%. We introduce the small, fully-associative Wrong Execution Cache (WEC) to eliminate the potential pollution that can be caused by the execution of the mispredicted load instructions. Our simulation results show that the WEC can improve the performance of a concurrent multithreaded architecture up to 18.5% on the benchmark programs tested, with an average improvement of 9.7%, due to the reductions in the number of cache misses.
Index Terms:
multithreaded processor, superthreaded architecture, data prefetch, wrong-thread executioin, wrong-path execution, wrong execution cache (WEC)
Citation:
Ying Chen, Resit Sendag, David J. Lilja, "Using Incorrect Speculation to Prefetch Data in a Concurrent Multithreaded Processor," ipdps, pp.76b, International Parallel and Distributed Processing Symposium (IPDPS'03), 2003