2004 IEEE International Conference on Computer Design (ICCD'04) Fetch Halting on Critical Load Misses San Jose, CA October 11-October 13 ISBN: 0-7695-2231-9
As the performance gap between processors and memory systems increases, the CPU spends more time stalled waiting for data from main memory. Critical long latency instructions, such as loads that miss to main memory and floating point arithmetic operations, are primarily responsible for these stalls. We present a technique, Fetch Halting, that suspends instruction fetching when the processor is stalled by a critical long latency instruction. This enables us to save power in one of the primary sources of power dissipation, the issue logic. By reducing the occupancy rates in the issue queue and reorder buffer, we save power by disabling a large number of unused queue entries.In order to characterize critical instructions, our approach combines software profiling and hardware monitoring techniques. Statistical profiling information obtained from sample runs is used to identify critical instructions while hardware cache-miss prediction is used to monitor these instructions. We show that, on average, Fetch Halting can reduce issue queue and reorder buffer occupancy rates by 17.2% and 23.4% respectively, with an average performance loss of only 4.6%.
Citation:
Nikil Mehta, Brian Singer, R. Iris Bahar, Michael Leuchtenburg, Richard Weiss, "Fetch Halting on Critical Load Misses," iccd, pp.244-249, 2004 IEEE International Conference on Computer Design (ICCD'04), 2004 Usage of this product signifies your acceptance of the Terms of Use. | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||