The Community for Technology Leaders
RSS Icon
Issue No.06 - Nov.-Dec. (2012 vol.32)
pp: 17-27
Javier Verdú , Technical University of Catalonia
Alex Pajuelo , Technical University of Catalonia
Mateo Valero , Technical University of Catalonia
Complex, computationally demanding 3D visualization applications can be used as benchmarks to evaluate CPU-GPU systems. However, because those applications are time dependent, their execution is not deterministic. Thus, measurements can vary from one execution to another. This article proposes a methodology that enforces the starting times of frames so that applications behave deterministically.
Benchmark testing, Graphics processing unit, Instruments, Time measurement, Instruction sets, Measurement uncertainty, Real-time systems, Three dimensional displays, 3D visualization applications, real-time emulation, simulation methodology, CPU-GPU systems
Javier Verdú, Alex Pajuelo, Mateo Valero, "The Problem of Evaluating CPU-GPU Systems with 3D Visualization Applications", IEEE Micro, vol.32, no. 6, pp. 17-27, Nov.-Dec. 2012, doi:10.1109/MM.2012.13
1. N. Renqvist and M. Kallinen, "3DMark06 Whitepaper v1.0.2," white paper, Futuremark, Jan. 2006.
2. R.F. Berry, P.E. McKenney, and F.N. Parr, "Responsive Systems: An Introduction," IBM Systems J., Apr. 2008, pp. 197-206.
3. T. Sherwood, E. Perelman, and B. Calder, "Basic Block Distribution Analysis to Find Periodic Behavior and Simulation Points in Applications," Proc. 10th Int'l Conf. Parallel Architectures and Compilation Techniques (PACT 01), IEEE CS, 2001, pp. 3-14.
4. F.J. Cazorla et al., "Dynamically Controlled Resource Allocation in SMT Processors," Proc. 37th Ann. IEEE/ACM Int'l Symp. Microarchitecture, IEEE CS, 2004, pp. 171-182.
5. M. Van Biesbrouck, T. Sherwood, and B. Calder, "A Co-phase Matrix to Guide Simultaneous Multithreading Simulation," Proc. IEEE Int'l Symp. Performance Analysis of Systems and Software (ISPASS 04), IEEE CS, 2004, pp. 45-56.
6. F.J. Cazorla et al., "On the Problem of Evaluating the Performance of Multiprogrammed Workloads," IEEE Trans. Computers, Dec. 2010, pp. 1722-1728.
7. K. Luo et al., "Boosting SMT Performance by Speculation Control," Proc. 15th Int'l Parallel & Distributed Processing Symp. (IPDPS 01), IEEE CS, 2001, pp. 7-15.
8. J. Gregory, Game Engine Architecture, A.K. Peters, 2009.
9. A. Lake and H. Gabb, "Threading 3D Game Engine Basics," Gamasutra,17 Nov. 2005; threading%203d%20game%20engine% 20basics.php .
10. F.D. Luna, Introduction to 3D Programming with DirectX 9.0, Jones & Bartlett, 2003.
11. I. Ivanov, "API Hooking Revealed," Code Project,2 Dec. 2002; .
12. C.K. Luk et al., "Pin: Building Customized Program Analysis Tools with Dynamic Instrumentation," Proc. ACM SIGPLAN Conf. Programming Language Design and Implementation (PLDI 05), ACM, 2005, pp. 190-200.
28 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool