loading...
 This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
2007 International Conference on Parallel Processing (ICPP 2007)
Methods of Memory Optimizations in Streaming Applications
Xi'an, China
September 10-September 14
ISBN: 0-7695-2933-X
Nissim Harel, Georgia Institute of Technology, USA
Hasnain A. Mandviwala, Georgia Institute of Technology, USA
Kath Knobe, Intel Corporation
Umakishore Ramachandran, Georgia Institute of Technology, USA
Streaming applications are often distributed, manage large quantities of data and, as a result, have large memory requirements. Therefore, efficient garbage collection (GC) is crucial for their performance. On the other hand, not all data items affect the application output due to differences in the processing rates of various application threads. In this paper we propose extending the definition of the garbage identification problem for streaming applications and include not only data items that are not "reachable" but also data items that have no effect on the final outcome of the application. We present four optimizations to an existing GC algorithm in Stampede, a parallel programming system to support interactive multimedia applications. We ask the question how far off these algorithms are from an ideal garbage collector, one in which the memory usage exactly equals the amount required for buffering only the relevant data items. This oracle, while unimplementable, serves as an empirical lower-bound for memory usage. We then propose optimizations that will help us get closer to this lowerbound. Using an elaborate measurement and post-mortem analysis infrastructure, we simulate the performance potential for these optimizations and implement the most promising ones. A color-based people tracking application is used for the performance evaluation. Our results show that these optimizations reduce the memory usage by up to 60%.
Citation:
Nissim Harel, Hasnain A. Mandviwala, Kath Knobe, Umakishore Ramachandran, "Methods of Memory Optimizations in Streaming Applications," icpp, pp.11, 2007 International Conference on Parallel Processing (ICPP 2007), 2007
Usage of this product signifies your acceptance of the Terms of Use.