|
| This Article | ||
| ||
| Share | ||
| Bibliographic References | ||
| Add to: | ||
| | ||
| Search | ||
| ||
2011 IEEE International Parallel & Distributed Processing Symposium
Exploiting Data Similarity to Reduce Memory Footprints
Anchorage, Alaska USA
May 16-May 20
ISBN: 978-0-7695-4385-7
| ASCII Text | x | ||
| Susmit Biswas, Bronis R. de Supinski, Martin Schulz, Diana Franklin, Timothy Sherwood, Frederic T. Chong, "Exploiting Data Similarity to Reduce Memory Footprints," Parallel and Distributed Processing Symposium, International, pp. 152-163, 2011 IEEE International Parallel & Distributed Processing Symposium, 2011. | |||
| BibTex | x | ||
| @article{ 10.1109/IPDPS.2011.24, author = {Susmit Biswas and Bronis R. de Supinski and Martin Schulz and Diana Franklin and Timothy Sherwood and Frederic T. Chong}, title = {Exploiting Data Similarity to Reduce Memory Footprints}, journal ={Parallel and Distributed Processing Symposium, International}, volume = {0}, year = {2011}, issn = {1530-2075}, pages = {152-163}, doi = {http://doi.ieeecomputersociety.org/10.1109/IPDPS.2011.24}, publisher = {IEEE Computer Society}, address = {Los Alamitos, CA, USA}, } | |||
| RefWorks Procite/RefMan/Endnote | x | ||
| TY - CONF JO - Parallel and Distributed Processing Symposium, International TI - Exploiting Data Similarity to Reduce Memory Footprints SN - 1530-2075 SP152 EP163 A1 - Susmit Biswas, A1 - Bronis R. de Supinski, A1 - Martin Schulz, A1 - Diana Franklin, A1 - Timothy Sherwood, A1 - Frederic T. Chong, PY - 2011 VL - 0 JA - Parallel and Distributed Processing Symposium, International ER - | |||
DOI Bookmark: http://doi.ieeecomputersociety.org/10.1109/IPDPS.2011.24
Memory size has long limited large-scale applications on high-performance computing (HPC) systems. Since compute nodes frequently do not have swap space, physical memory often limits problem sizes. Increasing core counts per chip and power density constraints, which limit the number of DIMMs per node, have exacerbated this problem. Further, DRAM constitutes a significant portion of overall HPC system cost. Therefore, instead of adding more DRAM to the nodes, mechanisms to manage memory usage more efficiently -- preferably transparently -- could increase effective DRAM capacity and thus the benefit of multicore nodes for HPC systems. MPI application processes often exhibit significant data similarity. These data regions occupy multiple physical locations across the individual rank processes within a multicore node and thus offer a potential savings in memory capacity. These regions, primarily residing in heap, are dynamic, which makes them difficult to manage statically. Our novel memory allocation library, {\it SBLLmallocShort}, automatically identifies identical memory blocks and merges them into a single copy. Our implementation is transparent to the application and does not require any kernel modifications. Overall, we demonstrate that {\it SBLLmalloc} reduces the memory footprint of a range of MPI applications by $32.03\%$ on average and up to $60.87\%$. Further, {\it SBLLmalloc} supports problem sizes for IRS over $21.36\%$ larger than using standard memory management techniques, thus significantly increasing effective system size. Similarly, {\it SBLLmalloc} requires $43.75\%$ fewer nodes than standard memory management techniques to solve an AMG problem.
Citation:
Susmit Biswas, Bronis R. de Supinski, Martin Schulz, Diana Franklin, Timothy Sherwood, Frederic T. Chong, "Exploiting Data Similarity to Reduce Memory Footprints," ipdps, pp.152-163, 2011 IEEE International Parallel & Distributed Processing Symposium, 2011
Usage of this product signifies your acceptance of the Terms of Use.
