Search For:

Displaying 1-16 out of 16 total
Poster: Bringing Task and Data Parallelism to Analysis of Climate Model Output
Found in: 2012 SC Companion: High Performance Computing, Networking, Storage and Analysis (SCC)
By Robert Jacob,Jayesh Krishna,Xiabing Xu,Sheri Mickelson,Tim Tautges,Mike Wilde,Robert Latham,Ian Foster,Robert Ross,Mark Hereld,Jay Larson,Pavel Bochev,Kara Peterson,Mark Taylor,Karen Schuchardt,Jain Yin,Don Middleton,Mary Haley,David Brown,Wei Huang,Dennis Shea,Richard Brownrigg,Mariana Vertenstein,Kwan-Liu Ma,Jingrong Xie
Issue Date:November 2012
pp. 1495
Climate models are both outputting larger and larger amounts of data and are doing it on more sophisticated numerical grids. The tools climate scientists have used to analyze climate output, an essential component of climate modeling, are single threaded a...
 
An Evolutionary Path to Object Storage Access
Found in: 2012 SC Companion: High Performance Computing, Networking, Storage and Analysis (SCC)
By David Goodell,Seong Jo Kim,Robert Latham,Mahmut Kandemir,Robert Ross
Issue Date:November 2012
pp. 36-41
High-performance computing (HPC) storage sys- tems typically consist of an object storage system that is accessed via the POSIX file interface. However, rapid increases in system scales and storage system complexity have uncovered a number of limitations i...
 
Efficient data restructuring and aggregation for I/O acceleration in PIDX
Found in: 2012 SC - International Conference for High Performance Computing, Networking, Storage and Analysis
By Sidharth Kumar,Venkatram Vishwanath,Philip Carns,Joshua A. Levine,Robert Latham,Giorgio Scorzelli,Hemanth Kolla,Ray Grout,Robert Ross,Michael E. Papka,Jacqueline Chen,Valerio Pascucci
Issue Date:November 2012
pp. 1-11
Hierarchical, multiresolution data representations enable interactive analysis and visualization of large-scale simulations. One promising application of these techniques is to store high performance computing simulation output in a hierarchical Z (HZ) ord...
 
ISOBAR Preconditioner for Effective and High-throughput Lossless Data Compression
Found in: Data Engineering, International Conference on
By Eric R. Schendel,Ye Jin,Neil Shah,Jackie Chen,C.S. Chang,Seung-Hoe Ku,Stephane Ethier,Scott Klasky,Robert Latham,Robert Ross,Nagiza F. Samatova
Issue Date:April 2012
pp. 138-149
Efficient handling of large volumes of data is a necessity for exascale scientific applications and database systems. To address the growing imbalance between the amount of available storage and the amount of data being produced by high speed (FLOPS) proce...
 
S-preconditioner for Multi-fold Data Reduction with Guaranteed User-Controlled Accuracy
Found in: Data Mining, IEEE International Conference on
By Ye Jin,Sriram Lakshminarasimhan,Neil Shah,Zhenhuan Gong,C.S. Chang,Jackie Chen,Stephane Ethier,Hemanth Kolla,Seung-Hoe Ku,Scott Klasky,Robert Latham,Robert Ross,Karen Schuchardt,Nagiza F. Samatova
Issue Date:December 2011
pp. 290-299
The growing gap between the massive amounts of data generated by petascale scientific simulation codes and the capability of system hardware and software to effectively analyze this data necessitates data reduction. Yet, the increasing data complexity chal...
 
ISABELA-QA: query-driven analytics with ISABELA-compressed extreme-scale scientific data
Found in: SC Conference
By Sriram Lakshminarasimhan,John Jenkins,Isha Arkatkar,Zhenhuan Gong,Hemanth Kolla,Seung-Hoe Ku,Stephane Ethier,Jackie Chen,C. S. Chang,Scott Klasky,Robert Latham,Robert Ross,Nagiza F. Samatova
Issue Date:November 2011
pp. 1-11
Efficient analytics of scientific data from extreme-scale simulations is quickly becoming a top-notch priority. The increasing simulation output data sizes demand for a paradigm shift in how analytics is conducted. In this paper, we argue that query-driven...
 
Understanding and improving computational science storage access through continuous characterization
Found in: Mass Storage Systems and Technologies, IEEE / NASA Goddard Conference on
By Philip Carns,Kevin Harms,William Allcock,Charles Bacon,Samuel Lang,Robert Latham,Robert Ross
Issue Date:May 2011
pp. 1-14
Computational science applications are driving a demand for increasingly powerful storage systems. While many techniques are available for capturing the I/O behavior of individual application trial runs and specific components of the storage system, contin...
 
Design and Evaluation of Multiple-Level Data Staging for Blue Gene Systems
Found in: IEEE Transactions on Parallel and Distributed Systems
By Florin Isaila,Javier Garcia Blas,Jesus Carretero,Robert Latham,Robert Ross
Issue Date:June 2011
pp. 946-959
Parallel applications currently suffer from a significant imbalance between computational power and available I/O bandwidth. Additionally, the hierarchical organization of current Petascale systems contributes to an increase of the I/O subsystem latency. I...
 
I/O performance challenges at leadership scale
Found in: SC Conference
By Samuel Lang, Philip Carns, Robert Latham, Robert Ross, Kevin Harms, William Allcock
Issue Date:November 2009
pp. 1-12
Today's top high performance computing systems run applications with hundreds of thousands of processes, contain hundreds of storage nodes, and must meet massive I/O requirements for capacity and performance. These leadership-class systems face daunting ch...
 
Terascale data organization for discovering multivariate climatic trends
Found in: SC Conference
By Wesley Kendall, Markus Glatter, Jian Huang, Tom Peterka, Robert Latham, Robert Ross
Issue Date:November 2009
pp. 1-12
Current visualization tools lack the ability to perform full-range spatial and temporal analysis on terascale scientific datasets. Two key reasons exist for this shortcoming: I/O and postprocessing on these datasets are being performed in suboptimal manner...
 
Latency Hiding File I/O for Blue Gene Systems
Found in: Cluster Computing and the Grid, IEEE International Symposium on
By Florin Isaila, Javier Garcia Blas, Jesus Carretero, Robert Latham, Samuel Lang, Robert Ross
Issue Date:May 2009
pp. 212-219
This paper presents the design and implementation of a novel file I/O solution for Blue Gene systems. We propose a hierarchical I/O cache architecture based on open source software. Our solution is based on an asynchronous data staging strategy, which hide...
 
Parallel I/O Performance for Application-Level Checkpointing on the Blue Gene/P System
Found in: Cluster Computing, IEEE International Conference on
By Jing Fu,Misun Min,Robert Latham,Christopher D. Carothers
Issue Date:September 2011
pp. 465-473
As the number of processors increases to hundreds of thousands in parallel computer architectures, the failure probability rises correspondingly, making fault tolerance a highly important and challenging task. Application-level checkpointing is one of the ...
 
Characterization and modeling of PIDX parallel I/O for performance optimization
Found in: Proceedings of SC13: International Conference for High Performance Computing, Networking, Storage and Analysis (SC '13)
By Giorgio Scorzelli, Hemanth Kolla, Michael E. Papkafa, Philip Carns, Sidharth Kumar, Venkatram Vishwanath, Avishek Saha, Jacqueline Chen, John A. Schmidt, Ray Grout, Robert Latham, Robert Ross, Valerio Pascucci
Issue Date:November 2013
pp. 1-12
Parallel I/O library performance can vary greatly in response to user-tunable parameter values such as aggregator count, file count, and aggregation strategy. Unfortunately, manual selection of these values is time consuming and dependent on characteristic...
     
I/O performance challenges at leadership scale
Found in: Proceedings of the Conference on High Performance Computing Networking, Storage and Analysis (SC '09)
By Kevin Harms, Philip Carns, Robert Latham, Robert Ross, Samuel Lang, William Allcock
Issue Date:November 2009
pp. 1-12
Today's top high performance computing systems run applications with hundreds of thousands of processes, contain hundreds of storage nodes, and must meet massive I/O requirements for capacity and performance. These leadership-class systems face daunting ch...
     
Terascale data organization for discovering multivariate climatic trends
Found in: Proceedings of the Conference on High Performance Computing Networking, Storage and Analysis (SC '09)
By Jian Huang, Markus Glatter, Robert Latham, Robert Ross, Tom Peterka, Wesley Kendall
Issue Date:November 2009
pp. 1-12
Current visualization tools lack the ability to perform full-range spatial and temporal analysis on terascale scientific datasets. Two key reasons exist for this shortcoming: I/O and postprocessing on these datasets are being performed in suboptimal manner...
     
I/O threads to reduce checkpoint blocking for an electromagnetics solver on Blue Gene/P and Cray XK6
Found in: Proceedings of the 2nd International Workshop on Runtime and Operating Systems for Supercomputers (ROSS '12)
By Christopher D. Carothers, Jing Fu, Misun Min, Robert Latham
Issue Date:June 2012
pp. 1-8
Application-level checkpointing has been one of the most popular techniques to proactively deal with unexpected failures in supercomputers with hundreds of thousands of cores. Unfortunately, this approach results in heavy I/O load and often causes I/O bott...
     
 1