Search For:

Displaying 1-18 out of 18 total
DataMods: Programmable File System Services
Found in: 2012 SC Companion: High Performance Computing, Networking, Storage and Analysis (SCC)
By Noah Watkins,Carlos Maltzahn,Scott Brandt,Adam Manzanares
Issue Date:November 2012
pp. 42-47
As applications become more complex, and the level of concurrency in systems continue to rise, developers are struggling to scale complex data models on top of a traditional byte stream interface. Middleware tailored for specific data models is a common ap...
The Power and Challenges of Transformative I/O
Found in: 2012 IEEE International Conference on Cluster Computing (CLUSTER)
By Adam Manzanares,John Bent,Meghan Wingate,Garth Gibson
Issue Date:September 2012
pp. 144-154
Extracting high data bandwidth and metadata rates from parallel file systems is notoriously difficult. User workloads almost never achieve the performance of synthetic benchmarks. The reason for this is that real-world applications are not as well-aligned,...
EAD and PEBD: Two Energy-Aware Duplication Scheduling Algorithms for Parallel Tasks on Homogeneous Clusters
Found in: IEEE Transactions on Computers
By Ziliang Zong, Adam Manzanares, Xiaojun Ruan, Xiao Qin
Issue Date:March 2011
pp. 360-374
High-performance clusters have been widely deployed to solve challenging and rigorous scientific and engineering tasks. On one hand, high performance is certainly an important consideration in designing clusters to run parallel applications. On the other h...
Energy Efficient Prefetching with Buffer Disks for Cluster File Systems
Found in: Parallel Processing, International Conference on
By Adam Manzanares, Xiaojun Ruan, Shu Yin, Jiong Xie, Zhiyang Ding, Yun Tian, James Majors, Xiao Qin
Issue Date:September 2010
pp. 404-413
Energy efficient computing is becoming increasingly important as the scale of parallel computing systems is expanding. As the processing power of parallel computing systems has been incremented there has been an increased demand for large scale storage sys...
Improving MapReduce performance through data placement in heterogeneous Hadoop clusters
Found in: Parallel and Distributed Processing Workshops and PhD Forum, 2011 IEEE International Symposium on
By Jiong Xie, Shu Yin, Xiaojun Ruan, Zhiyang Ding, Yun Tian,James Majors,Adam Manzanares, Xiao Qin
Issue Date:April 2010
pp. 1-9
MapReduce has become an important distributed processing model for large-scale data-intensive applications like data mining and web indexing. Hadoop-an open-source implementation of MapReduce is widely used for short jobs requiring low response time. The c...
HYBUD: An Energy-Efficient Architecture for Hybrid Parallel Disk Systems
Found in: Computer Communications and Networks, International Conference on
By Mais Nijim, Adam Manzanares, Xiaojun Ruan, Xiao Qin
Issue Date:August 2009
pp. 1-6
No summary available.
Communication-Aware Load Balancing for Parallel Applications on Clusters
Found in: IEEE Transactions on Computers
By Xiao Qin, Hong Jiang, Adam Manzanares, Xiaojun Ruan, Shu Yin
Issue Date:January 2010
pp. 42-52
Cluster computing has emerged as a primary and cost-effective platform for running parallel applications, including communication-intensive applications that transfer a large amount of data among the nodes of a cluster via the interconnection network. Conv...
Can We Improve Energy Efficiency of Secure Disk Systems without Modifying Security Mechanisms?
Found in: Networking, Architecture, and Storage, International Conference on
By Xiaojun Ruan, Adam Manzanares, Shu Yin, Mais Nijim, Xiao Qin
Issue Date:July 2009
pp. 413-420
Improving energy efficiency of security-aware storage systems is challenging, because security and energy efficiency are often two conflicting goals. The first step toward making the best tradeoffs between high security and energy efficiency is to profile ...
An Energy-Efficient Reliability Model for Parallel Disk Systems
Found in: Information Technology: New Generations, Third International Conference on
By Fangyang Shen, Xiao Qin, Andres Salazar, Adam Manzanares, Kiranmai Bellam
Issue Date:April 2009
pp. 843-848
In the last decade, parallel disk systems have increasingly become popular for data-intensive applications running on high-performance computing platforms. Conservation of energy in parallel disk systems has a strong impact on the cost of cooling equipment...
An Adaptive Energy-Conserving Strategy for Parallel Disk Systems
Found in: Distributed Simulation and Real Time Applications, IEEE/ACM International Symposium on
By Mais Nijim, Adam Manzanares, Xiao Qin
Issue Date:October 2008
pp. 75-82
In the past decade parallel disk systems have been highly scalable and able to alleviate the problem of disk I/O bottleneck, thereby being widely used to support a wide range of data-intensive applications. Optimizing energy consumption in parallel disk sy...
A prefetching scheme for energy conservation in parallel disk systems
Found in: Parallel and Distributed Processing Symposium, International
By Adam Manzanares, Kiranmai Bellam, Xiao Qin
Issue Date:April 2008
pp. 1-5
Large-scale parallel disk systems are frequently used to meet the demands of information systems requiring high storage capacities. A critical problem with these large-scale parallel disk systems is the fact that disks consume a significant amount of energ...
MINT: A Reliability Modeling Frameworkfor Energy-Efficient Parallel Disk Systems
Found in: IEEE Transactions on Dependable and Secure Computing
By Shu Yin,Xiaojun Ruan,Adam Manzanares,Xiao Qin,Kenli Li
Issue Date:July 2014
pp. 345-360
The Popular Disk Concentration (PDC) technique and the Massive Array of Idle Disks (MAID) technique are two effective energy conservation schemes for parallel disk systems. The goal of PDC and MAID is to skew I/O load toward a few disks so that other disks...
The design and implementation of a multi-level content-addressable checkpoint file system
Found in: 2012 19th International Conference on High Performance Computing (HiPC)
By Abhishek Kulkarni,Adam Manzanares,Latchesar Ionkov,Michael Lang,Andrew Lumsdaine
Issue Date:December 2012
pp. 1-10
Long-running HPC applications guard against node failures by writing checkpoints to parallel file systems. Writing these checkpoints with petascale class machines has proven difficult and the increased concurrency demands of exascale computing will exacerb...
Conserving energy in real-time storage systems with I/O burstiness
Found in: ACM Transactions on Embedded Computing Systems (TECS)
By Adam Manzanares, Adam Roth, Mais Najim, Shu Yin, Xiao Qin, Xiaojun Ruan
Issue Date:February 2010
pp. 1-21
Energy conservation has become a critical problem for real-time embedded storage systems. Although a variety of approaches for reducing energy consumption have been extensively studied, energy conservation for real-time embedded storage systems is still an...
PRE-BUD: Prefetching for energy-efficient parallel I/O systems with buffer disks
Found in: ACM Transactions on Storage (TOS)
By Adam Manzanares, Shu Yin, Xiao Qin, Xiaojun Ruan
Issue Date:June 2011
pp. 1-29
A critical problem with parallel I/O systems is the fact that disks consume a significant amount of energy. To design economically attractive and environmentally friendly parallel I/O systems, we propose an energy-aware prefetching strategy (PRE-BUD) for p...
Dynamic load balancing for I/O-intensive applications on clusters
Found in: ACM Transactions on Storage (TOS)
By Adam Manzanares, Hong Jiang, Shu Yin, Xiao Qin, Xiaojun Ruan
Issue Date:November 2009
pp. 1-38
Load balancing for clusters has been investigated extensively, mainly focusing on the effective usage of global CPU and memory resources. However, previous CPU- or memory-centric load balancing schemes suffer significant performance drop under I/O-intensiv...
DARAW: a new write buffer to improve parallel I/O energy-efficiency
Found in: Proceedings of the 2009 ACM symposium on Applied Computing (SAC '09)
By Adam Manzanares, Kiranmai Bellam, Xiao Qin, Xiaojun Ruan, Ziliang Zong
Issue Date:March 2009
pp. 1-5
In the past decades, parallel I/O systems have been used widely to support scientific and commercial applications. New data centers today employ huge quantities of I/O systems, which consume a large amount of energy. Most large-scale I/O systems have an ar...
Energy efficient and reliable storage disks
Found in: Proceedings of the 46th Annual Southeast Regional Conference on XX (ACM-SE 46)
By Adam Manzanares, Kiranmai Bellam, Xiao Qin
Issue Date:March 2008
pp. 1-32
Computer hard disks have different failure probability rates that are a function of age and utilization. In this paper the relationship between the disk age, utilization, and failure probabilities are determined. This relationship is used to estimate a saf...