The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.09 - September (2010 vol.21)
pp: 1330-1341
Tao Xie , University of Alabama, Tuscaloosa
Yao Sun , Teradata Corporation, San Diego
ABSTRACT
Current disk arrays consist purely of hard disk drives, which normally provide huge storage capacities with low cost and high throughput for data-intensive applications. Nevertheless, they have some inherent disadvantages such as long access latencies and energy inefficiency due to their build-in mechanical mechanisms. Flash-memory-based solid state disks, on the other hand, although currently more expensive and inadequate in write cycles, offer much faster random read accesses and are much more robust and energy efficient. To combine the complementary merits of hard disks and flash disks, in this paper, we propose a hybrid disk array architecture named hybrid disk storage (HIT) for data-intensive applications. Next, a dynamic data redistribution strategy called performance, energy, and reliability balanced (PEARL), which can periodically redistribute data between flash disks and hard disks to adapt to the changing data access patterns, is developed on top of the HIT architecture. Comprehensive simulations using real-life traces demonstrate that compared with existing data placement techniques, PEARL exhibits its strength in both performance and energy consumption without impairing flash disk reliability.
INDEX TERMS
Allocation strategies, energy-aware systems, reliability, secondary storage.
CITATION
Tao Xie, Yao Sun, "Dynamic Data Reallocation in Hybrid Disk Arrays", IEEE Transactions on Parallel & Distributed Systems, vol.21, no. 9, pp. 1330-1341, September 2010, doi:10.1109/TPDS.2009.175
REFERENCES
[1] M. Arlitt and C. Williamson, "Web Server Workload Characterization: The Search for Invariants," Proc. ACM SIGMETRICS Conf., pp. 126-137, May 1996.
[2] N. Agrawal, V. Prabhakaran, T. Wobber, J. Davis, M. Manasse, and R. Panigrahy, "Design Tradeoffs for SSD Performance," Proc. USENIX Ann. Technical Conf., pp. 57-70, 2008.
[3] R. Arnan, E. Bachmat, T.K. Lam, and R. Michel, "Dynamic Data Reallocation in Disk Arrays," ACM Trans. Storage, vol. 3, no. 1, p. 2, Mar. 2007.
[4] T. Bisson and S. Brandt, "Reducing Energy Consumption with a Non-Volatile Storage Cache," Proc. Int'l Workshop Software Support for Portable Storage, Mar. 2005.
[5] J. Bucy, J. Schindler, S. Schlosser, G. Ganger, B. Worthington, and Y. Patt, The DiskSim Simulation Environment Version 4.0 Reference Manual, http://www.pdl.cmu.edu/DiskSimindex.html , 2008.
[6] K. Cash, "Flash Solid State Disks—Inferior Technology or Closet Superstar?" BiTMICRO Networks, http://www.storagesearch. combitmicro-art1.html , 2007.
[7] L.P. Chang and T.W. Kuo, "Efficient Management for Large-Scale Flash-Memory Storage Systems with Resource Conservation," ACM Trans. Storage, vol. 1, no. 4, pp. 381-418, 2005.
[8] L.P. Chang and T.W. Kuo, "An Adaptive Striping Architecture for Flash-Memory Storage," Proc. Real-Time and Embedded Technology Systems of Embedded Systems and Applications Symp., pp. 187-196, 2002.
[9] "Cheetah 15K.4 Mainstream Enterprise Disc Drive Storage," Seagate Cheetah ST3146854LW.pdf.
[10] F. Chen, S. Jiang, and X. Zhang, "SmartSaver: Turning Flash Drive into a Disk Energy Saver for Mobile Computers," Proc. Int'l Symp. Low Power Electronics and Design, pp. 412-417, 2006.
[11] T. Claburn, "Google Plans to Use Intel SSD Storage in Servers," http://www.informationweek.com/news/storage/ systems showArticle.jhtml?articleID=207602745 , 2010.
[12] W. Dowdy and D. Foster, "Comparative Models of the File Assignment Problem," ACM Computing Surveys, vol. 14, no. 2, pp. 287-313, 1982.
[13] D. Dumitru, "Understanding Flash SSD Performance," EasyCo LLC, Aug. 2007.
[14] A. Fitzgerald, "Flash Disk Reliability Begins at the IC Level," J. COTS, http://www.cotsjournalonline.com/homearticle.php? id=100053 , 2004.
[15] J.W. Hsieh, T.W. Kuo, and L.P. Chang, "Efficient Identification of Hot Data for Flash Memory Storage Systems," ACM Trans. Storage, vol. 2, no. 1, pp. 22-40, 2006.
[16] A. Kawaguchi, S. Nishioka, and H. Andmotoda, "A Flash-Memory-Based File System," Proc. USENIX Technical Conf., pp. 155-164, 1995.
[17] H. Kim and S.G. Lee, "A New Flash-Memory Management for Flash Storage System," Proc. 23rd Int'l Computer Software and Applications Conf., pp. 284-289, 1999.
[18] Y.J. Kim, K.T. Kwon, and J. Kim, "Energy-Efficient File Placement Techniques for Heterogeneous Mobile Storage Systems," Proc. Sixth ACM IEEE Int'l Conf. Embedded Software, pp. 171-177, 2006.
[19] I. Koltsidas and S.D. Viglas, "Flashing up the Storage Layer," Proc. Int'l Conf. Very Large Databases (VLDB), pp. 514-525, 2008.
[20] L.W. Lee, P. Scheuermann, and R. Vingralek, "File Assignment in Parallel I/O Systems with Minimal Variance of Service Time," IEEE Trans. Computers, vol. 49, no. 2, pp. 127-140, Feb. 2000.
[21] S.W Lee, B. Moon, C. Park, J. Kim, and S.W. Kim, "A Case for Flash Memory ssd in Enterprise Database Applications," Proc. ACM SIGMOD, pp. 1075-1086, 2008.
[22] A. Leventhal, "Flash Storage Memory," Comm. ACM, vol. 51, pp. 47-51, July 2008.
[23] B. Levine, "Dell and Alienware Offer Samsung 64-GB SSDs," http://www.newsfactor.comstory.xhtml?story_id=55235 , Sept. 2007.
[24] R. Panabaker, "Hybrid Hard Disk and ReadyDrive(tm) Technology: Improving Performance and Power for Windows Vista Mobile PCs," Proc. Microsoft Windows Hardware Eng. Conf. (WinHEC), 2006.
[25] E. Pinheiro and R. Bianchini, "Energy Conservation Techniques for Disk Array-Based Servers," Proc. Conf. Supercomputing, pp. 88-95, June 2004.
[26] "Power, Heat and Sledgehammer," white paper, Maximum Inst., Inc., Apr. 2002.
[27] "Product Specification, Adtron A25FB-20 Flashpak Data Storage," http://www.adtron.com/pdfA25FB-20-sum052908.pdf , 2008.
[28] D. Roselli, J.R. Lorch, and T.E. Anderson, "A Comparison of File System Workloads," Proc. USENIX Technical Conf., pp. 44-54, June 2000.
[29] P. Scheuermann, G. Weikum, and P. Zabback, "Data Partitioning and Load Balancing in Parallel Disk Systems," J. VLDB, vol. 7, no. 1, pp. 48-66, 1998.
[30] "SPC Trace File Format Specification," http://traces.cs.umass. edu/index.php/Storage Storage, June 2007.
[31] "Storage Products, A25FB-20-R2spec101507.pdf," http:/www. adtron.com, 2007.
[32] G. Weikum, P. Zabback, and P. Scheuermann, "Dynamic File Allocation in Disk Arrays," Proc. ACM SIGMOD, vol. 20, no. 2, pp. 406-415, 1991.
[33] T. Xie, "SOR: A Static File Assignment Strategy Immune to Workload Characteristic Assumptions in Parallel I/O Systems," Proc. 36th Int'l Conf. Parallel Processing (ICPP), Sept. 2007.
[34] T. Xie, "SEA: A Striping-Based Energy-Aware Strategy for Data Placement in RAID-Structured Storage Systems," IEEE Trans. Computers, vol. 57, no. 6, pp. 748-761, June 2008.
[35] T. Xie and Y. Sun, "PEARL: Performance, Energy, and Reliability Balanced Dynamic Data Redistribution for Next Generation Disk Arrays," Proc. 16th Ann. Meeting of the IEEE Int'l Symp. Modeling, Analysis, and Simulation of Computer and Telecomm. Systems (MASCOTS), Sept. 2008.
18 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool