This Article 
 Bibliographic References 
 Add to: 
Modeling and Dimensioning Hierarchical Storage Systems for Low-Delay Video Services
July 2003 (vol. 52 no. 7)
pp. 907-919

Abstract—In order to cost-effectively accommodate a large number of titles in a video system, a hierarchical storage system can be used. In this system, not-so-popular video files are stored in a tertiary level such as a disk/tape library. These files are transferred, or “staged,” to a secondary level composed of magnetic disks before being streamed to the users. This system overcomes the current limitations in using disk/tape libraries to stream videos and resolves the bandwidth difference between staging and streaming. In this paper, we present, via analysis, a model of the system and determine the minimum storage and bandwidth required, at each level, to meet a given user delay goal. We also analyze a number of system operations pertaining to whether or not a file is played while it is being staged (i.e., stage-streaming) and whether or not the displayed segments are deleted (i.e., trail-deletion). We show that stage-streaming and trail-deletion can achieve substantially lower bandwidth and storage requirements. In order to further increase the streaming and storage scalability, a distributed storage system can be used where multiple local servers are put close to user pools and get their files from one of the libraries through a network. We extend the models developed to such a system and specify the resource requirements to meet a given delay goal.

[1] A. Guha, The Evolution to Network Storage Architecture for Multimedia Applications Proc. IEEE Int'l Conf. Multimedia Computing and Systems, pp. 68-73, June 1999.
[2] T. Kurioka, H. Minami, H. Okuda, J. Numazawa, and A. Yanagimachi, Television Home Server for Integrated Services Toward the Realization of ISDB 'Anytime' Services IEEE Trans. Consumer Electronics, vol. 44, pp. 1195-1200, Nov. 1998.
[3] V.O.K. Li and W. Liao, Distributed Multimedia Systems Proc. IEEE, vol. 85, pp. 1063-1108, July 1997.
[4] T. Little and D. Venkatesh, Prospects for Interactive Video-on-Demand IEEE Multimedia, pp. 14-24, Fall 1994.
[5] W.J. Bolosky, J.S. Barrera, R.P. Draves, R.P. Fitzgerald, G.A. Gibson, M.B. Jones, S.P. Levi, N.P. Myhrvold, and R.F. Rashid, The Tiger Video Fileserver Proc. Sixth Int'l Workshop Network and Operating System Support for Digital Audio and Video (NOSSDAV '96), Apr. 1996.
[6] R.L. Haskin and F.B. Schmuck, The Tiger Shark File System Proc. COMPCON '96, pp. 226-231, 1996.
[7] C.T. Johnson, The IBM 3850: A Mass Storage System with Disk Characteristics Proc. IEEE, vol. 63, pp. 1166-1170, Aug. 1975.
[8] A. Laursen, J. Olkin, and M. Porter, Oracle Media Server: Providing Consumer Based Interactive Access to Multimedia Data Proc. ACM SIGMOD, pp. 470-477, 1994.
[9] A. Laursen, J. Olkin, and M. Porter, Oracle Media Server Framework Compcon: Digest of Papers, pp. 203-208, 1995.
[10] K.C. Almeroth, A. Dan, D. Sitaram, and W.H. Tetzlaff, Long Term Resource Allocation in Video Delivery Systems Proc. IEEE Infocom '97, pp. 1333-1340, Apr. 1997.
[11] A. Dan, M. Kienzle, and D. Sitaram, “A Dynamic Policy of Segment Replication for Load-Balancing in Video-On-Demand Servers,” ACM Multimedia Systems J., 1995.
[12] C.C. Aggarwal, J.L. Wolf, and P.S. Yu, The Maximum Factor Queue Length Batching Scheme for Video-on-Demand Systems IEEE Trans. Computers, vol. 50, no. 2, pp. 97-110, Feb. 2001.
[13] S.-H. G. Chan and F. Tobagi, Trade-Off between System Profit and User Delay/Loss in Providing Video Services with Request Batching IEEE Trans. Circuits and Systems for Video Technology, vol. 11, pp. 916-927, Aug. 2001.
[14] S.-H.G. Chan and F. Tobagi, Distributed Servers Architecture for Networked Video Services IEEE/ACM Trans. Networking, vol. 9, pp. 125-136, Apr. 2001.
[15] L. Gao, Z.-L. Zhang, and D. Towsley, Catching and Selective Catching: Efficient Latency Reduction Techniques for Delivering Continuous Multimedia Streams Proc. ACM Multimedia '99, pp. 203-206, Oct.-Nov. 1999.
[16] C.C. Aggarwal, J.L. Wolf, and P.S. Yu, Design and Analysis of Permutation-Based Pyramid Broadcasting ACM/Springer Multimedia Systems, vol. 7, no. 6, pp. 439-448, 1999.
[17] S.-H.G. Chan and S.-H.I. Yeung, Client Buffering Techniques for Scalable Video Broadcasting over Broadband Networks with Low User Delay IEEE Trans. Broadcasting, vol. 48, pp. 19-26, Mar. 2002.
[18] S. Ghandeharizadeh, A. Dashti, and C. Shahabi, A Pipelining Mechanism to Minimize the Latency Time in Hierarchical Multimedia Storage Managers Computer Comm., vol. 18, pp. 170-184, Mar. 1995.
[19] S. Ghandeharizadeh and C. Shahabi, “On Multimedia Repositories, Personal Computers, and Hierarchical Storage,” Proc. Second ACM Int'l Conf. Multimedia, Oct. 1994.
[20] R.-H. Hwang and P.-H. Chi, A Low Cost Optical Storage Server for Near-on-Demand Systems IEEE Trans. Broadcasting, vol. 47, pp. 357-366, Dec. 2001.
[21] M.G. Kienzle, A. Dan, D. Sitaram, and W. Tetzlaff, Using Tertiary Storage in Video-on-Demand Servers Compcon: Digest of Papers, pp. 225-232, 1995.
[22] A.L. Chervenak, D.A. Patterson, and R.H. Katz, Choosing the Best Storage System for Video Service Proc. ACM Multimedia, pp. 109-119, 1995.
[23] S.A. Barnett and G.J. Anido, “A Cost Comparison of Distributed and Centralized Approaches to Video-on-Demand,” IEEE J. Selected Areas on Comm., vol. 14, no. 6, pp. 1,173-1,183, 1996.
[24] P. Triantafillou and T. Papadakis, Ondemand Data Elevation in Hierarchical Multimedia Storage Servers Proc. 23rd Int'l Conf. Very Large Data Bases, pp. 226-235, 1997.
[25] S.-L. Tsao, A Low Cost Optical Storage Server for Near-on-Demand Systems IEEE Trans. Broadcasting, vol. 47, pp. 56-65, Mar. 2001.
[26] P. Sumari, M. Merabti, and R. Pereira, Video-on-Demand Server: Strategies for Improving Performance IEE Proc.-Software, vol. 146, pp. 33-37, Feb. 1999.
[27] Z.D. Wu, Design and Analysis of Video-on-Demand Servers Proc. IEEE Globecom, pp. 773-778, Nov. 1998.
[28] S.-L. Tsao and Y.-M. Huang, Making a Cost-Effective Storage Server for Broadcasting Digital Video Services IEEE Trans. Broadcasting, vol. 44, pp. 300-307, Sept. 1998.
[29] E. Chang and H. Garcia-Molina, Reducing Initial Latency in Media Servers IEEE Multimedia, vol. 4, no. 3, pp. 50-61, July-Sept. 1997.
[30] S. Chen and M. Thapar, A Novel Video Layout Strategy for Near-Video-on-Demand Servers Proc. IEEE Int'l Conf. Multimedia Computing and Systems '97, pp. 37-45, June 1997.
[31] A.N. Mourad, “Issues in the Design of a Storage Server For Video-on-Demand,” ACM Multimedia Systems J., vol. 4, pp. 70-86, 1996.
[32] H.M. Vin, A. Goyal, and P. Goyal, Algorithms for Designing Multimedia Servers Computer Comm., vol. 18, pp. 192-203, Mar. 1995.
[33] H.M. Vin and P.V. Rangan, “Design of a Multi-User HDTV Storage Server,” IEEE J. Selected Areas in Comm., vol. 11, no. 1, Jan. 1993.
[34] J. Wilkes, R. Golding, C. Staelin, and T. Sullivan, The HP Auto RAID Hierarchical Storage System ACM Trans. Computer Systems, vol. 14, pp. 108-136, Feb. 1996.
[35] C. Ruemmler and J. Wilkes, "An Introduction to Disk Drive Modeling," Computer, vol. 27, no. 3, pp. 17-28, Mar. 1994.
[36] L. Golubchik, R.R. Muntz, and R.W. Watson, “Analysis of Striping Techniques in Robotic Storage Libraries,” Proc. 14th IEEE Symp. Mass Storage Systems, pp. 225-238, Sept. 1995.
[37] D.A. Ford, R.J.T. Morris, and A.E. Bell, Redundant Arrays of Independent Libraries (RAIL): A Tertiary Storage System Proc. COMPCON '96, pp. 280-285, 1996.
[38] S.-W. Lau and J.C.S. Lui, Scheduling and Data Layout Policies for a Near-Line Multimedia Storage Architecture ACM/Springer Multimedia Systems, vol. 5, pp. 310-323, Sept. 1997.
[39] R. Boutaba and A. Hafid, A Generic Platform for Scalable Access to Multimedia-on-Demand Systems IEEE J. Selected Areas in Comm., vol. 17, pp. 1599-1613, Sept. 1999.
[40] S.M. Poon, B.S. Lee, and C.K. Yeo, A DAVIC-Based Video-on-Demand System over ATM Networks IEEE Trans. Consumer Electronics, vol. 45, pp. 345-355, May 1999.
[41] T.-H. Wu, I. Korpeoglu, and B.-C. Cheng, Distributed Interactive Video System Design and Analysis IEEE Comm. Magazine, pp. 100-108, Mar. 1997.
[42] D.W. Brubeck and L.A. Rowe, “Hierarchical Storage Management in a Distributed VoD System,” IEEE Multimedia, vol. 3, no. 3, pp. 37-47, Fall 1996.
[43] P. Mundur, R. Simon, and A. Sood, Integrated Admission Control in Hierarchical Video-on-Demand Systems Proc. IEEE Int'l Conf. Multimedia Computing and Systems, pp. 220-225, June 1999.
[44] L.D. Giovanni, A.M. Langellotti, L.M. Patitucci, and L. Petrini, Dimensioning of Hierarchical Storage for Video on Demand Services Proc. IEEE Int'l Computing Conf. (ICC '94), pp. 1739-1743, 1994.
[45] Y. Won and J. Srivastava, Minimizing Blocking Probability in a Hierarchical Storage Based VOD Server Proc. Int'l Workshop Multimedia Database Management Systems, pp. 12-19, Aug. 1996.
[46] S.B. Jun and W.S. Lee, Video Allocation Methods in a Multi-Level Server for Large-Scale VOD Services IEEE Trans. Consumer Electronics, vol. 44, pp. 1309-1318, Nov. 1998.
[47] Y.-C. Lai, Y.-D. Lin, and H.-Z. Lai, A Hierarchical Network Storage Architecture for Video-on-Demand Services IEEE Trans. Broadcasting, vol. 43, pp. 145-154, June 1997.
[48] J.-P. Nussbaumer et. al., "Networking Requirements for Interactive Video on Demand," IEEE J. Selected Areas in Communication, Vol. 13, No. 5, June 1995, pp. 779-787.
[49] G. Bianchi and R. Melen, The Role of Local Storage in Supporting Video Retrieval Services on ATM Networks IEEE/ACM Trans. Networking, vol. 5, pp. 882-892, Dec. 1997.
[50] H. Suzuki and K. Nishimura, Performance Analysis of a Storage Hierarchy for Video Servers Systems and Computers in Japan, vol. 28, pp. 11-20, June 1997.
[51] A. Merchant, Q. Ren, and B. Sengupta, Hierarchical Storage Servers for Video on Demand: Feasibility, Design and Sizing Proc. IEEE Globecom '96, pp. 272-278, Nov. 1996.
[52] S.-H.G. Chan and F.A. Tobagi, Hierarchical Storage Systems for On-Demand Video Servers Proc. SPIE High-Density Data Recording and Retrieval Technologies, pp. 103-120, Oct. 1995.
[53] L. Kleinrock, Queueing Systems: Theory, vol. 1. Wiley Interscience, 1975.
[54] S.-H.G. Chan, Scalable Services for Video-on-Demand PhD dissertation, Dept. of Electrical Eng., Stanford Univ., Jan. 1999.

Index Terms:
Hierarchical storage systems, video services, tertiary and secondary levels, distributed storage systems, staging and replacement policies, user delay goal.
S.-H. Gary Chan, Fouad A. Tobagi, "Modeling and Dimensioning Hierarchical Storage Systems for Low-Delay Video Services," IEEE Transactions on Computers, vol. 52, no. 7, pp. 907-919, July 2003, doi:10.1109/TC.2003.1214339
Usage of this product signifies your acceptance of the Terms of Use.