skip to main content
10.1145/1921168.1921174acmconferencesArticle/Chapter ViewAbstractPublication PagesconextConference Proceedingsconference-collections
research-article

Optimal content placement for a large-scale VoD system

Published: 30 November 2010 Publication History

Abstract

IPTV service providers offering Video-on-Demand currently use servers at each metropolitan office to store all the videos in their library. With the rapid increase in library sizes, it will soon become infeasible to replicate the entire library at each office. We present an approach for intelligent content placement that scales to large library sizes (e.g., 100Ks of videos). We formulate the problem as a mixed integer program (MIP) that takes into account constraints such as disk space, link bandwidth, and content popularity. To overcome the challenges of scale, we employ a Lagrangian relaxation-based decomposition technique combined with integer rounding. Our technique finds a near-optimal solution (e.g., within 1-2%) with orders of magnitude speedup relative to solving even the LP relaxation via standard software. We also present simple strategies to address practical issues such as popularity estimation, content updates, short-term popularity fluctuation, and frequency of placement updates. Using traces from an operational system, we show that our approach significantly outperforms simpler placement strategies. For instance, our MIP-based solution can serve all requests using only half the link bandwidth used by LRU or LFU cache replacement policies. We also investigate the trade-off between disk space and network bandwidth.

References

[1]
H. A. Alzoubi, S. Lee, M. Rabinovich, O. Spatscheck, and J. V. der Merwe. Anycast CDNs revisited. In Proceeding of WWW, 2008.
[2]
S. Asur and B. A. Huberman. Predicting the future with social media. arXiv:1003.5699v1 {cs.CY}, 2010.
[3]
I. D. Baev, R. Rajaraman, and C. Swamy. Approximation algorithms for data placement problems. SIAM J. Computing, 38(4):1411--1429, 2008.
[4]
A. Barbir, B. Cain, F. Douglis, M. Green, M. Hofmann, R. Nair, D. Potter, and O. Spatscheck. Known Content Network (CN) Request-Routing Mechanisms. RFC 3568, July 2003.
[5]
D. Bienstock. Potential Function Methods for Approximately Solving Linear Programming Problems: Theory and Practice. Kluwer, 2002.
[6]
S. Borst, V. Gupta, and A. Walid. Distributed caching algorithms for content distribution networks. In Proceeding of IEEE Infocom, 2010.
[7]
J. Byrka and K. Aardal. An optimal bifactor approximation algorithm for the metric uncapacitated facility location problem. SIAM Journal on Computing, 39(6):2212--2231, 2010.
[8]
M. Cha, H. Kwak, P. Rodriguez, Y.-Y. Ahn, and S. Moon. I Tube, You Tube, Everybody Tubes: Analyzing the World's Largest User Generated Content Video System. In Proceedings of ACM IMC, 2007.
[9]
L. W. Dowdy and D. V. Foster. Comparative models of the file assignment problem. ACM Comput. Surv., 14(2):287--313, 1982.
[10]
L. Fan, P. Cao, J. Almeida, and A. Z. Broder. Summary cache: a scalable wide-area web cache sharing protocol. IEEE/ACM Trans. Netw., 8(3):281--293, 2000.
[11]
N. Garg and J. Könemann. Faster and simpler algorithms for multicommodity flow and other fractional packing problems. SIAM J. Comput., 37(2):630--652, 2007.
[12]
L. Guo, E. Tan, S. Chen, Z. Xiao, and X. Zhang. Does internet media traffic really follow zipf-like distribution? In Proceedings of ACM SIGMETRICS, New York, NY, USA, 2007.
[13]
C. Huang, J. Li, and K. W. Ross. Can internet video-on-demand be profitable? In Proceedings of ACM Sigcomm, 2007.
[14]
Y. Koren. Factorization meets the neighborhood: a multifaceted collaborative filtering model. In Proceeding of ACM SIGKDD, 2008.
[15]
D. Lee, J. Choi, J. H. Kim, S. H. Noh, S. L. Min, Y. Cho, and C. S. Kim. LRFU: A spectrum of policies that subsumes the least recently used and least frequently used policies. IEEE Trans. Comput., 50(12):1352--1361, 2001.
[16]
L. Qiu, V. N. Padmanabhan, and G. M. Voelker. On the placement of web server replicas. In Proceeding of IEEE Infocom, 2001.
[17]
N. Spring, R. Mahajan, and D. Wetherall. Measuring isp topologies with rocketfuel. In Proceedings of ACM SIGCOMM, 2002.
[18]
V. Valancius, N. Laoutaris, L. Massoulié, C. Diot, and P. Rodriguez. Greening the internet with nano data centers. In Proceedings of ACM CoNEXT, 2009.
[19]
Y. Zhao, D. L. Eager, and M. K. Vernon. Network bandwidth requirements for scalable on-demand streaming. IEEE/ACM Trans. Netw., 15(4):878--891, 2007.
[20]
X. Zhou and C.-Z. Xu. Optimal video replication and placement on a cluster of video-on-demand servers. In Proc. IEEE ICPP, 2002.

Cited By

View all

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
Co-NEXT '10: Proceedings of the 6th International COnference
November 2010
349 pages
ISBN:9781450304481
DOI:10.1145/1921168
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 30 November 2010

Permissions

Request permissions for this article.

Check for updates

Qualifiers

  • Research-article

Conference

Co-NEXT '10
Sponsor:
Co-NEXT '10: Conference on emerging Networking EXperiments and Technologies
November 30 - December 3, 2010
Pennsylvania, Philadelphia

Acceptance Rates

Overall Acceptance Rate 198 of 789 submissions, 25%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)23
  • Downloads (Last 6 weeks)2
Reflects downloads up to 15 Sep 2024

Other Metrics

Citations

Cited By

View all

View Options

Get Access

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media