skip to main content
10.1145/3394171.3413512acmconferencesArticle/Chapter ViewAbstractPublication PagesmmConference Proceedingsconference-collections
research-article

Grad: Learning for Overhead-aware Adaptive Video Streaming with Scalable Video Coding

Published: 12 October 2020 Publication History

Abstract

Video streaming commonly uses Dynamic Adaptive Streaming over HTTP (DASH) to deliver good Quality of Experience (QoE) to users. Videos used in DASH are predominantly encoded by single-layered video coding such as H.264/AVC. In comparison, multi-layered video coding such as H.264/SVC provides more flexibility for upgrading the quality of buffered video segments and has the potential to further improve QoE. However, there are two challenges for using SVC in DASH: (i) the complexity in designing ABR algorithms; and (ii) the negative impact of SVC's coding overhead. In this work, we propose a deep reinforcement learning method called Grad for designing ABR algorithms that take advantage of the quality upgrade mechanism of SVC. Additionally, we quantify the impact of coding overhead on the achievable QoE of SVC in DASH, and propose jump-enabled hybrid coding (HYBJ) to mitigate the impact. Through emulation, we demonstrate that Grad-HYBJ, an ABR algorithm for HYBJ learned by Grad, outperforms the best performing state-of-the-art ABR algorithm by 17% in QoE.

Supplementary Material

MP4 File (3394171.3413512.mp4)
Presentation video of our paper "Grad: Learning for Overhead-aware Adaptive Video Streaming with Scalable Video Coding". In the video we introduce our work and display a short demo.

References

[1]
2016. Dash.js. https://github.com/Dash-Industry-Forum/dash.js/
[2]
2017. Federal Communications Commission. 2017. Raw Data - Measuring Broadband America. https://www.fcc.gov/reports-research/reports
[3]
2019. Cisco Visual Networking Index: Forecast and Trends, 2017-2022 White Paper. https://www.cisco.com/c/en/us/solutions/collateral/service-provider/visual-networking-index-vni/white-paper-c11-741490.html
[4]
Zahaib Akhtar, Yun Seong Nam, Ramesh Govindan, Sanjay Rao, Jessica Chen, Ethan Katz-Bassett, Bruno Ribeiro, Jibin Zhan, and Hui Zhang. 2018. Oboe: Auto-Tuning Video ABR Algorithms to Network Conditions. In Proceedings of the 2018 Conference of the ACM Special Interest Group on Data Communication. 44--58.
[5]
Travis Andelin, Vasu Chetty, Devon Harbaugh, Sean Warnick, and Daniel Zappala. 2012. Quality Selection for Dynamic Adaptive Streaming over HTTP with Scalable Video Coding. In Proceedings of the 3rd Multimedia Systems Conference. 149--154.
[6]
G. Bjontegaard. 2001. Calculation of average PSNR differences between RD-Curves. Proceedings of the ITU-T Video Coding Experts Group (VCEG) Thirteenth Meeting (01 2001).
[7]
Ayub Bokani, Mahbub Hassan, Salil S. Kanhere, Jun Yao, and Garson Zhong. 2016. Comprehensive Mobile Bandwidth Traces from Vehicular Networks. In Proceedings of the 7th International Conference on Multimedia Systems. Article 44, bibinfonumpages6 pages.
[8]
Niels Bouten, Steven Latré, Jeroen Famaey, Filip De Turck, and Werner Van Leekwijck. 2013. Minimizing the Impact of Delay on Live SVC-based HTTP Adaptive Streaming Services. Proceedings of the 2013 IFIP/IEEE International Symposium on Integrated Network Management, IM 2013.
[9]
Federico Chiariotti, Stefano D'Aronco, Laura Toni, and Pascal Frossard. 2016. Online Learning Adaptation Strategy for DASH Clients. In Proceedings of the 7th International Conference on Multimedia Systems. Article 8, 12 pages.
[10]
Maxim Claeys, Steven Latré, Jeroen Famaey, Tingyao Wu, Werner Van Leekwijck, and Filip De Turck. 2013. Design of a Q-Learning based client quality selection algorithm for HTTP Adaptive Video Streaming.
[11]
Maxim Claeys, Steven Latré, Jeroen Famaey, TY Wu, W Van Leekwijck, and Filip De Turck. 2014. Design and optimisation of a (FA)Q-learning-based HTTP adaptive streaming client. CONNECTION SCIENCE, Vol. 26, 1 (2014), 22.
[12]
Florin Dobrian, Vyas Sekar, Asad Awan, Ion Stoica, Dilip Antony Joseph, Aditya Ganjam, Jibin Zhan, and Zhang Hui. 2011. Understanding the impact of video quality on user engagement. In Acm Sigcomm Conference. 362--373.
[13]
A. Elgabli, V. Aggarwal, S. Hao, F. Qian, and S. Sen. 2018. LBP: Robust Rate Adaptation Algorithm for SVC Video Streaming. IEEE/ACM Transactions on Networking, Vol. 26, 4 (2018), 1633--1645.
[14]
Michael Grafl, Christian Timmerer, Hermann Hellwagner, Wael Chérif, and Adlen Ksentini. 2013. Evaluation of Hybrid Scalable Video Coding for HTTP-based Adaptive Media Streaming with High-Definition Content. 2013 IEEE 14th International Symposium on a World of Wireless, Mobile and Multimedia Networks, WoWMoM 2013, 7.
[15]
Te-Yuan Huang, Ramesh Johari, Nick McKeown, Matthew Trunnell, and Mark Watson. 2014. A Buffer-Based Approach to Rate Adaptation: Evidence from a Large Video Streaming Service. In Proceedings of the 2014 ACM Conference on SIGCOMM. 187--198.
[16]
Jaehyun Hwang, Junghwan Lee, and Chuck Yoo. 2016. Eliminating bandwidth estimation from adaptive video streaming in wireless networks. Signal Processing: Image Communication, Vol. 47 (2016), 242--251.
[17]
Christian Kreuzberger, Daniel Posch, and Hermann Hellwagner. 2015. A Scalable Video Coding Dataset and Toolchain for Dynamic Adaptive Streaming over HTTP. In Proceedings of the 6th ACM Multimedia Systems Conference. 213--218.
[18]
Yunzhuo Liu, Bo Jiang, Tian Guo, Ramesh K. Sitaraman, Don Towsley, and Xinbing Wang. 2020. Technical report: Grad: Learning for Overhead-aware Adaptive Video Streaming with Scalable Video Coding.
[19]
Hongzi Mao, Ravi Netravali, and Mohammad Alizadeh. 2017. Neural Adaptive Video Streaming with Pensieve. In Proceedings of the Conference of the ACM Special Interest Group on Data Communication. 197--210.
[20]
Volodymyr Mnih, Adria Puigdomenech Badia, Mehdi Mirza, Alex Graves, Timothy Lillicrap, Tim Harley, David Silver, and Koray Kavukcuoglu. 2016. Asynchronous Methods for Deep Reinforcement Learning. In Proceedings of The 33rd International Conference on Machine Learning.
[21]
Ricky K. P. Mok, Xiapu Luo, Edmond W. W. Chan, and Rocky K. C. Chang. 2012. QDASH: A QoE-Aware DASH System. In Proceedings of the 3rd Multimedia Systems Conference. 11--22.
[22]
Afshin Taghavi Nasrabadi, Anahita Mahzari, Joseph D. Beshay, and Ravi Prakash. 2017. Adaptive 360-Degree Video Streaming Using Scalable Video Coding. In Proceedings of the 25th ACM International Conference on Multimedia. 1689--1697.
[23]
Afshin Taghavi Nasrabadi and Ravi Prakash. 2018. Layer-Assisted Adaptive Video Streaming. In Proceedings of the 28th ACM SIGMM Workshop on Network and Operating Systems Support for Digital Audio and Video. 31--36.
[24]
Ravi Netravali, Anirudh Sivaraman, Keith Winstein, Somak Das, Ameesh Goyal, and Hari Balakrishnan. 2014. Mahimahi: A Lightweight Toolkit for Reproducible Web Measurement. In Proceedings of the 2014 ACM Conference on SIGCOMM. 129--130.
[25]
Pengpeng Ni, Ragnhild Eg, Alexander Eichhorn, Carsten Griwodz, and Pral Halvorsen. 2011. Flicker Effects in Adaptive Video Streaming to Handheld Devices. In Proceedings of the 19th ACM International Conference on Multimedia. 463--472.
[26]
S. G. Ozcan, T. Kivilcim, C. Cetinkaya, and M. Sayit. 2017. Rate adaptation algorithm with backward quality increasing property for SVC-DASH. In 2017 IEEE 7th International Conference on Consumer Electronics - Berlin (ICCE-Berlin). 24--28.
[27]
Darijo Raca, Jason J. Quinlan, Ahmed H. Zahran, and Cormac J. Sreenan. 2018. Beyond Throughput: A 4G LTE Dataset with Channel and Context Metrics. In Proceedings of the 9th ACM Multimedia Systems Conference. 460--465.
[28]
Haakon Riiser, Paul Vigmostad, Carsten Griwodz, and Pral Halvorsen. 2013. Commute Path Bandwidth Traces from 3G Networks: Analysis and Applications. In Proceedings of the 4th ACM Multimedia Systems Conference. 114--118.
[29]
S. Rimac-Drlje, O. Nemcic, and M. Vranjes. 2008. Scalable Video Coding extension of the H.264/AVC standard. In Elmar, International Symposium. 9--12.
[30]
Heiko Schwarz, Detlev Marpe, and Thomas Wiegand. 2007. Overview of the Scalable Video Coding Extension of the H.264/AVC Standard. Circuits and Systems for Video Technology, IEEE Transactions on, Vol. 17 (10 2007), 1103--1120.
[31]
C. Sieber, T. Hoßfeld, T. Zinner, P. Tran-Gia, and C. Timmerer. 2013. Implementation and user-centric comparison of a novel adaptation logic for DASH with SVC. In 2013 IFIP/IEEE International Symposium on Integrated Network Management (IM 2013). 1318--1323.
[32]
Kevin Spiteri, Ramesh Sitaraman, and Daniel Sparacio. 2018. From theory to practice: improving bitrate adaptation in the DASH reference player. In Proceedings of the 9th ACM Multimedia Systems Conference. 123--137.
[33]
K. Spiteri, R. Urgaonkar, and R. K. Sitaraman. 2016. BOLA: Near-optimal bitrate adaptation for online videos. In IEEE INFOCOM 2016 - The 35th Annual IEEE International Conference on Computer Communications. 1--9.
[34]
Gary Sullivan, Pankaj Topiwala, and Ajay Luthra. 2004. The H.264/AVC Advanced Video Coding Standard: Overview and Introduction to the Fidelity Range Extensions. Proceedings of SPIE - The International Society for Optical Engineering (11 2004).
[35]
Siyuan Xiang, Min Xing, Lin Cai, and Jianping Pan. 2015. Dynamic Rate Adaptation for Adaptive Video Streaming in Wireless Networks. Signal Processing: Image Communication, Vol. 39 (09 2015).
[36]
Xiaoqi Yin, Abhishek Jindal, Vyas Sekar, and Bruno Sinopoli. 2015. A Control-Theoretic Approach for Dynamic Adaptive Video Streaming over HTTP. In Acm Conference on Special Interest Group on Data Communication. 325--338.

Cited By

View all

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
MM '20: Proceedings of the 28th ACM International Conference on Multimedia
October 2020
4889 pages
ISBN:9781450379885
DOI:10.1145/3394171
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 12 October 2020

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. adaptive bitrate algorithm
  2. reinforcement learning
  3. scalable video coding

Qualifiers

  • Research-article

Funding Sources

  • Science and Technology Innovation Program of Shanghai
  • U.S. National Science Foundation
  • National Natural Science Foundation of China
  • Shanghai Key Laboratory of Scalable Computing and Systems
  • National Key R&D Program of China

Conference

MM '20
Sponsor:

Acceptance Rates

Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)66
  • Downloads (Last 6 weeks)9
Reflects downloads up to 06 Nov 2024

Other Metrics

Citations

Cited By

View all

View Options

Get Access

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media