skip to main content
10.1145/3458306.3458872acmconferencesArticle/Chapter ViewAbstractPublication PagesmmsysConference Proceedingsconference-collections
research-article

Uncertainty-aware robust adaptive video streaming with bayesian neural network and model predictive control

Published: 02 July 2021 Publication History

Abstract

In this paper, we propose BayesMPC, an uncertainty-aware robust adaptive bitrate (ABR) algorithm on the basis of Bayesian neural network (BNN) and model predictive control (MPC). Specifically, to improve the capacity of learning transition probability of the network throughput, we adopt a BNN-based predictor that is able to predict the statistical distribution of future throughput from the past throughput by not only considering the aleatoric uncertainty (e.g., noise), but also capturing the epistemic uncertainty incurred by lack of adequate training samples. We further show that by using the negative log-likelihood loss function to train this BNN-based throughput predictor, the generalization error can be minimized with the guarantee of PAC-Bayesian theorem. Rather than a point estimate, the learnt uncertainty can contribute to a confidence region for the future throughput, the lower bound of which then leads to an uncertainty-aware robust MPC strategy to maximize the worst-case user quality-of-experience (QoE) w.r.t. this confidence region. Finally, experimental results on three real-world network trace datasets validate the efficiency of both the proposed BNN-based predictor and uncertainty-aware robust MPC strategy, and demonstrate the superior performance compared to other baselines, in terms of both the overall QoE performance and generalization across all ranges of heterogeneous network and user conditions.

References

[1]
Zahaib Akhtar, Yun Seong Nam, Ramesh Govindan, Sanjay Rao, Jessica Chen, Ethan Katz-Bassett, Bruno Ribeiro, Jibin Zhan, and Hui Zhang. 2018. Oboe: Auto-Tuning Video ABR Algorithms to Network Conditions. In Proceedings of the 2018 Conference of the ACM Special Interest Group on Data Communication. New York, NY, USA, 44--58.
[2]
Pierre Alquier, James Ridgway, and Nicolas Chopin. 2016. On the Properties of Variational Approximations of Gibbs Posteriors. Journal of Machine Learning Research 17, 236 (2016), 1--41.
[3]
Abdelhak Bentaleb, Christian Timmerer, Ali C. Begen, and Roger Zimmermann. 2019. Bandwidth Prediction in Low-Latency Chunked Streaming. In Proceedings of the 29th ACM Workshop on Network and Operating Systems Support for Digital Audio and Video. New York, NY, USA, 7--13.
[4]
Charles Blundell, Julien Cornebise, Koray Kavukcuoglu, and Daan Wierstra. 2015. Weight Uncertainty in Neural Network. In Proceedings of the 32nd International Conference on Machine Learning, Vol. 37. 1613--1622.
[5]
Kurtland Chua, Roberto Calandra, Rowan McAllister, and Sergey Levine. 2018. Deep Reinforcement Learning in a Handful of Trials Using Probabilistic Dynamics Models. In Advances in Neural Information Processing Systems. Red Hook, NY, USA, 4759--4770.
[6]
Federal Communications Commission. [n.d.]. Raw Data - Measuring Broadband America. (2016). https://www.fcc.gov/reports-research/reports/measuring-broadband-america/raw-data-measuring-broadband-america-2016.
[7]
Matteo Gadaleta, Federico Chiariotti, Michele Rossi, and Andrea Zanella. 2017. D-DASH: A Deep Q-Learning Framework for DASH Video Streaming. IEEE Transactions on Cognitive Communications and Networking 3, 4 (2017), 703--718.
[8]
Pascal Germain, Francis Bach, Alexandre Lacoste, and Simon Lacoste-Julien. 2016. PAC-Bayesian Theory Meets Bayesian Inference. In Advances in Neural Information Processing Systems, Vol. 29. 1884--1892.
[9]
Peter Henderson, Riashat Islam, Philip Bachman, Joelle Pineau, Doina Pre-cup, and David Meger. 2019. Deep Reinforcement Learning that Matters. arXiv:1709.06560 [cs.LG]
[10]
Tianchi Huang and Lifeng Sun. 2020. DeepMPC: A Mixture ABR Approach via Deep Learning and MPC. In Proceedings of the 2020 IEEE International Conference on Image Processing (ICIP). 1231--1235.
[11]
Tianchi Huang, Rui-Xiao Zhang, and Lifeng Sun. 2020. Self-Play Reinforcement Learning for Video Transmission. In Proceedings of the 30th ACM Workshop on Network and Operating Systems Support for Digital Audio and Video. New York, NY, USA, 7--13.
[12]
Te-Yuan Huang, Ramesh Johari, Nick McKeown, Matthew Trunnell, and Mark Watson. 2014. A Buffer-Based Approach to Rate Adaptation: Evidence from a Large Video Streaming Service. In Proceedings of the Conference of the ACM Special Interest Group on Data Communication. New York, NY, USA, 187--198.
[13]
Michael Janner, Justin Fu, Marvin Zhang, and Sergey Levine. 2019. When to Trust Your Model: Model-Based Policy Optimization. arXiv:1906.08253 [cs.LG]
[14]
Junchen Jiang, Vyas Sekar, and Hui Zhang. 2014. Improving Fairness, Efficiency, and Stability in HTTP-Based Adaptive Video Streaming With FESTIVE. IEEE/ACM Transactions on Networking 22, 1 (Feb 2014), 326--340.
[15]
Zhi Li, Xiaoqing Zhu, Joshua Gahm, Rong Pan, Hao Hu, Ali C. Begen, and David Oran. 2014. Probe and Adapt: Rate Adaptation for HTTP Video Streaming At Scale. IEEE Journal on Selected Areas in Communications 32, 4 (2014), 719--733.
[16]
Hongzi Mao, Ravi Netravali, and Mohammad Alizadeh. 2017. Neural Adaptive Video Streaming with Pensieve. In Proceedings of the Conference of the ACM Special Interest Group on Data Communication. New York, NY, USA, 197--210.
[17]
Haakon Riiser, Paul Vigmostad, Carsten Griwodz, and Pål Halvorsen. 2013. Commute Path Bandwidth Traces from 3G Networks: Analysis and Applications. In Proceedings of the 4th ACM Multimedia Systems Conference. New York, NY, USA, 114--118.
[18]
Satadal. Sengupta, Niloy Ganguly, Sandip Chakraborty, and Pradipta De. 2018. HotDASH: Hotspot Aware Adaptive Video Streaming Using Deep Reinforcement Learning. In 2018 IEEE 26th International Conference on Network Protocols (ICNP). 165--175.
[19]
Kevin Spiteri, Rahul Urgaonkar, and Ramesh Sitaraman. 2016. BOLA: Near-Optimal Bitrate Adaptation for Online Videos. In Proceedings of the 35th Annual IEEE International Conference on Computer Communications. 1--9.
[20]
Yi Sun, Xiaoqi Yin, Junchen Jiang, Vyas Sekar, Fuyuan Lin, Nanshu Wang, Tao Liu, and Bruno Sinopoli. 2016. CS2P: Improving Video Bitrate Selection and Adaptation with Data-Driven Throughput Prediction. In Proceedings of the Conference of the ACM Special Interest Group on Data Communication. New York, NY, USA, 272--285.
[21]
Xiaoqi Yin, Abhishek Jindal, Vyas Sekar, and Bruno Sinopoli. 2015. A Control-Theoretic Approach for Dynamic Adaptive Video Streaming over HTTP. In Proceedings of the 2015 ACM Conference on Special Interest Group on Data Communication. New York, NY, USA, 325--338.

Cited By

View all

Index Terms

  1. Uncertainty-aware robust adaptive video streaming with bayesian neural network and model predictive control

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Conferences
      NOSSDAV '21: Proceedings of the 31st ACM Workshop on Network and Operating Systems Support for Digital Audio and Video
      July 2021
      128 pages
      ISBN:9781450384353
      DOI:10.1145/3458306
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Sponsors

      In-Cooperation

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 02 July 2021

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. adaptive video streaming
      2. bayesian neural network (BNN)
      3. model predictive control (MPC)
      4. rate adaptation

      Qualifiers

      • Research-article

      Funding Sources

      Conference

      MMSys '21
      Sponsor:
      MMSys '21: 12th ACM Multimedia Systems Conference
      September 28 - October 1, 2021
      Istanbul, Turkey

      Acceptance Rates

      NOSSDAV '21 Paper Acceptance Rate 15 of 52 submissions, 29%;
      Overall Acceptance Rate 118 of 363 submissions, 33%

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)102
      • Downloads (Last 6 weeks)6
      Reflects downloads up to 20 Jan 2025

      Other Metrics

      Citations

      Cited By

      View all

      View Options

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Media

      Figures

      Other

      Tables

      Share

      Share

      Share this Publication link

      Share on social media