research-article

Navigation Graph for Tiled Media Streaming

Authors:

Klara NahrstedtAuthors Info & Claims

MM '19: Proceedings of the 27th ACM International Conference on Multimedia

Pages 447 - 455

https://doi.org/10.1145/3343031.3351021

Published: 15 October 2019 Publication History

Abstract

After the emergence of video streaming services, more creative and diverse multimedia content has become available, and now the capability of streaming 360-degree videos will open a new era of multimedia experiences. However, streaming these videos requires larger bandwidth and less latency than what is found in conventional video streaming systems. Rate adaptation of tiled videos and view prediction techniques are used to solve this problem. In this paper, we introduce the Navigation Graph, which models viewing behaviors in the temporal (segments) and the spatial (tiles) domains to perform the rate adaptation of tiled media associated with the view prediction. The Navigation Graph allows clients to perform view prediction more easily by sharing the viewing model in the same way in which media description information is shared in DASH. It is also useful for encoding the trajectory information in the media description file, which could also allow for more efficient navigation of 360-degree videos. This paper provides information about the creation of the Navigation Graph and its uses. The performance evaluation shows that the Navigation Graph based view prediction and rate adaptation outperform other existing tiled media streaming solutions. Navigation Graph is not limited to 360-degree video streaming applications, but it can also be applied to other tiled media streaming systems, such as volumetric media streaming for augmented reality applications.

References

[1]

Mathias Almquist, Viktor Almquist, Vengatanathan Krishnamoorthi, Niklas Carlsson, and Derek Eager. 2018. The Prefetch Aggressiveness Tradeoff in 360&Deg; Video Streaming. In Proceedings of the 9th ACM Multimedia Systems Conference (MMSys '18). ACM, New York, NY, USA, 258--269. https://doi.org/10.1145/3204949. 3204970

Digital Library

[2]

Y. Bao, H. Wu, T. Zhang, A. A. Ramli, and X. Liu. 2016. Shooting a moving target: Motion-prediction-based transmission for 360-degree videos. In 2016 IEEE International Conference on Big Data (Big Data). 1161--1170. https://doi.org/10. 1109/BigData.2016.7840720

[3]

F. Bellard. https://www.ffmpeg.org. (FFmpeg https://www.ffmpeg.org).

[4]

W. Chenglei, T. Zhihao, W. Zhi, and Y. Shiqiang. 2017. A Dataset for Exploring User Behaviors in VR Spherical Video Streaming. In Proceedings of the 8th ACM on Multimedia Systems Conference (MMSys'17). ACM, New York, NY, USA, 193--198. https://doi.org/10.1145/3083187.3083210

[5]

V. R. Gaddam, M. Riegler, R. Eg, C. Griwodz, and P. Halvorsen. 2016. Tiling in Interactive Panoramic Video: Approaches and Evaluation. IEEE Transactions on Multimedia 18, 9 (Sep. 2016), 1819--1831. https://doi.org/10.1109/TMM.2016. 2586304

Digital Library

[6]

A. Ghosh, V. Aggarwal, and F. Qian. 2018. A Robust Algorithm for Tile-based 360- degree Video Streaming with Uncertain FoV Estimation. CoRR abs/1812.00816 (2018). arXiv:1812.00816 http://arxiv.org/abs/1812.00816

[7]

M. Hosseini and V. Swaminathan. 2016. Adaptive 360 VR Video Streaming Based on MPEG-DASH SRD. In 2016 IEEE International Symposium on Multimedia (ISM). 407--408. https://doi.org/10.1109/ISM.2016.0093

[8]

K. Misra, A. Segall, M. Horowitz, S. Xu, A. Fuldseth, and M. Zhou. 2013. An Overview of Tiles in HEVC. IEEE Journal of Selected Topics in Signal Processing 7, 6 (Dec 2013), 969--977. https://doi.org/10.1109/JSTSP.2013.2271451

[9]

J. Park. 2019. Video Streaming over the LWA Systems. In 2019 International Conference on Computing, Networking and Communications (ICNC). 597--601. https://doi.org/10.1109/ICCNC.2019.8685626

[10]

J. Park, P. A. Chou, and J. Hwang. 2018. Volumetric Media Streaming for Augmented Reality. In 2018 IEEE Global Communications Conference (GLOBECOM). 1--6. https://doi.org/10.1109/GLOCOM.2018.8647537

[11]

J. Park, P. A. Chou, and J. Hwang. 2019. Rate-Utility Optimized Streaming of Volumetric Media for Augmented Reality. IEEE Journal on Emerging and Selected Topics in Circuits and Systems 9, 1 (March 2019), 149--162. https://doi.org/10.1109/ JETCAS.2019.2898622

[12]

J. Park, J. Hwang, and H. Wei. 2018. Cross-Layer Optimization for VR Video Multicast Systems. In 2018 IEEE Global Communications Conference (GLOBECOM). 206--212. https://doi.org/10.1109/GLOCOM.2018.8647389

[13]

R. A. Patrice, M. Jean-Franois, and V. Nico. 2012. Interactive Omnidirectional Video Delivery: A Bandwidth-Effective Approach. Bell Lab. Tech. J. 16, 4 (March 2012), 135--147. https://doi.org/10.1002/bltj.20538

[14]

R.Haakon, E. Tore, V Paul, G. Carsten, and H. Paul. 2012. Video Streaming Using a Location-based Bandwidth-lookup Service for Bitrate Planning. ACM Trans. Multimedia Comput. Commun. Appl. 8, 3, Article 24 (Aug. 2012), 19 pages. https://doi.org/10.1145/2240136.2240137

[15]

L. Sun, F. Duanmu, Y. Liu, Y. Wang, Y. Ye, H. Shi, and D. Dai. 2019. A Two-Tier System for On-Demand Streaming of 360 Degree Video Over Dynamic Networks. IEEE Journal on Emerging and Selected Topics in Circuits and Systems 9, 1 (March 2019), 43--57. https://doi.org/10.1109/JETCAS.2019.2898877

[16]

P. Wydrych, K. Rusek, and P. Cholda. 2013. Efficient Modelling of Traffic and Quality of Scalable Video Coding (SVC) Encoded Streams. IEEE Communications Letters 17, 12 (2013), 2372--2375. https://doi.org/10.1109/LCOMM.2013.110613. 132163

[17]

C. Xavier, D. Francesca, and S. Gwendal. 2017. 360Degreee Video Head Movement Dataset. In Proceedings of the 8th ACM on Multimedia Systems Conference (MMSys'17). ACM, New York, NY, USA, 199--204. https://doi.org/10.1145/3083187. 3083215

[18]

M. Xiao, C. Zhou, V. Swaminathan, Y. Liu, and S. Chen. 2018. BAS-360 : Exploring Spatial and Temporal Adaptability in 360-degree Videos over HTTP/2. In IEEE INFOCOM 2018 - IEEE Conference on Computer Communications. 953--961. https: //doi.org/10.1109/INFOCOM.2018.8486390

[19]

L. Xie, Z. Xu, Y. Ban, X. Zhang, and Z. Guo. 2017. 360ProbDASH: Improving QoE of 360 Video Streaming Using Tile-based HTTP Adaptive Streaming. In Proceedings of the 25th ACM International Conference on Multimedia (MM '17). ACM, New York, NY, USA, 315--323. https://doi.org/10.1145/3123266.3123291

[20]

L. Xie, X. Zhang, and Z. Guo. 2018. CLS: A Cross-user Learning Based System for Improving QoE in 360-degree Video Adaptive Streaming. In Proceedings of the 26th ACM International Conference on Multimedia (MM '18). ACM, New York, NY, USA, 564--572. https://doi.org/10.1145/3240508.3240556

[21]

M. Xu, Y. Song, J. Wang, M. Qiao, L. Huo, and Z. Wang. 2018. Predicting Head Movement in Panoramic Video: A Deep Reinforcement Learning Approach. IEEE Transactions on Pattern Analysis and Machine Intelligence (2018), 1--1. https: //doi.org/10.1109/TPAMI.2018.2858783

[22]

M. Yu, H. Lakshman, and B. Girod. 2015. A Framework to Evaluate Omnidirectional Video Coding Schemes. In 2015 IEEE International Symposium on Mixed and Augmented Reality. 31--36. https://doi.org/10.1109/ISMAR.2015.12

Digital Library

Cited By

Zeynali AHajiesmaili MSitaraman R(2024)BOLA360Proceedings of the 15th ACM Multimedia Systems Conference10.1145/3625468.3647607(12-22)Online publication date: 15-Apr-2024
https://dl.acm.org/doi/10.1145/3625468.3647607
Zhang YKutscher DCui Y(2024)Networked Metaverse Systems: Foundations, Gaps, Research DirectionsIEEE Open Journal of the Communications Society10.1109/OJCOMS.2024.34260985(5488-5539)Online publication date: 2024
https://doi.org/10.1109/OJCOMS.2024.3426098
Ahmed ASiddique FSkadron K(2024)GraphTango: A Hybrid Representation Format for Efficient Streaming Graph Updates and AnalysisInternational Journal of Parallel Programming10.1007/s10766-024-00768-x52:3(147-170)Online publication date: 18-May-2024
https://doi.org/10.1007/s10766-024-00768-x
Show More Cited By

Index Terms

Navigation Graph for Tiled Media Streaming
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms
      1. Virtual reality
2. Information systems
  1. Information systems applications
    1. Multimedia information systems
      1. Multimedia streaming

Recommendations

Improving Server and Client-Side Algorithms for Adaptive Streaming of Non-Immersive and Immersive Media
MMSys '21: Proceedings of the 12th ACM Multimedia Systems Conference

HTTP adaptive streaming is a technique widely used in the internet today to stream live and on-demand content. Server and client-side algorithms play an important role in achieving a better user experience in terms of metrics such as latency, ...
Effective client-driven three-level rate adaptation (TLRA) approach for adaptive HTTP streaming

Multimedia streaming allows consumers to view multimedia content anywhere. However, quality of service is a major concern amid heightened levels of network traffic caused by increasing user demand. Accordingly, media streaming technology is adopting a ...
Adaptive streaming of interactive free viewpoint videos to heterogeneous clients
MMSys '16: Proceedings of the 7th International Conference on Multimedia Systems

Recent advances in video capturing and rendering technologies have paved the way for new video streaming applications. Free-viewpoint video (FVV) streaming is one such application where users are able to interact with the scene by navigating to ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

MM '19: Proceedings of the 27th ACM International Conference on Multimedia

October 2019

2794 pages

ISBN:9781450368896

DOI:10.1145/3343031

General Chairs:
Laurent Amsaleg
CNRS-IRISA, France
,
Benoit Huet
EURECOM, France
,
Martha Larson
Radboud University and TU Delft (Netherlands)
,
Program Chairs:
Guillaume Gravier
CNRS-IRISA, France
,
Hayley Hung
Delft University of Technology Netherlands
,
Chong-Wah Ngo
City University of Hong Kong Hong Kong
,
Wei Tsang Ooi
National University of Singapore Singapore

Copyright © 2019 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGMM: ACM Special Interest Group on Multimedia

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 15 October 2019

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Ralf and Catherine Fisher Gift Funding
Coordinated Science Laboratory
Grainger College of Engineering

Conference

MM '19

Sponsor:

SIGMM

MM '19: The 27th ACM International Conference on Multimedia

October 21 - 25, 2019

Nice, France

Acceptance Rates

MM '19 Paper Acceptance Rate 252 of 936 submissions, 27%;

Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

20
Total Citations
View Citations
499
Total Downloads

Downloads (Last 12 months)20
Downloads (Last 6 weeks)2

Reflects downloads up to 26 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Zeynali AHajiesmaili MSitaraman R(2024)BOLA360Proceedings of the 15th ACM Multimedia Systems Conference10.1145/3625468.3647607(12-22)Online publication date: 15-Apr-2024
https://dl.acm.org/doi/10.1145/3625468.3647607
Zhang YKutscher DCui Y(2024)Networked Metaverse Systems: Foundations, Gaps, Research DirectionsIEEE Open Journal of the Communications Society10.1109/OJCOMS.2024.34260985(5488-5539)Online publication date: 2024
https://doi.org/10.1109/OJCOMS.2024.3426098
Ahmed ASiddique FSkadron K(2024)GraphTango: A Hybrid Representation Format for Efficient Streaming Graph Updates and AnalysisInternational Journal of Parallel Programming10.1007/s10766-024-00768-x52:3(147-170)Online publication date: 18-May-2024
https://doi.org/10.1007/s10766-024-00768-x
Rizk AHellwagner HTimmerer CZink M(2024)Adaptivity in Video Streaming Through the Transition LensFrom Multimedia Communications to the Future Internet10.1007/978-3-031-71874-8_3(31-45)Online publication date: 13-Sep-2024
https://doi.org/10.1007/978-3-031-71874-8_3
Huang XRiddell JXiao R(2023)Virtual Reality Telepresence: 360-Degree Video Streaming with Edge-Compute Assisted Static Foveated CompressionIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.332025529:11(4525-4534)Online publication date: Nov-2023
https://doi.org/10.1109/TVCG.2023.3320255
Wang LLi CDai WLi SZou JXiong H(2023)QoE-Driven Adaptive Streaming for Point CloudsIEEE Transactions on Multimedia10.1109/TMM.2022.314858525(2543-2558)Online publication date: 2023
https://doi.org/10.1109/TMM.2022.3148585
Abdelzaher TCaesar MMendis CNahrstedt KSrivastava MYu M(2023)Challenges in Metaverse Research: An Internet of Things Perspective2023 IEEE International Conference on Metaverse Computing, Networking and Applications (MetaCom)10.1109/MetaCom57706.2023.00042(161-170)Online publication date: Jun-2023
https://doi.org/10.1109/MetaCom57706.2023.00042
Zhang YWu MTian BLi JChen BZhou QNahrstedt K(2023)SAVG360: Saliency-aware Viewport-guidance-enabled 360-video Streaming System2023 IEEE International Symposium on Multimedia (ISM)10.1109/ISM59092.2023.00011(36-43)Online publication date: 11-Dec-2023
https://doi.org/10.1109/ISM59092.2023.00011
Lan CQiu XMiao CZheng M(2023)A self-attention model for viewport prediction based on distance constraintThe Visual Computer10.1007/s00371-023-03149-640:9(5997-6014)Online publication date: 28-Nov-2023
https://doi.org/10.1007/s00371-023-03149-6
Zhou QYang ZGuo HTian BNahrstedt KJiang SAizawa KChen PYanai K(2022)360BroadViewProceedings of the 4th ACM International Conference on Multimedia in Asia10.1145/3551626.3564939(1-7)Online publication date: 13-Dec-2022
https://dl.acm.org/doi/10.1145/3551626.3564939
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents