research-article

Toward an Adaptive Screencast Platform: Measurement and Optimization

Authors:

Ching-Ling Fan,

Tsung-Han Tsai,

Chun-Ying Huang,

Cheng-Hsin Hsu,

Kuan-Ta ChenAuthors Info & Claims

ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM), Volume 12, Issue 5s

Article No.: 79, Pages 1 - 23

https://doi.org/10.1145/2886778

Published: 08 November 2016 Publication History

Abstract

The binding between computing devices and displays is becoming dynamic and adaptive, and screencast technologies enable such binding over wireless networks. In this article, we design and conduct the first detailed measurement study on the performance of the state-of-the-art screencast technologies. Several commercial and one open-source screencast technologies are considered in our detailed analysis, which leads to several insights: (1) there is no single winning screencast technology, indicating room to further enhance the screencast technologies; (2) hardware video encoders significantly reduce the CPU usage at the expense of slightly higher GPU usage and end-to-end delay, and should be adopted in future screencast technologies; (3) comprehensive error resilience tools are needed as wireless communication is vulnerable to packet loss; (4) emerging video codecs designed for screen contents lead to a better Quality of Experience (QoE) of screencast; and (5) rate adaptation mechanisms are critical to avoiding degraded QoE due to network dynamics. As a case study, we propose a nonintrusive yet accurate available bandwidth estimation mechanism. Real experiments demonstrate the practicality and efficiency of our proposed solution. Our measurement methodology, open-source screencast platform, and case study allow researchers and developers to quantitatively evaluate other design considerations, which will lead to optimized screencast technologies.

Supplementary Material

a79-hsu-apndx.pdf (hsu.zip)

Supplemental movie, appendix, image and software files for, Toward an Adaptive Screencast Platform: Measurement and Optimization

Download
341.77 KB

References

[1]

AirPlay. 2014. AirPlay--Play Content from iOS devices on Android TV. Retrieved from https://www.apple.com/airplay/.

[2]

R. Baratto, L. Kim, and J. Nieh. 2005. THINC: A virtual display architecture for thin-client computing. In Proc. of ACM Symposium on Operating Systems Principles (SOSP’05). 277--290.

Digital Library

[3]

K. Calagari, M. Pakravan, S. Shirmohammadi, and M. Hefeeda. 2014. ALP: Adaptive loss protection scheme with constant overhead for interactive video applications. ACM Transactions on Multimedia Computing, Communications, and Applications 11, 2 (December 2014), 25:1--25:23.

Digital Library

[4]

S. Chandra, J. Biehl, J. Boreczky, S. Carter, and L. Rowe. 2012. Understanding screen contents for building a high performance, real time screen sharing system. In Proc. of ACM Multimedia Conference (MM’12). 389--398.

Digital Library

[5]

S. Chandra, J. Boreczky, and L. Rowe. 2014. High performance many-to-many intranet screen sharing with displaycast. ACM Transactions on Multimedia Computing, Communications, and Applications 10, 2 (February 2014), 19:1--19:22.

Digital Library

[6]

Y. Chang, P. Tseng, K. Chen, and C. Lei. 2011. Understanding the performance of thin-client gaming. In Proc. of IEEE International Workshop Technical Committee on Communications Quality and Reliability (CQR’11). 1--6.

[7]

K. Chen, Y. Chang, H. Hsu, D. Chen, C. Huang, and C. Hsu. 2014. On the quality of service of cloud gaming systems. IEEE Transactions on Multimedia 16, 2 (February 2014), 480--495.

Digital Library

[8]

Chromecast Web Page. 2014. Chromecast Web Page. http://www.google.com/chrome/devices/chromecast/.

[9]

M. Claypool, D. Finkel, A. Grant, and M. Solano. 2012. Thin to win? Network performance analysis of the OnLive thin client game system. In Proc. of ACM Workshop on Network and Systems Support for Games (NetGames’12). 22--23.

Digital Library

[10]

B. Cumberland, A. Muir, and G. Carius. 1999. Microsoft Windows NT server 4.0 terminal server edition technical reference. Microsoft Press.

[11]

A. Farshad, M. Lee, M. Marina, and F. Garcia. 2014. On the impact of 802.11n frame aggregation on end-to-end available bandwidth estimation. In Proc. of IEEE International Conference on Sensing, Communication, and Networking (SECON’14). 108--116.

[12]

GaiKai Web Page. 2012. GaiKai Web Page. Retrieved from http://www.gaikai.com/.

[13]

GamingAnywhere Web Page. 2013. GamingAnywhere: An Open Source Cloud Gaming Project. Retrieved from http://gaminganywhere.org.

[14]

Y. He, K. Fei, G. Fernandez, and E. Delp. 2014. Video quality assessment for web content mirroring. In Proc. of Imaging and Multimedia Analytics in a Web and Mobile World. 9027--11.

[15]

HEVC Test Model. 2014. HEVC Test Model (HM) Documentation. Retrieved from http://hevc.hhi.fraunhofer.de/HM-doc/.

[16]

H. Hong, C. Hsu, T. Tsai, C. Huang, K. Chen, and C. Hsu. 2015. Enabling adaptive cloud gaming in an open-source cloud gaming platform. IEEE Transactions on Circuits and Systems for Video Technology 25, 12 (December 2015), 2078--2091.

Digital Library

[17]

C. Hsu, T. Tsai, C. Huang, C. Hsu, and K. Chen. 2015. Screencast dissected: Performance measurements and design considerations. In Proc. of ACM Multimedia Systems Conference (MMSys’15). 177--188.

Digital Library

[18]

C. Huang, K. Chen, D. Chen, H. Hsu, and C. Hsu. 2014. GamingAnywhere: The first open source cloud gaming system. ACM Transactions on Multimedia Computing, Communications, and Applications 10, 1 (January 2014 ), 10:1--10:25.

Digital Library

[19]

C. Huang, C. Hsu, T. Tsai, C. Fan, C. Hsu, and K. Chen. 2015. Smart Beholder: An open-source smart lens for mobile photography. In Proc. of ACM Multimedia Conference (MM’15). 351--360.

Digital Library

[20]

Intel Web Page. 2015. Intel Media Client Solution Web Page. Retrieved from https://software.intel.com/en-us/media-client-solutions.

[21]

Iperf Web Page. 2015. Iperf Web Page. Retrieved from https://iperf.fr/.

[22]

A. Javadtalab, M. Semsarzadeh, A. Khanchi, S. Shirmohammadi, and A. Yassine. 2015. Continuous one-way detection of available bandwidth changes for video streaming over best-effort networks. IEEE Transactions on Instrumentation and Measurement 64, 1 (January 2015), 190--203.

[23]

R. Kapoor, L. Chen, L. Lao, M. Gerla, and M. Sanadidi. 2004. CapProbe: A simple and accurate capacity estimation technique. In Proc. of ACM Conference on Applications, Technologies, Architectures, and Protocols for Computer Communication (SIGCOMM’04). 67--78.

Digital Library

[24]

L. Kleinrock. 1992. The latency/bandwidth tradeoff in gigabit networks. IEEE Communications Magazine 30, 4 (April 1992), 36--40.

Digital Library

[25]

H. Lagar-Cavilla, N. Tolia, E. Lara, M. Satyanarayanan, and D. O’Hallaron. 2007. Interactive resource-intensive applications made easy. In Proc. of the ACM/IFIP/USENIX International Conference on Middleware. 143--163.

Digital Library

[26]

M. Lai and J. Nieh. 2006. On the performance of wide-area thin-client computing. ACM Transactions on Computer Systems 24, 2 (May 2006), 175--209.

Digital Library

[27]

M. Li, M. Claypool, and R. Kinicki. 2008. WBest: A bandwidth estimation tool for IEEE 802.11 wireless networks. In Proc. of the IEEE Conference on Local Computer Networks (LCN’08). 374--381.

[28]

Y. Lin, W. Xie, L. Jin, and R. Shen. 2012. Content-adpative H. 264 rate control for live screencasting. In Proc. of the Visual Communications and Image Processing (VCIP’12). 1--6.

[29]

Markets. 2012. Global Market for Wi-Fi/WLAN, Wireless Display/Video, Mobile WiMAX 8 LTE (4G) and ZigBee Chipsets in Consumer Electronics 8 Automation Applications worth &dollar;20.4 Billion by 2017. Retrieved from http://www.marketsandmarkets.com/PressReleases/wireless-communication-chipsets.asp.

[30]

Markets. 2014. Flexible Display Market worth &dollar;3.89 Billion by 2020. Retrieved from http://www.marketsandmarkets.com/PressReleases/flexible-display.asp.

[31]

Miracast. 2014. Wi-Fi Certified Miracast. Retrieved from http://www.wi-fi.org/discover-wi-fi/wi-fi-certified-miracast.

[32]

MirrorOp Web Page. 2014. MirrorOp Web Page. Retrieved from http://www.mirrorop.com.

[33]

OnLive Web Page. 2012. OnLive Web Page. Retrieved from http://www.onlive.com/.

[34]

open-airplay. 2014. open-airplay: A collection of libraries for connecting over Apple’s AirPlay protocol. Retrieved from https://github.com/jamesdlow/open-airplay.

[35]

OpenH264 Web Page. 2015. OpenH264 Web Page. Retrieved from http://www.openh264.org/.

[36]

V. Ribeiro, R. Riedi, R. Baraniuk, J. Navratil, and L. Cottrell. 2003. PathChirp: Efficient available bandwidth estimation for network paths. In Proc. of Passive and Active Monitoring Workshop (PAM’03). 1--11.

[37]

T. Richardson, Q. Stafford-Fraser, R. Wood, and Hopper. 1998. Virtual network computing. IEEE Internet Computing 2, 1 (January 1998), 33--38.

Digital Library

[38]

J. Roskind. 2012. QUIC (Quick UDP Internet Connections), Multiplexed Stream Transport over UDP. Technical Report. Google technical report. Retrieved from https://www.ietf.org/proceedings/88/slides/slides-88-tsvarea-10.pdf.

[39]

K. Schmidt, M. Lam, and J. Northcutt. 1999. The interactive performance of SLIM: A stateless, thin-client architecture. In Proc. of ACM Symposium on Operating Systems Principles (SOSP’99). 32--47.

Digital Library

[40]

Splashtop. 2014. Splashtop Home Page. Retrieved from http://www.splashtop.com.

[41]

N. Tolia, D. Andersen, and M. Satyanarayanan. 2006. Quantifying interactive user experience on thin clients. Computer 39, 3 (March 2006), 46--52.

Digital Library

[42]

S. Tursunova, K. Inoyatov, and Y. Kim. 2010. Cognitive passive estimation of available bandwidth (cPEAB) in overlapped IEEE 802.11 WiFi WLANs. In Proc. of IEEE International Conference on Network Operations and Management Symposium (NOMS’10). 448--454.

[43]

Ubitus Web Page. 2014. Ubitus Web Page. Retrieved from http://www.ubitus.net.

[44]

Y. Wang, J. Ostermann, and Y. Zhang. 2001. Video Processing and Communications. Prentice Hall.

Digital Library

[45]

Z. Wang, A. Bovik, H. Sheikh, and E. Simoncelli. 2004. Image quality assessment: From error visibility to structural similarity. IEEE Transactions on Image Processing 13, 4 (April 2004), 600--612.

Digital Library

[46]

T. Wiegand, G. Sullivan, G. Bjntegaard, and A. Luthra. 2003. Overview of the H.264/AVC video coding standard. IEEE Transactions on Circuits and Systems for Video Technology 13, 7 (July 2003), 560--576.

Digital Library

[47]

C. Wu, K. Chen, Y. Chang, and C. Lei. 2013. Crowdsourcing multimedia QoE evaluation: A trusted framework. IEEE Transactions on Multimedia 15, 5 (August 2013), 1121--1137.

Digital Library

[48]

x264 Web Page. 2012. x264 Web Page. Retrieved from http://www.videolan.org/developers/x264.html.

[49]

x265 Web Page. 2014. x265 Web Page. Retrieved from http://x265.org.

[50]

K. Xu, K. Tang, R. Bagrodia, M. Gerla, and M. Bereschinsky. 2003. Adaptive bandwidth management and QoS provisioning in large scale ad hoc networks. In Proc. of IEEE Military Communications Conference (MILCOM’03), Vol. 2. 1018--1023.

Digital Library

[51]

S. Yang, J. Nieh, M. Selsky, and N. Tiwari. 2002. The performance of remote display mechanisms for thin-client computing. In Proc. of USENIX Annual Technical Conference (ATC’02). 131--146.

Digital Library

[52]

C. Zhang, X. Zhang, and R. Chandra. 2015. Energy efficient WiFi display. In Proc. of ACM International Conference on Mobile Systems, Applications, and Services (MobiSys’15). 405--418.

Digital Library

[53]

W. Zhu, W. Ding, J. Xu, Y. Shi, and B. Yin. 2014. Screen content coding based on HEVC framework. IEEE Transactions on Multimedia 16, 5 (August 2014), 1316--1326.

Cited By

Hsu CChang YHuang CLiu X(2022)Measuring Objective Visual Quality of Real-Time Communication Systems in the WildInternational Journal of Semantic Computing10.1142/S1793351X2240011616:02(257-280)Online publication date: 28-May-2022
https://doi.org/10.1142/S1793351X22400116
Huang CCheng YHuang GFan CHsu C(2021)On the Performance Comparisons of Native and Clientless Real-Time Screen-Sharing TechnologiesACM Transactions on Multimedia Computing, Communications, and Applications10.1145/343788117:2(1-26)Online publication date: 29-May-2021
https://dl.acm.org/doi/10.1145/3437881
Qi LSong HZhang XSrivastava GXu XYu S(2021)Compatibility-Aware Web API Recommendation for Mashup Creation via Textual Description MiningACM Transactions on Multimedia Computing, Communications, and Applications10.1145/341729317:1s(1-19)Online publication date: 31-Mar-2021
https://dl.acm.org/doi/10.1145/3417293
Show More Cited By

Index Terms

Toward an Adaptive Screencast Platform: Measurement and Optimization
1. Human-centered computing

Recommendations

Screencast dissected: performance measurements and design considerations
MMSys '15: Proceedings of the 6th ACM Multimedia Systems Conference

Dynamic and adaptive binding between computing devices and displays is increasingly more popular, and screencast technologies enable such binding over wireless networks. In this paper, we design and conduct the first detailed measurement study on the ...
On the Performance Comparisons of Native and Clientless Real-Time Screen-Sharing Technologies

Real-time screen-sharing provides users with ubiquitous access to remote applications, such as computer games, movie players, and desktop applications (apps), anywhere and anytime. In this article, we study the performance of different screen-sharing ...
An In-depth Performance Analysis and Optimization for Android Screencast
CSAE '18: Proceedings of the 2nd International Conference on Computer Science and Application Engineering

Screen content1 sharing and human-computer interaction across multiple devices (computers, smartTVs, smartphones, etc) are becoming increasingly popular. A typical scenario widely in use is screencast (or called remote display), in which the screen ...

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Multimedia Computing, Communications, and Applications

ACM Transactions on Multimedia Computing, Communications, and Applications Volume 12, Issue 5s

Special Section on Multimedia Big Data: Networking and Special Section on Best Papers From ACM MMSYS/NOSSDAV 2015

December 2016

288 pages

ISSN:1551-6857

EISSN:1551-6865

DOI:10.1145/3001754

Editor:
Alberto Del Bimbo
University of Firenze, Italy

Issue’s Table of Contents

Copyright © 2016 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 08 November 2016

Accepted: 01 December 2015

Revised: 01 December 2015

Received: 01 August 2015

Published in TOMM Volume 12, Issue 5s

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed

Funding Sources

Ministry of Science and Technology of Taiwan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
168
Total Downloads

Downloads (Last 12 months)8
Downloads (Last 6 weeks)1

Reflects downloads up to 14 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Hsu CChang YHuang CLiu X(2022)Measuring Objective Visual Quality of Real-Time Communication Systems in the WildInternational Journal of Semantic Computing10.1142/S1793351X2240011616:02(257-280)Online publication date: 28-May-2022
https://doi.org/10.1142/S1793351X22400116
Huang CCheng YHuang GFan CHsu C(2021)On the Performance Comparisons of Native and Clientless Real-Time Screen-Sharing TechnologiesACM Transactions on Multimedia Computing, Communications, and Applications10.1145/343788117:2(1-26)Online publication date: 29-May-2021
https://dl.acm.org/doi/10.1145/3437881
Qi LSong HZhang XSrivastava GXu XYu S(2021)Compatibility-Aware Web API Recommendation for Mashup Creation via Textual Description MiningACM Transactions on Multimedia Computing, Communications, and Applications10.1145/341729317:1s(1-19)Online publication date: 31-Mar-2021
https://dl.acm.org/doi/10.1145/3417293
Hsu CHuang CLiu X(2021)Measuring Objective Visual Quality of Real-time Communication Systems in the Wild2021 IEEE Seventh International Conference on Multimedia Big Data (BigMM)10.1109/BigMM52142.2021.00010(9-16)Online publication date: Nov-2021
https://doi.org/10.1109/BigMM52142.2021.00010

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents