Work in Progress

Assessing Social Text Placement in Mixed Reality TV

Authors:

Florian Mathis,

Adalberto L. Simeone,

Mohamed KhamisAuthors Info & Claims

IMX '20: Proceedings of the 2020 ACM International Conference on Interactive Media Experiences

Pages 205 - 211

https://doi.org/10.1145/3391614.3399402

Published: 17 June 2020 Publication History

Abstract

TV experiences are often social, be it at-a-distance (through text) or in-person (through speech). Mixed Reality (MR) headsets offer new opportunities to enhance social communication during TV viewing by placing social artifacts (e.g. text) anywhere the viewer wishes, rather than being constrained to a smartphone or TV display. In this paper, we use VR as a test-bed to evaluate different text locations for MR TV specifically. We introduce the concepts of wall messages, below-screen messages, and egocentric messages in addition to state-of-the-art on-screen messages (i.e., subtitles) and controller messages (i.e., reading text messages on the mobile device) to convey messages to users during TV viewing experiences. Our results suggest that a) future MR systems that aim to improve viewers’ experience need to consider the integration of a communication channel that does not interfere with viewers’ primary task, that is watching TV, and b) independent of the location of text messages, users prefer to be in full control of them, especially when reading and responding to them. Our findings pave the way for further investigations towards social at-a-distance communication in Mixed Reality.

Supplementary Material

MP4 File (p205-mathis-supplement.mp4)

Download
78.57 MB

References

[1]

Caroline Baillard, Matthieu Fradet, Vincent Alleaume, Pierrick Jouet, and Anthony Laurent. 2017. Multi-Device Mixed Reality TV: A Collaborative Experience with Joint Use of a Tablet and a Headset. In Proceedings of the 23rd ACM Symposium on Virtual Reality Software and Technology (Gothenburg, Sweden) (VRST ’17). Association for Computing Machinery, New York, NY, USA, Article 67, 2 pages. https://doi.org/10.1145/3139131.3141196

Digital Library

[2]

VR Codex. 2020. VR AR Cmoar TV. Retrieved May 1, 2020 from https://www.vrcodex.com/vr-ar-cmoar-tv/

[3]

David Geerts. 2006. Comparing Voice Chat and Text Chat in a Communication Tool for Interactive Television. In Proceedings of the 4th Nordic Conference on Human-Computer Interaction: Changing Roles (Oslo, Norway) (NordiCHI ’06). Association for Computing Machinery, New York, NY, USA, 461–464. https://doi.org/10.1145/1182475.1182537

Digital Library

[4]

David Geerts and Dirk De Grooff. 2009. Supporting the Social Uses of Television: Sociability Heuristics for Social Tv. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Boston, MA, USA) (CHI ’09). Association for Computing Machinery, New York, NY, USA, 595–604. https://doi.org/10.1145/1518701.1518793

Digital Library

[5]

David Geerts, Gunner Harboe, and Noel Massey. 2007. Overview of Social TV Workshop. In 5th Euro iTV Conference, Amsterdam, Netherlands.

[6]

David Geerts, Rinze Leenheer, Dirk De Grooff, Joost Negenman, and Susanne Heijstraten. 2014. In Front of and behind the Second Screen: Viewer and Producer Perspectives on a Companion App. In Proceedings of the ACM International Conference on Interactive Experiences for TV and Online Video (Newcastle Upon Tyne, United Kingdom) (TVX ’14). Association for Computing Machinery, New York, NY, USA, 95–102. https://doi.org/10.1145/2602299.2602312

Digital Library

[7]

National Geographic. 2019. Geographic Documentary 2019 - Islands of Europe. Retrieved May 1, 2020 from https://www.youtube.com/watch?v=KIr71WzILxo

[8]

Gene V Glass, Percy D Peckham, and James R Sanders. 1972. Consequences of failure to meet assumptions underlying the fixed effects analyses of variance and covariance. Review of educational research 42, 3 (1972), 237–288. https://doi.org/10.2307/1169991

[9]

Sandra G Hart. 2006. NASA-task load index (NASA-TLX); 20 years later. In Proceedings of the human factors and ergonomics society annual meeting, Vol. 50. Sage publications Sage CA: Los Angeles, CA, 904–908. https://doi.org/10.1177/154193120605000909

[10]

Michael R Harwell, Elaine N Rubinstein, William S Hayes, and Corley C Olds. 1992. Summarizing Monte Carlo results in methodological research: The one-and two-factor fixed effects ANOVA cases. Journal of educational statistics 17, 4 (1992), 315–339. https://doi.org/10.3102/10769986017004315

[11]

Com Hem. 2016. Com Hem Labs Testing TV platform in VR environment. Retrieved May 1, 2020 from https://news.cision.com/com-hem-sweden-ab--publ-/r/com-hem-labs-testing-tv-platform-in-vr-environment,c2029700

[12]

Elaine M. Huang, Gunnar Harboe, Joe Tullio, Ashley Novak, Noel Massey, Crysta J. Metcalf, and Guy Romano. 2009. Of Social Television Comes Home: A Field Study of Communication Choices and Practices in Tv-Based Text and Voice Chat. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Boston, MA, USA) (CHI ’09). Association for Computing Machinery, New York, NY, USA, 585–594. https://doi.org/10.1145/1518701.1518792

Digital Library

[13]

Chris Hughes, Mario Montagud Climent, and Peter tho Pesch. 2019. Disruptive Approaches for Subtitling in Immersive Environments. In Proceedings of the 2019 ACM International Conference on Interactive Experiences for TV and Online Video(Salford (Manchester), United Kingdom) (TVX ’19). Association for Computing Machinery, New York, NY, USA, 216–229. https://doi.org/10.1145/3317697.3325123

Digital Library

[14]

Lisa M Lix, Joanne C Keselman, and HJ Keselman. 1996. Consequences of assumption violations revisited: A quantitative review of alternatives to the one-way analysis of variance F test. Review of educational research 66, 4 (1996), 579–619. https://doi.org/10.2307/1170654

[15]

Mark McGill, Florian Mathis, Julie Williamson, and Mohamed Khamis. 2020. Augmenting TV Viewing using Acoustically Transparent Auditory Headsets. In Proceedings of the 2020 ACM International Conference on Interactive Media Experiences(Cornella, Barcelona, Spain) (IMX ’20). Association for Computing Machinery, New York, NY, USA. https://doi.org/10.1145/3391614.3393650

Digital Library

[16]

Mark McGill, John H. Williamson, and Stephen Brewster. 2016. Examining The Role of Smart TVs and VR HMDs in Synchronous At-a-Distance Media Consumption. ACM Trans. Comput.-Hum. Interact. 23, 5, Article 33 (Nov. 2016), 57 pages. https://doi.org/10.1145/2983530

Digital Library

[17]

Mark McGill, John H. Williamson, and Stephen A. Brewster. 2015. A review of collocated multi-user TV. Personal and Ubiquitous Computing 19, 5-6 (August 2015), 743–759. https://doi.org/10.1007/s00779-015-0860-1

[18]

Netflix Party. 2020. Netflix Party: A new way to watch Netflix. Retrieved May 1, 2020 from https://www.netflixparty.com/

[19]

Dan Price. 2020. How to Watch Netflix With Friends Far Away: 7 Methods That Work. Retrieved May 1, 2020 from https://www.makeuseof.com/tag/watch-netflix-with-friends-far-away/

[20]

Sylvia Rothe, Kim Tran, and Heinrich Hußmann. 2018. Dynamic Subtitles in Cinematic Virtual Reality. In Proceedings of the 2018 ACM International Conference on Interactive Experiences for TV and Online Video (SEOUL, Republic of Korea) (TVX ’18). Association for Computing Machinery, New York, NY, USA, 209–214. https://doi.org/10.1145/3210825.3213556

Digital Library

[21]

Rufat Rzayev, Sven Mayer, Christian Krauter, and Niels Henze. 2019. Notification in VR: The Effect of Notification Placement, Task and Environment. In Proceedings of the Annual Symposium on Computer-Human Interaction in Play (Barcelona, Spain) (CHI PLAY ’19). Association for Computing Machinery, New York, NY, USA, 199–211. https://doi.org/10.1145/3311350.3347190

Digital Library

[22]

Pejman Saeghe, Sarah Clinch, Bruce Weir, Maxine Glancy, Vinoba Vinayagamoorthy, Ollie Pattinson, Stephen Robert Pettifer, and Robert Stevens. 2019. Augmenting Television With Augmented Reality. In Proceedings of the 2019 ACM International Conference on Interactive Experiences for TV and Online Video (Salford (Manchester), United Kingdom) (TVX ’19). Association for Computing Machinery, New York, NY, USA, 255–261. https://doi.org/10.1145/3317697.3325129

Digital Library

[23]

J Saldaña. 2015. The coding manual for qualitative researchers. Sage.

[24]

Steven Schirra, Huan Sun, and Frank Bentley. 2014. Together Alone: Motivations for Live-Tweeting a Television Series. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Toronto, Ontario, Canada) (CHI ’14). Association for Computing Machinery, New York, NY, USA, 2441–2450. https://doi.org/10.1145/2556288.2557070

Digital Library

[25]

Statista. 2018. Total number of TV households in the United Kingdom from 2004 to 2018. Retrieved May 1, 2020 from https://www.statista.com/statistics/269969/number-of-tv-households-in-the-uk/

[26]

William G. Stillwell, David A. Seaver, and Ward Edwards. 1981. A comparison of weight approximation techniques in multiattribute utility decision making. Organizational Behavior and Human Performance 28, 1(1981), 62 – 77. https://doi.org/10.1016/0030-5073(81)90015-5

[27]

Pei-Yun Tu, Mei-Ling Chen, Chi-Lan Yang, and Hao-Chuan Wang. 2016. Co-Viewing Room: Mobile TV Content Sharing in Social Chat. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems (San Jose, California, USA) (CHI EA ’16). Association for Computing Machinery, New York, NY, USA, 1615–1621. https://doi.org/10.1145/2851581.2892476

Digital Library

[28]

Unity Technologies. 2020. Unity Game Engine. Retrieved May 1, 2020 from https://unity3d.com/

[29]

Radu-Daniel Vatavu. 2013. There’s a World Outside Your TV: Exploring Interactions beyond the Physical TV Screen. In Proceedings of the 11th European Conference on Interactive TV and Video (Como, Italy) (EuroITV ’13). Association for Computing Machinery, New York, NY, USA, 143–152. https://doi.org/10.1145/2465958.2465972

Digital Library

[30]

Justin D. Weisz, Sara Kiesler, Hui Zhang, Yuqing Ren, Robert E. Kraut, and Joseph A. Konstan. 2007. Watching Together: Integrating Text Chat with Video. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (San Jose, California, USA) (CHI ’07). Association for Computing Machinery, New York, NY, USA, 877–886. https://doi.org/10.1145/1240624.1240756

Digital Library

[31]

Julie R. Williamson, Mark McGill, and Khari Outram. 2019. PlaneVR: Social Acceptability of Virtual Reality for Aeroplane Passengers. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). Association for Computing Machinery, New York, NY, USA, Article 80, 14 pages. https://doi.org/10.1145/3290605.3300310

Digital Library

Cited By

Yangfu RZhiqiang LSonghai Z(2024)Survey of visualization methods for multiscene visual cue information in immersive environmentsJournal of Image and Graphics10.11834/jig.22114729:1(1-21)Online publication date: 2024
https://doi.org/10.11834/jig.221147
Mack NSchümmer FRose MTobias M(2024)Evaluating Text Placement in Information-Rich Virtual Environments: A User Study on Controller-Anchored TextProceedings of the 13th Nordic Conference on Human-Computer Interaction10.1145/3679318.3685400(1-10)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3679318.3685400
Mathis F(2024)Everyday Life Challenges and Augmented Realities: Exploring Use Cases For, and User Perspectives on, an Augmented Everyday LifeProceedings of the Augmented Humans International Conference 202410.1145/3652920.3652921(52-62)Online publication date: 4-Apr-2024
https://dl.acm.org/doi/10.1145/3652920.3652921
Show More Cited By

Recommendations

Multi-screen cloud social TV: transforming TV experience into 21st century
MM '13: Proceedings of the 21st ACM international conference on Multimedia

Nowadays, TV experience has been transformed from the traditional "laid-back" video watching experience to a "lean-forward" social and multi-screen experience. In this demo, we design and develop a multi-screen cloud social TV system in response to this ...
Multi-device mixed reality TV: a collaborative experience with joint use of a tablet and a headset
VRST '17: Proceedings of the 23rd ACM Symposium on Virtual Reality Software and Technology

A multi-user experience extending a standard TV content with AR elements is presented. It runs with both a standard tablet and a premium MR headset, the Microsoft HoloLens. A virtual TV mosaic is displayed around the TV screen and used as a GUI to ...
How "social" is Social TV? The influence of social motives and expected outcomes on the usage of Social TV applications

The study analyzes the predictors of Social TV usage via different platforms.Social TV usage is spurred by the motive to communicate and the expectation of enjoyment and social gratification.Besides Twitter, instant messaging systems emerge as important ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

IMX '20: Proceedings of the 2020 ACM International Conference on Interactive Media Experiences

June 2020

211 pages

ISBN:9781450379762

DOI:10.1145/3391614

Copyright © 2020 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 17 June 2020

Check for updates

Author Tags

Qualifiers

Work in progress
Research
Refereed limited

Funding Sources

Royal Society of Edinburgh

Conference

IMX '20

Sponsor:

IMX '20: ACM International Conference on Interactive Media Experiences

June 17 - 19, 2020

Cornella, Barcelona, Spain

Acceptance Rates

Overall Acceptance Rate 69 of 245 submissions, 28%

Upcoming Conference

IMX '25

Sponsor:
sigchi

ACM International Conference on Interactive Media Experiences

June 3 - 6, 2025

Niter?i , Brazil

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

8
Total Citations
View Citations
271
Total Downloads

Downloads (Last 12 months)28
Downloads (Last 6 weeks)3

Reflects downloads up to 28 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Yangfu RZhiqiang LSonghai Z(2024)Survey of visualization methods for multiscene visual cue information in immersive environmentsJournal of Image and Graphics10.11834/jig.22114729:1(1-21)Online publication date: 2024
https://doi.org/10.11834/jig.221147
Mack NSchümmer FRose MTobias M(2024)Evaluating Text Placement in Information-Rich Virtual Environments: A User Study on Controller-Anchored TextProceedings of the 13th Nordic Conference on Human-Computer Interaction10.1145/3679318.3685400(1-10)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3679318.3685400
Mathis F(2024)Everyday Life Challenges and Augmented Realities: Exploring Use Cases For, and User Perspectives on, an Augmented Everyday LifeProceedings of the Augmented Humans International Conference 202410.1145/3652920.3652921(52-62)Online publication date: 4-Apr-2024
https://dl.acm.org/doi/10.1145/3652920.3652921
Auda JGruenefeld UFaltaous SMayer SSchneegass S(2023)A Scoping Survey on Cross-reality SystemsACM Computing Surveys10.1145/361653656:4(1-38)Online publication date: 21-Oct-2023
https://dl.acm.org/doi/10.1145/3616536
Mack NHeun MRose M(2023)Head-anchored text placements and cognitive load in information-rich virtual environmentsProceedings of Mensch und Computer 202310.1145/3603555.3603575(27-36)Online publication date: 3-Sep-2023
https://dl.acm.org/doi/10.1145/3603555.3603575
Belani MSingh HParnami ASingh P(2023)Investigating Spatial Representation of Learning Content in Virtual Reality Learning Environments2023 IEEE Conference Virtual Reality and 3D User Interfaces (VR)10.1109/VR55154.2023.00019(33-43)Online publication date: Mar-2023
https://doi.org/10.1109/VR55154.2023.00019
O'Hagan JKhamis MMcGill MWilliamson J(2022)Exploring Attitudes Towards Increasing User Awareness of Reality From Within Virtual RealityProceedings of the 2022 ACM International Conference on Interactive Media Experiences10.1145/3505284.3529971(151-160)Online publication date: 21-Jun-2022
https://dl.acm.org/doi/10.1145/3505284.3529971
Auda JGruenefeld USchneegass S(2022)If The Map Fits! Exploring Minimaps as Distractors from Non-Euclidean Spaces in Virtual RealityExtended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491101.3519621(1-6)Online publication date: 27-Apr-2022
https://dl.acm.org/doi/10.1145/3491101.3519621

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Figures

Tables

Media

View Table of Conten