article

The Effect of View Independence in a Collaborative AR System

Authors:

Mark BillinghurstAuthors Info & Claims

Computer Supported Cooperative Work, Volume 24, Issue 6

Pages 563 - 589

https://doi.org/10.1007/s10606-015-9231-8

Published: 01 December 2015 Publication History

Abstract

In this paper we describe a system for remote collaboration using Augmented Reality (AR) that supports view independence. The system was designed to allow a remote user to assist a local user in an object placement task. The remote helper can navigate the local user's scene independently from the local user by using a three-dimensional reconstruction of the environment. The remote user can also place virtual annotations in the scene that the local user views through a head mounted display. The system tracks the position of key physical objects and the local user's head pose, displaying both to the remote user. A key advantage of this system compared to other collaborative AR interfaces is that it allows the remote expert to have an independent view into the shared task space. A user study was performed using this system with the users completing a simple mostly two-dimensional object placement task. It was designed to test how the amount of remote view independence affected collaboration. Four conditions were used with varying degrees of view independence. It was found that increased view independence led to faster task completion time, more confidence from users, and a decrease in the amount of time spent communicating verbally during the task. However, varying the view independence did not significantly change the accuracy of the placement of objects. The implications of the results are discussed along with directions for future research.

References

[1]

Advanced Realtime Tracking GmbH (n.d.). DTrack2. Retrieved July 4, 2015, from http://www.artracking.com/products/software/dtrack2/.

[2]

Benko, Hrvoje, Ricardo Jota, and Andrew Wilson (2012). MirageTable: freehand interaction on a projected augmented reality tabletop. CHI'12: Proceedings of the 2012 ACM Annual Conference on Human Factors in Computing Systems. New York, New York: ACM, pp. 199-208.

[3]

Biocca, Frank, Chad Harms, and Judee K. Burgoon (2003). Toward a more robust theory and measure of social presence. Presence: Teleoperators and Virtual Environments, vol. 12, no. 5, pp. 456-480.

[4]

Brooke, John (1996). SUS-A quick and dirty usability scale. Usability Evaluation in Industry, vol. 189, pp. 194

[5]

Cheng, Le-Te, and John Robinson (1998). Dealing with speed and robustness issues for videobased registration on a wearable computing platform. Digest of Papers. Second International Symposium on Wearable Computers (Cat. No.98EX215). Washington, DC: IEEE Computer Society, p. 84.

[6]

Durrant-Whyte, Hugh, and Tim Bailey (2006). Simultaneous Localization and Mapping (SLAM): part I: The Essential Algorithms. Robotics & Automation Magazine, vol. 2, pp. 99-110.

[7]

Fussell, Susan R., Leslie D. Setlock, and Robert E. Kraut (2003). Effects of head-mounted and scene-oriented video systems on remote collaboration on physical tasks. CHI'03: Proceedings of the Conference on Human factors in computing systems. New York, New York: ACM, pp. 513-520.

[8]

Fussell, Susan, Leslie Setlock, Jie Yang, Jiazhi Ou, Elizabeth Mauer, and Adam Kramer (2004). Gestures Over Video Streams to Support Remote Collaboration on Physical Tasks. Human-Computer Interaction, vol. 19, pp. 273-309.

[9]

Gauglitz, Steffen, Cha Lee, Matthew Turk, and Tobias Höllerer (2012). Integrating the physical environment into mobile remote collaboration. MobileHCI'12: Proceedings of the 14th International Conference on Human-computer interaction with Mobile Devices and Services. New York, New York: ACM, p. 241.

[10]

Gauglitz, Steffen, Benjamin Nuernberger, Matthew Turk, and Tobias Höllerer (2014a). In touch with the remote world. VRST'14: Proceedings of the 20th ACM Symposium on Virtual Reality Software and Technology. New York, New York: ACM, pp. 197-205.

[11]

Gauglitz, Steffen, Benjamin Nuernberger, Matthew Turk, and Tobias Höllerer (2014b). World-stabilized annotations and virtual scene navigation for remote collaboration. UIST'14: Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology, pp. 449-459.

[12]

Gaver, William W., Abigail Sellen, Christian Heath, and Paul Luff (1993). One is not enough: multiple views in a media space. Proceedings of the INTERCHI'93: Conference on Human factors in Computing Systems. Amsterdam, The Netherlands: IOS Press, pp. 335-341.

[13]

Gelb, Dan, Anbumani Subramanian, and Kar Han Tan (2011). Augmented reality for immersive remote collaboration. POV 2011: 2011 I.E. Workshop on Person-Oriented Vision. IEEE, pp. 1-6.

[14]

Haller, Michael, Mark Billinghurst, Daniel Leithinger, Jakob Leitner, and Thomas Seifried (2005). Coeno: enhancing face-to-face collaboration. ICAT'05: Proceedings of the 2005 International Conference on Augmented Tele-existence. New York, New York: ACM, p. 40.

[15]

Henry, Peter, Michael Krainin, Evan Herbst, Xiaofeng Ren, and Dieter Fox (2012). RGB-D mapping: Using Kinect-style depth cameras for dense 3D modeling of indoor environments. The International Journal of Robotics Research, vol. 31, pp. 647-663.

[16]

Hills, Aimèe, Jörg Hauber, and Holger Regenbrecht (2005). Videos in Space: A study on Presence in Video Mediating Communication Systems. Proceedings of the 2005 International Conference on Augmented Tele-existence. New York, New York: ACM, pp. 2-3.

[17]

Izadi, Shahram, Ankur Agarwal, Antonio Criminisi, John Winn, Andrew Blake, and Andrew Fitzgibbon (2007). C-Slate: A multi-touch and object recognition system for remote collaboration using horizontal surfaces. Tabletop 2007: 2nd Annual IEEE International Workshop on Horizontal Interactive Human-Computer Systems. Washington, DC: IEEE, pp. 3-10.

[18]

Izadi, Sharam, Kimm David, Otmar Hilliges, David Molyneaux, Richard Newcombe, Pushmeet Kohli, ... Andrew Fitzgibbon (2011). KinectFusion: real-time 3D reconstruction and interaction using a moving depth camera. Proceedings of User Interface Software and Technology Symposium 2011. New York, New York: ACM, pp. 559-568.

[19]

Kim, Kibum, John Bolton, Audrey Girouard, Jeremy Cooperstock, and Roel Vertegaal (2012). TeleHuman: Effects of 3d perspective on gaze and pose estimation with a life-size cylindrical telepresence pod. CHI'12: Proceedings of the 2012 ACM Annual Conference on Human Factors in Computing Systems. New York, New York: ACM, pp. 2531-2540.

[20]

Kirk, David, Tom Rodden, and Stanton Danaë Fraser (2007). Turn It This Way: Grounding Collaborative Action with Remote Gestures. CHI'07: Proceedings of the 25th annual ACM conference on Human factors in Computing Systems. New York, New York: ACM, pp. 1039-1048.

[21]

Klein, Georg, and David Murray (2007). Parallel tracking and mapping for small AR workspaces. ISMAR 07: 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality. Washington, DC: IEEE Computer Society.

[22]

Kraut, Robert E., Mark D. Miller, and Jane Siegel (1996). Collaboration in performance of physical tasks. CSCW'96: Proceedings of the 1996 ACM Conference on Computer Supported Cooperative Work. New York, New York: ACM, pp. 57-66.

[23]

Kraut, Robert, Susan Fussell, and Jane Siegel (2003). Visual Information as a Conversational Resource in Collaborative Physical Tasks. Human-Computer Interaction, vol. 18, no. 1, pp. 13-49.

[24]

Kurata, Takeshi, Nobuchika Sakata, Masakatsu Kourogi, Hideaki Kuzuoka, and Mark Billinghurst (2004). Remote collaboration using a shoulder-worn active camera/laser. Eighth International Symposium on Wearable Computers. Washington, DC: IEEE Computer Society.

[25]

Kuzuoka, Hideaki, Toshio Kosuge, and Masatomo Tanaka (1994). GestureCam: A video communication system for sympathetic remote collaboration. Proceedings of the 1994 ACM Conference on Computer Supported Cooperative Work. New York, New York: ACM, pp. 35-43.

[26]

Kuzuoka, Hideaki, Shinya Oyama, Keiichi Yamazaki, Kenji Suzuki, and Mamoru Mitsuishi (2000). GestureMan: a mobile robot that embodies a remote instructor's actions. Proceedings of the 2000 ACM Conference on Computer Supported Cooperative Work. New York, New York: ACM, pp. 155-162.

[27]

Lukosch, Stephan, Ronald Poelman, Oytun Akman, and Pieter Jonker (2012). A Novel Gesture-based Interface for Crime Scene Investigation in Mediated Reality. Proceedings of the CSCW Workshop on Exploring Collaboration in Challenging Environments. New York, New York: ACM, pp. 3-6.

[28]

Newcombe, Richard A., Shahram Izadi, Otmar Hilliges, David Molyneaux, David Kim, Andrew J. Davison, ... Andrew Fitzgibbon (2011). KinectFusion: Real-time dense surface mapping and tracking. ISMAR'11: 2011 10th IEEE International Symposium on Mixed and Augmented Reality. Washington, DC: IEEE Computer Society, pp. 127-136.

[29]

OpenSceneGraph (n.d.). OpenSceneGraph. Retrieved July 4, 2015, from http://www.openscenegraph.org/

[30]

Ou, Jiazhi, Xilin Chen, Susan R. Fussell, and Jie Yang (2003). DOVE : Drawing over Video Environment. Proceedings of the Eleventh ACM International Conference on Multimedia. New York, New York: ACM, pp. 100-101.

[31]

Park, Kyoung S., Abhinav Kapoor, and Jason Leigh (2000). Lessons learned from employing multiple perspectives in a collaborative virtual environment for visualizing scientific data. CVE'00: Proceedings of the Third International Conference on Collaborative Virtual Environments, pp. 73-82.

[32]

Poelman, Ronald, and Oytun Akman (2012). As if being there: mediated reality for crime scene investigation. Proceedings of the ACM 2012 Conference on Computer Supported Cooperative Work. New York, New York: ACM.

[33]

Rekimoto, Jun, and M. Saitoh (1999). Augmented surfaces: a spatially continuous work space for hybrid computing environments. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems: The CHI is the Limit. New York, New York: ACM, pp. 378-385.

[34]

Rusu, Radu Bogdan, and Steve Cousins (2011). 3D is here: Point Cloud Library (PCL). Proceedings - IEEE International Conference on Robotics and Automation. Washington, DC: IEEE Computer Society.

[35]

Sakata, Nobuchika, Takeshi Kurata, and Hideaki Kuzuoka (2006). Visual assist with a laser pointer and wearable display for remote collaboration. Proc. 2nd International Conference on Collaboration Technologies. New York, New York: ACM.

[36]

Sodhi, Rajinder S., Brett R. Jones, David Forsyth, Brian P. Bailey, and Giuliano Maciocci (2013). BeThere: 3D Mobile Collaboration with Spatial Input. CHI 2013: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. New York, New York: ACM, pp. 179-188.

[37]

Sousa Santos, Beatriz, Paulo Dias, Angela Pimentel, Jan Willem Baggerman, Carlos Ferreira, Samuel Silva, and Joaquim Madeira (2009). Head-mounted display versus desktop for 3D navigation in virtual reality: A user study. Multimedia Tools and Applications, vol. 41, no. 1, pp. 161-181.

Digital Library

[38]

wxWidgets (n.d.). wxWidgets: Cross-Platform GUI Library. Retrieved July 4, 2015, from http://wxwidgets.org/.

[39]

Zhou, Feng, Henry Been Lirn Dun, and Mark Billinghurst (2008). Trends in augmented reality tracking, interaction and display: A review of ten years of ISMAR. ISMAR'08: Proceedings - 7th IEEE International Symposium on Mixed and Augmented Reality 2008. Washington, DC: IEEE Computer Society, pp. 193-202.

[40]

zSpace Inc (n.d.). zSpace Product. Retrieved 4 July 2015, from http://zspace.com/product.

Cited By

Liao JVan KXia ZSuzuki R(2024)RealityEffects: Augmenting 3D Volumetric Videos with Object-Centric Annotation and Dynamic Visual EffectsProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661631(1248-1261)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3661631
Do NLe KLy DFjeld MTran M(2024)XRPublicSpectator: Towards Public Mixed Reality Viewing in Collocated Asymmetric GroupsExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3650796(1-7)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3650796
Chang ELee YBillinghurst MYoo B(2024)Efficient VR-AR communication method using virtual replicas in XR remote collaborationInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2024.103304190:COnline publication date: 1-Oct-2024
https://dl.acm.org/doi/10.1016/j.ijhcs.2024.103304
Show More Cited By

The Effect of View Independence in a Collaborative AR System
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms

Recommendations

Mini-Me: An Adaptive Avatar for Mixed Reality Remote Collaboration
CHI '18: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems

We present Mini-Me, an adaptive avatar for enhancing Mixed Reality (MR) remote collaboration between a local Augmented Reality (AR) user and a remote Virtual Reality (VR) user. The Mini-Me avatar represents the VR user's gaze direction and body gestures ...
The Effect of Collaboration Styles and View Independence on Video-Mediated Remote Collaboration

This paper investigates how different collaboration styles and view independence affect remote collaboration. Our remote collaboration system shares a live video of a local user's real-world task space with a remote user. The remote user can have an ...
Viewpoint-sharing method with reduced motion sickness in object-based VR/AR collaborative virtual environment
Abstract
We propose a viewpoint-sharing method with reduced motion sickness in an object-based remote collaborative virtual environment (CVE). The method is designed with an assumption of asymmetric, object-based CVE where collaborators use non-homogeneous ...

Comments

Information & Contributors

Information

Published In

cover image Computer Supported Cooperative Work

Computer Supported Cooperative Work Volume 24, Issue 6

December 2015

147 pages

ISSN:0925-9724

Issue’s Table of Contents

Copyright © Copyright © 2015 Springer Science+Business Media Dordrecht.

Publisher

Kluwer Academic Publishers

United States

Publication History

Published: 01 December 2015

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

36
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 06 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Liao JVan KXia ZSuzuki R(2024)RealityEffects: Augmenting 3D Volumetric Videos with Object-Centric Annotation and Dynamic Visual EffectsProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661631(1248-1261)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3661631
Do NLe KLy DFjeld MTran M(2024)XRPublicSpectator: Towards Public Mixed Reality Viewing in Collocated Asymmetric GroupsExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3650796(1-7)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3650796
Chang ELee YBillinghurst MYoo B(2024)Efficient VR-AR communication method using virtual replicas in XR remote collaborationInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2024.103304190:COnline publication date: 1-Oct-2024
https://dl.acm.org/doi/10.1016/j.ijhcs.2024.103304
Zaman FAnslow CRhee T(2023)Vicarious: Context-aware Viewpoints Selection for Mixed Reality CollaborationProceedings of the 29th ACM Symposium on Virtual Reality Software and Technology10.1145/3611659.3615709(1-11)Online publication date: 9-Oct-2023
https://dl.acm.org/doi/10.1145/3611659.3615709
Kruse LWittig JFinnern SGundlach MIserlohe NAriza OSteinicke F(2023)Blended Collaboration: Communication and Cooperation Between Two Users Across the Reality-Virtuality ContinuumExtended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544549.3585881(1-8)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544549.3585881
Johnson JSharkey TButarbutar IXiong DHuang RSy LWeibel N(2023)UnMapped: Leveraging Experts’ Situated Experiences to Ease Remote Guidance in Collaborative Mixed RealityProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581444(1-20)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581444
Tian HLee GBai HBillinghurst M(2023)Using Virtual Replicas to Improve Mixed Reality Remote CollaborationIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.324711329:5(2785-2795)Online publication date: 22-Feb-2023
https://dl.acm.org/doi/10.1109/TVCG.2023.3247113
Fidalgo CYan YCho HSousa MLindlbauer DJorge J(2023)A Survey on Remote Assistance and Training in Mixed Reality EnvironmentsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.324708129:5(2291-2303)Online publication date: 22-Feb-2023
https://dl.acm.org/doi/10.1109/TVCG.2023.3247081
Fages AFleury CTsandilas T(2022)Understanding Multi-View Collaboration between Augmented Reality and Remote Desktop UsersProceedings of the ACM on Human-Computer Interaction10.1145/35556076:CSCW2(1-27)Online publication date: 11-Nov-2022
https://dl.acm.org/doi/10.1145/3555607
Schäfer AReis GStricker D(2022)A Survey on Synchronous Augmented, Virtual, andMixed Reality Remote Collaboration SystemsACM Computing Surveys10.1145/353337655:6(1-27)Online publication date: 7-Dec-2022
https://dl.acm.org/doi/10.1145/3533376
Show More Cited By

View Options

View options

Media

Figures

Other

Tables

View Issue’s Table of Contents