research-article

OmniView: An Exploratory Study of 360 Degree Vision using Dynamic Distortion based on Direction of Interest

Authors:

Stevanus Kevin,

Holger Baldauf,

Yun Suen PaiAuthors Info & Claims

AHs '20: Proceedings of the Augmented Humans International Conference

Article No.: 5, Pages 1 - 10

https://doi.org/10.1145/3384657.3384796

Published: 06 June 2020 Publication History

Abstract

The possibility of providing humans with a 360 field of view (FOV) is an area that has fascinated researchers for some time. We introduce OmniView, an exploratory study to determine an optimized 360 FOV vision using dynamic distortion methods for reducing distortion and enlarging the area of the direction of interest. We developed three variations of OmniView to trigger distortions: eye gaze selection, pointing selection, and automatic selection. Our first study (n=16) compares these methods with no dynamic distortion (equirectangular view) in terms of spatial perception change and reaction time. The second study (n=16) evaluated subjective simulator sickness while performing simple everyday tasks. There is no significant change between OmniView and a no distortion baseline regarding spatial perception and reaction time. However, there is a statistically significant rise in disorientation from before the study to after using Pointing OmniView and Automatic OmniView. Most users (n=13) have a strong preference towards Gaze OmniView. From the results, we provide design guidelines towards further optimizing 360 vision and preserving our spatial sense and reaction time while keeping simulator sickness to a minimum.

References

[1]

Jérôme Ardouin, Anatole Lécuyer, Maud Marchal, Clément Riant, and Eric Marchand. 2012. FlyVIZ: A Novel Display Device to Provide Humans with 360 Vision by Coupling Catadioptric Camera with Hmd. In Proceedings of the 18th ACM Symposium on Virtual Reality Software and Technology (VRST '12). ACM, New York, NY, USA, 41--44. https://doi.org/10.1145/2407336.2407344

Digital Library

[2]

J. Ardouin, A. Lécuyer, M. Marchal, and E. Marchand. 2013. Navigating in virtual environments with 360° omnidirectional rendering. In 2013 IEEE Symposium on 3D User Interfaces (3DUI). 95--98. https://doi.org/10.1109/3DUI.2013.6550203

[3]

J. Ardouin, A. Lécuyer, M. Marchal, and E. Marchand. 2014. Stereoscopic rendering of virtual environments with wide Field-of-Views up to 360°. In 2014 IEEE Virtual Reality (VR). 3--8. https://doi.org/10.1109/VR.2014.6802042

[4]

Matthias Berning, Florian Braun, Till Riedel, and Michael Beigl. 2015. ProximityHat: A Head-worn System for Subtle Sensory Augmentation with Tactile Stimulation. In Proceedings of the 2015 ACM International Symposium on Wearable Computers (ISWC '15). ACM, New York, NY, USA, 31--38. https://doi.org/10.1145/2802083.2802088

Digital Library

[5]

Wutthigrai Boonsuk, Stephen Gilbert, and Jonathan Kelly. 2012. The Impact of Three Interfaces for 360-degree Video on Spatial Cognition. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12). ACM, New York, NY, USA, 2579--2588. https://doi.org/10.1145/2207676.2208647

Digital Library

[6]

S. Boustila, A. Capobianco, O. Génevaux, and D. Bechmann. 2016. New hybrid projection to widen the vertical field of view with large screen to improve the perception of personal space in architectural project review. In 2016 IEEE Virtual Reality (VR). 159--160. https://doi.org/10.1109/VR.2016.7504702

[7]

Thomas W Cronin. 2005. The visual ecology of predator-prey interactions. Ecology of predator-prey interactions (2005), 105--138.

[8]

Henrique G. Debarba, Sami Perrin, Bruno Herbelin, and Ronan Boulic. 2015. Embodied Interaction Using Non-planar Projections in Immersive Virtual Reality. In Proceedings of the 21st ACM Symposium on Virtual Reality Software and Technology (VRST '15). ACM, New York, NY, USA, 125--128. https://doi.org/10.1145/2821592.2821603

Digital Library

[9]

Tarek El-Ganainy and Mohamed Hefeeda. 2016. Streaming virtual reality content. arXiv preprint arXiv:1612.08350 (2016).

[10]

Ching-Ling Fan, Jean Lee, Wen-Chih Lo, Chun-Ying Huang, Kuan-Ta Chen, and Cheng-Hsin Hsu. 2017. Fixation prediction for 360 video streaming in head-mounted virtual reality. In Proceedings of the 27th Workshop on Network and Operating Systems Support for Digital Audio and Video. ACM, 67--72.

Digital Library

[11]

Kevin Fan, Jochen Huber, Suranga Nanayakkara, and Masahiko Inami. 2014. SpiderVision: Extending the Human Field of View for Augmented Awareness. In Proceedings of the 5th Augmented Human International Conference (AH '14). ACM, New York, NY, USA, Article 49, 8 pages. https://doi.org/10.1145/2582051.2582100

Digital Library

[12]

John V. Forrester, Andrew D. Dick, Paul G. McMenamin, Fiona Roberts, and Eric Pearlman. 2016. Chapter 5 - Physiology of vision and the visual system. In The Eye (Fourth Edition) (fourth edition ed.), John V. Forrester, Andrew D. Dick, Paul G. McMenamin, Fiona Roberts, and Eric Pearlman (Eds.). W.B. Saunders, 269--337.e2. https://doi.org/10.1016/B978-0-7020-5554-6.00005-8

[13]

Uwe Gruenefeld, Abdallah El Ali, Susanne Boll, and Wilko Heuten. 2018. Beyond Halo and Wedge: Visualizing Out-of-view Objects on Head-mounted Virtual and Augmented Reality Devices. In Proceedings of the 20th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI '18). ACM, New York, NY, USA, Article 40, 11 pages. https://doi.org/10.1145/3229434.3229438

Digital Library

[14]

Uwe Gruenefeld, Tim Claudius Stratmann, Lars Prädel, and Wilko Heuten. 2018. MonoculAR: A Radial Light Display to Point Towards Out-of-view Objects on Augmented Reality Devices. In Proceedings of the 20th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct (MobileHCI '18). ACM, New York, NY, USA, 16--22. https://doi.org/10.1145/3236112.3236115

Digital Library

[15]

Sean Gustafson, Patrick Baudisch, Carl Gutwin, and Pourang Irani. 2008. Wedge: Clutter-free Visualization of Off-screen Locations. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '08). ACM, New York, NY, USA, 787--796. https://doi.org/10.1145/1357054.1357179

Digital Library

[16]

Bernhard Jenny, Tom Patterson, and Lorenz Hurni. 2008. Flex Projector-interactive software for designing world map projections. Cartographic Perspectives 59 (2008), 12--27.

[17]

Jinki Jung, Hyeopwoo Lee, Jeehye Choi, Abhilasha Nanda, Uwe Gruenefeld, Tim Stratmann, and Wilko Heuten. 2018. Ensuring Safety in Augmented Reality from Trade-off Between Immersion and Situation Awareness. In 2018 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). IEEE, 70--79.

[18]

Jungjin Lee, Bumki Kim, Kyehyun Kim, Younghui Kim, and Junyong Noh. 2016. Rich360: Optimized Spherical Representation from Structured Panoramic Camera Arrays. ACM Trans. Graph. 35, 4, Article 63 (July 2016), 11 pages. https://doi.org/10.1145/2897824.2925983

Digital Library

[19]

Wei Liu, Dragomir Anguelov, Dumitru Erhan, Christian Szegedy, Scott E. Reed, Cheng-Yang Fu, and Alexander C. Berg. 2015. SSD: Single Shot MultiBox Detector. CoRR abs/1512.02325 (2015). arXiv:1512.02325 http://arxiv.org/abs/1512.02325

[20]

Wen-Chih Lo, Ching-Ling Fan, Jean Lee, Chun-Ying Huang, Kuan-Ta Chen, and Cheng-Hsin Hsu. 2017. 360 video viewing dataset in head-mounted virtual reality. In Proceedings of the 8th ACM on Multimedia Systems Conference. ACM, 211--216.

Digital Library

[21]

Victor Mateevitsi, Brad Haggadone, Jason Leigh, Brian Kunzer, and Robert V Kenyon. 2013. Sensing the environment through SpiderSense. In Proceedings of the 4th augmented human international conference. ACM, 51--57.

Digital Library

[22]

Mark Monmonier. 2010. Rhumb lines and map wars: A social history of the Mercator projection. University of Chicago Press.

[23]

Akira Ohashi, Yuki Tanaka, Gakuto Masuyama, Kazunori Umeda, Daisuke Fukuda, Takehito Ogata, Tatsurou Narita, Shuzo Kaneko, Yoshitaka Uchida, and Kota Irie. 2016. Fisheye stereo camera using equirectangular images. In 2016 11th France-Japan & 9th Europe-Asia Congress on Mechatronics (MECATRONICS)/17th International Conference on Research and Education in Mechatronics (REM). IEEE, 284--289.

[24]

Jason Orlosky, Qifan Wu, Kiyoshi Kiyokawa, Haruo Takemura, and Christian Nitschke. 2014. Fisheye vision: peripheral spatial compression for improved field of view in head mounted displays. In Proceedings of the 2nd ACM symposium on Spatial user interaction. ACM, 54--61.

Digital Library

[25]

Manojit Sarkar and Marc H Brown. 1992. Graphical fisheye views of graphs. In Proceedings of the SIGCHI conference on Human factors in computing systems. ACM, 83--91.

Digital Library

[26]

Stefanie Schaack, George Chernyshov, Kirill Ragozin, Benjamin Tag, Roshan Peiris, and Kai Kunze. 2019. Haptic Collar: Vibrotactile Feedback Around the Neck for Guidance Applications. In Proceedings of the 10th Augmented Human International Conference 2019 (AH2019). ACM, New York, NY, USA, Article 12, 4 pages. https://doi.org/10.1145/3311823.3311840

Digital Library

[27]

Eldon Schoop, James Smith, and Bjoern Hartmann. 2018. HindSight: Enhancing Spatial Awareness by Sonifying Detected Objects in Real-Time 360-Degree Video. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, Article 143, 12 pages. https://doi.org/10.1145/3173574.3173717

Digital Library

[28]

Bruce Schubert. [n. d.]. https://worldwind.earth/explorer/

[29]

Lichao Shen, Mhd Yamen Saraji, Kai Kunze, and Kouta Minamizawa. 2018. Unconstrained Neck: Omnidirectional Observation from an Extra Robotic Neck. In Proceedings of the 9th Augmented Human International Conference (AH '18). ACM, New York, NY, USA, Article 38, 2 pages. https://doi.org/10.1145/3174910.3174955

Digital Library

[30]

John P Snyder. 1997. Flattening the earth: two thousand years of map projections. University of Chicago Press.

[31]

Kashyap Kammachi Sreedhar, Alireza Aminlou, Miska M Hannuksela, and Moncef Gabbouj. 2016. Viewport-adaptive encoding and streaming of 360-degree video for virtual reality applications. In 2016 IEEE International Symposium on Multimedia (ISM). IEEE, 583--586.

[32]

Jordan Tewell, Jon Bird, and George R. Buchanan. 2017. Heat-Nav: Using Temperature Changes As Navigation Cues. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 1131--1135. https://doi.org/10.1145/3025453.3025965

[33]

Tran Thi Hai Uyen, Seungcheol Choi, and Oh-Jin Kwon. 2019. Subjective Evaluation of the 360-Degree Projection Formats Using Absolute Category Rating. In Proceedings of the 2019 4th International Conference on Intelligent Information Technology (ICIIT '19). ACM, New York, NY, USA, 10--15. https://doi.org/10.1145/3321454.3321471

Digital Library

Cited By

Neuhaus RRingfort-Felner RCourtney DKneile MHassenzahl M(2024)Virtual Unreality: Augmentation-Oriented Ideation Through Design CardsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642364(1-23)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642364
Zhang XWu XCools RSimeone AGruenefeld U(2023)ARcoustic: A Mobile Augmented Reality System for Seeing Out-of-View TrafficProceedings of the 15th International Conference on Automotive User Interfaces and Interactive Vehicular Applications10.1145/3580585.3606461(178-190)Online publication date: 18-Sep-2023
https://dl.acm.org/doi/10.1145/3580585.3606461
Yamazaki SOhnishi ATerada TTsukamoto M(2022)Extensible Neck: A Gesture Input Method to Extend/Contract Neck Virtually in Video See-through AR EnvironmentSensors10.3390/s2209355922:9(3559)Online publication date: 7-May-2022
https://doi.org/10.3390/s22093559
Show More Cited By

Index Terms

OmniView: An Exploratory Study of 360 Degree Vision using Dynamic Distortion based on Direction of Interest
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. HCI design and evaluation methods
      1. Usability testing
  2. Visualization
    1. Visualization application domains
      1. Information visualization

Recommendations

PanoFlex: Adaptive Panoramic Vision to Accommodate 360° Field-of-View for Humans
VRST '19: Proceedings of the 25th ACM Symposium on Virtual Reality Software and Technology

We propose PanoFlex, an adaptive method for projecting panoramic vision using a dynamic distortion method based on eye gaze. We stream real-time video from a 360° camera and project the view on a plane to the user. The user controls the distortion of ...
SpiderVision: extending the human field of view for augmented awareness
AH '14: Proceedings of the 5th Augmented Human International Conference

We present SpiderVision, a wearable device that extends the human field of view to augment a user's awareness of things happening behind one's back. SpiderVision leverages a front and back camera to enable users to focus on the front view while ...
Headlight: egocentric visual augmentation by wearable wide projector
SIGGRAPH '18: ACM SIGGRAPH 2018 Emerging Technologies

Visual augmentation to the real environment has potential not only to display information but also to provide a new perception of the physical world. However, the currently available mixed reality technologies could not provide enough angle of view. ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

AHs '20: Proceedings of the Augmented Humans International Conference

March 2020

296 pages

ISBN:9781450376037

DOI:10.1145/3384657

General Chairs:
Bo Zhou,
Jingyuan Cheng,
Program Chairs:
Paul Strohmeier,
Shoya Ishimaru,
Thomas Kosch

Copyright © 2020 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 06 June 2020

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

AHs '20

AHs '20: Augmented Humans International Conference

March 16 - 17, 2020

Kaiserslautern, Germany

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
271
Total Downloads

Downloads (Last 12 months)38
Downloads (Last 6 weeks)5

Reflects downloads up to 06 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Neuhaus RRingfort-Felner RCourtney DKneile MHassenzahl M(2024)Virtual Unreality: Augmentation-Oriented Ideation Through Design CardsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642364(1-23)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642364
Zhang XWu XCools RSimeone AGruenefeld U(2023)ARcoustic: A Mobile Augmented Reality System for Seeing Out-of-View TrafficProceedings of the 15th International Conference on Automotive User Interfaces and Interactive Vehicular Applications10.1145/3580585.3606461(178-190)Online publication date: 18-Sep-2023
https://dl.acm.org/doi/10.1145/3580585.3606461
Yamazaki SOhnishi ATerada TTsukamoto M(2022)Extensible Neck: A Gesture Input Method to Extend/Contract Neck Virtually in Video See-through AR EnvironmentSensors10.3390/s2209355922:9(3559)Online publication date: 7-May-2022
https://doi.org/10.3390/s22093559
Woźniak MDominiak JGrudzień KWróbel-Lachowska MNiess JWoźniak PRomanowski A(2022)Gapeau: Enhancing the Sense of Distance to Others with a Head-Mounted SensorProceedings of the Sixteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3490149.3501323(1-19)Online publication date: 13-Feb-2022
https://dl.acm.org/doi/10.1145/3490149.3501323
Shen LSaraiji MKunze KMinamizawa KPeiris R(2020)Visuomotor Influence of Attached Robotic Neck AugmentationProceedings of the 2020 ACM Symposium on Spatial User Interaction10.1145/3385959.3418460(1-10)Online publication date: 31-Oct-2020
https://dl.acm.org/doi/10.1145/3385959.3418460

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents