research-article

Large scale cut plane: an occlusion management technique for immersive dense 3D reconstructions

Authors:

Annette Mossel,

Christian KoesslerAuthors Info & Claims

VRST '16: Proceedings of the 22nd ACM Conference on Virtual Reality Software and Technology

Pages 201 - 210

https://doi.org/10.1145/2993369.2993384

Published: 02 November 2016 Publication History

Abstract

Dense 3D reconstructions of real-world environments become wide spread and are foreseen to act as data base to solve real world problems, such as remote inspections. Therefore not only scene viewing is required but also the ability to interact with the environment, such as selection of a user-defined part of the reconstruction for later usage. However, inter-object occlusion is inherent to large dense 3D reconstructions, due to scene geometry or reconstruction artifacts that might result in object containment. Since prior art lacks approaches for occlusion management in environments that consist of one or multiple (large) continuous surfaces, we propose the novel technique Large Scale Cut Plane that enables segmentation and subsequent selection of visible, partly or fully occluded patches within a large 3D reconstruction, even at far distance. We combine Large Scale Cut Plane with an immersive virtual reality setup to foster 3D scene understanding and natural user interactions. We furthermore present results from a user study where we investigate performance and usability of our proposed technique compared to a baseline technique. Our results indicate Large Scale Cut Plane to be superior in terms of speed and precision, while we found need of improvement of the user interface. The presented investigations has to the authors' best knowledge not been subject to previous research.

References

[1]

Andujar, C., Vazquez, P., and Fairen, M. 2004. Way-Finder: guided tours through complex walkthrough models. Computer Graphics Forum 23, 3 (sep), 499--508.

[2]

Argelaguet, F., and Andujar, C. 2013. A survey of 3D object selection techniques for virtual environments. Computers and Graphics (Pergamon) 37, 3, 121--136.

Digital Library

[3]

Birsak, M., Musialski, P., Arikan, M., and Wimmer, M. 2013. Seamless texturing of archaeological data. In Digital Heritage International Congress (DigitalHeritage), 2013, IEEE, 265--272.

[4]

Bowman, D., Kruijff, E., LaViola, J., and Poupyrev, I. 2004. Direct Manipulation: Virtual Hand Techniques. In 3D User Interfaces: Theory and Practise. Addison Wesley, ch. 5.4.3, 158.

[5]

Bowman, D., Kruijff, E., LaViola Jr., J. J., and Poupyrev, I. 2004. Interacting by Pointing. In 3D User Interfaces: Theory and Practise. Addison Wesley, ch. 5.4.2, 150.

[6]

Brooke, J. 1996. SUS - A quick and dirty usability scale. Usability evaluation in industry 189, 194, 4--7.

[7]

Cashion, J., Wingrave, C., and Jr., J. J. L. 2012. Dense and dynamic 3d selection for game-based virtual environments. IEEE Transactions on Visualization and Computer Graphics 18, 4 (April), 634--642.

Digital Library

[8]

Elmqvist, N., and Tsigas, P. 2008. A taxonomy of 3D occlusion management for visualization. IEEE Transactions on Visualization and Computer Graphics 14, 5, 1095--1109.

Digital Library

[9]

Fan, L., Liu, L., and Liu, K. 2011. Paint mesh cutting. Computer Graphic Forum 30, 2, 603--611.

[10]

Hinckley, K., Pausch, R., Goble, J. C., and Kassell, N. F. 1994. Passive Real-world Interface Props for Neurosurgical Visualization. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '94) 30, 452--458.

Digital Library

[11]

Ioannou, Y., Taati, B., Harrap, R., and Greenspan, M. 2012. Difference of normals as a multi-scale operator in unorganized point clouds. In 2012 Second International Conference on 3D Imaging, Modeling, Processing, Visualization & Transmission, IEEE, 501--508.

Digital Library

[12]

Ji, Z., Liu, L., Chen, Z., and Wang, G. 2006. Easy Mesh Cutting. Computer Graphics Forum.

[13]

Kalogerakis, E., Hertzmann, A., and Singh, K. 2010. Learning 3d mesh segmentation and labeling. In ACM SIGGRAPH 2010 Papers, ACM, NY, USA, SIGGRAPH '10, 102:1--102:12.

Digital Library

[14]

Liang, J., and Green, M. 1994. Jdcad: A highly interactive 3d modeling system. Computers and Graphics 18, 4, 499 -- 506.

[15]

Lubos, P., Beimler, R., Lammers, M., and Steinicke, F. 2014. Touching the cloud: Bimanual annotation of immersive point clouds. In 3D User Interfaces (3DUI), 2014 IEEE Symposium on, 191--192.

[16]

Meng, M., Fan, L., and Liu, L. 2011. iCutter: A Direct Cut Out Tool for 3D Shapes. Journal of Computer Animation and Virtual World 22, 4, 335--342.

Digital Library

[17]

Mossel, A., Venditti, B., and Kaufmann, H. 2013. Drillsample: Precise selection in dense handheld augmented reality environments. In Proceedings of the Virtual Reality International Conference: Laval Virtual, ACM, NY, USA, VRIC '13, 10:1--10:10.

Digital Library

[18]

Nasa, N. A., and Administration, S. 2010. NASA TLX: Task Load Index. In Planta Medica, vol. 35, 308--315.

[19]

Nguyen, A., and Le, B. 2013. 3d point cloud segmentation: a survey. In 2013 6th IEEE Conference on Robotics, Automation and Mechatronics (RAM), IEEE, 225--230.

[20]

Niessner, M., Zollhöfer, M., Izadi, S., and Stamminger, M. 2013. Real-time 3D Reconstruction at Scale Using Voxel Hashing. ACM Trans. Graph. 32, 6, 169:1----169:11.

Digital Library

[21]

Olwal, A., and Feiner, S. 2003. The flexible pointer: An interaction technique for augmented and virtual reality. In Proc. of ACM Symposium on User Interface Software and Technology (UIST), 83--84.

[22]

Poupyrev, I., Billinghurst, M., Weghorst, S., and Ichikawa, T. 1996. The go-go interaction technique: Nonlinear mapping for direct manipulation in vr. In Proceedings of the 9th Annual ACM Symposium on User Interface Software and Technology, ACM, NY, USA, UIST '96, 79--80.

Digital Library

[23]

Rosa, D. A. W., and Nagel, H. H. 2010. Selection techniques for dense and occluded virtual 3d environments, supported by depth feedback: Double, bound and depth bubble cursors. In Chilean Computer Science Society (SCCC), 2010 XXIX International Conference of the, 218--225.

Digital Library

[24]

Roth, H., and Marsette, V. 2012. Moving Volume Kinect-Fusion. Proceedings of the British Machine Vision Conference, 112.1----112.11.

[25]

Tateno, K., Tombari, F., and Navab, N. 2015. Real-time and scalable incremental segmentation on dense slam. In Intelligent Robots and Systems (IROS), 2015 IEEE/RSJ International Conference on, 4465--4472.

[26]

Vanacken, L., Grossman, T., and Coninx, K. 2007. Exploring the effects of environment density and target visibility on object selection in 3d virtual environments. In 2007 IEEE Symposium on 3D User Interfaces.

[27]

Vo, A.-V., Truong-Hong, L., Laefer, D. F., and Bertolotto, M. 2015. Octree-based region growing for point cloud segmentation. ISPRS Journal of Photogrammetry and Remote Sensing 104, 88--100.

[28]

Wonner, J., Grosjean, J., Capobianco, A., and Bechmann, D. 2012. Starfish: A selection technique for dense virtual environments. In Proceedings of the 18th ACM Symposium on Virtual Reality Software and Technology, ACM, NY, USA, VRST '12, 101--104.

Digital Library

[29]

Zhang, K., Chen, S.-C., Whitman, D., Shyu, M.-L., Yan, J., and Zhang, C. 2003. A progressive morphological filter for removing nonground measurements from airborne lidar data. IEEE Transactions on Geoscience and Remote Sensing 41, 4, 872--882.

[30]

Zheng, Y., and Tai, C.-L. 2010. Mesh decomposition with cross-boundary brushes. Comput. Graph. Forum 29, 2, 527--535.

Cited By

Bashar MBatmaz A(2024)Virtual Task Environments Factors Explored in 3D Selection StudiesProceedings of the 50th Graphics Interface Conference10.1145/3670947.3670983(1-16)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3670947.3670983
von Willich JGünther SMatviienko ASchmitz MMüller FMühlhäuser M(2023)DensingQueen: Exploration Methods for Spatial Dense Dynamic DataProceedings of the 2023 ACM Symposium on Spatial User Interaction10.1145/3607822.3614535(1-12)Online publication date: 13-Oct-2023
https://dl.acm.org/doi/10.1145/3607822.3614535
Liebers CProchazka MPfützenreuter NLiebers JAuda JGruenefeld USchneegass S(2023)Pointing It Out! Comparing Manual Segmentation of 3D Point Clouds between Desktop, Tablet, and Virtual RealityInternational Journal of Human–Computer Interaction10.1080/10447318.2023.223894540:19(5602-5616)Online publication date: 31-Jul-2023
https://doi.org/10.1080/10447318.2023.2238945
Show More Cited By

Index Terms

Large scale cut plane: an occlusion management technique for immersive dense 3D reconstructions
1. Computing methodologies
  1. Computer graphics
    1. Graphics systems and interfaces
      1. Virtual reality
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. HCI design and evaluation methods
      1. User studies
  2. Interaction design
    1. Interaction design process and methods
      1. Interface design prototyping
      2. User interface design

Recommendations

BoEs: attachable haptics bits on gaming controller for designing interactive gameplay
SA '17: SIGGRAPH Asia 2017 VR Showcase

Gaming controller is a general way for playing in the immersive virtual reality (VR) game. With haptics technology and head-mounted display (HMD), user can have an enhanced immersive experience when they manipulate in the virtual environment. Currently, ...
CAVE: An Emerging Immersive Technology -- A Review
UKSIM '14: Proceedings of the 2014 UKSim-AMSS 16th International Conference on Computer Modelling and Simulation

Currently, the CAVE (Cave Automatic Virtual Environment) systems are one of the best virtual reality (VR) immersive devices available for portraying the virtual environment. The CAVE gives the illusion of being surrounded by a fictional world, providing ...
Walking up and down in immersive virtual worlds: Novel interactive techniques based on visual feedback
3DUI '10: Proceedings of the 2010 IEEE Symposium on 3D User Interfaces

We introduce novel interactive techniques to simulate the sensation of walking up and down in immersive virtual worlds based on visual feedback. Our method consists in modifying the motion of the virtual subjective camera while the user is really ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

VRST '16: Proceedings of the 22nd ACM Conference on Virtual Reality Software and Technology

November 2016

363 pages

ISBN:9781450344913

DOI:10.1145/2993369

Conference Chairs:
Dieter Kranzlmüller
Leibniz Supercomputing Centre (LRZ) and Ludwig-Maximilians-Universität (LMU)
,
Gudrun Klinker
Technical University of Munich (TUM)

Copyright © 2016 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 02 November 2016

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

VRST '16

Sponsor:

VRST '16: 22th ACM Symposium on Virtual Reality Software and Technology

November 2 - 4, 2016

Munich, Germany

Acceptance Rates

Overall Acceptance Rate 66 of 254 submissions, 26%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

12
Total Citations
View Citations
277
Total Downloads

Downloads (Last 12 months)29
Downloads (Last 6 weeks)9

Reflects downloads up to 06 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Bashar MBatmaz A(2024)Virtual Task Environments Factors Explored in 3D Selection StudiesProceedings of the 50th Graphics Interface Conference10.1145/3670947.3670983(1-16)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3670947.3670983
von Willich JGünther SMatviienko ASchmitz MMüller FMühlhäuser M(2023)DensingQueen: Exploration Methods for Spatial Dense Dynamic DataProceedings of the 2023 ACM Symposium on Spatial User Interaction10.1145/3607822.3614535(1-12)Online publication date: 13-Oct-2023
https://dl.acm.org/doi/10.1145/3607822.3614535
Liebers CProchazka MPfützenreuter NLiebers JAuda JGruenefeld USchneegass S(2023)Pointing It Out! Comparing Manual Segmentation of 3D Point Clouds between Desktop, Tablet, and Virtual RealityInternational Journal of Human–Computer Interaction10.1080/10447318.2023.223894540:19(5602-5616)Online publication date: 31-Jul-2023
https://doi.org/10.1080/10447318.2023.2238945
Von Willich JMatviienko AGünther SMühlhäuser M(2022)Comparing VR Exploration Support for Ground-Based Rescue RobotsAdjunct Publication of the 24th International Conference on Human-Computer Interaction with Mobile Devices and Services10.1145/3528575.3551440(1-6)Online publication date: 28-Sep-2022
https://dl.acm.org/doi/10.1145/3528575.3551440
Abtahi PHough SLanday JFollmer S(2022)Beyond Being Real: A Sensorimotor Control Perspective on Interactions in Virtual RealityProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3517706(1-17)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3517706
Zhang QKim CByun H(2022)Multi-Finger-Based Arbitrary Region-of-Interest Selection in Virtual RealityInternational Journal of Human–Computer Interaction10.1080/10447318.2022.210866639:20(3969-3983)Online publication date: 9-Aug-2022
https://doi.org/10.1080/10447318.2022.2108666
Radwan MOhrhallinger SWimmer M(2021)Fast occlusion-based point cloud explorationThe Visual Computer10.1007/s00371-021-02243-xOnline publication date: 28-Jul-2021
https://doi.org/10.1007/s00371-021-02243-x
Chen YSun JXu QLank EIrani PLi W(2021)Global Scene Filtering, Exploration, and Pointing in Occluded Virtual SpaceHuman-Computer Interaction – INTERACT 202110.1007/978-3-030-85607-6_11(156-176)Online publication date: 27-Aug-2021
https://doi.org/10.1007/978-3-030-85607-6_11
Montano-Murillo RNguyen CKazi RSubramanian SDiVerdi SMartinez-Plasencia D(2020)Slicing-Volume: Hybrid 3D/2D Multi-target Selection Technique for Dense Virtual Environments2020 IEEE Conference on Virtual Reality and 3D User Interfaces (VR)10.1109/VR46266.2020.1581198507712(53-62)Online publication date: Mar-2020
https://doi.org/10.1109/VR46266.2020.1581198507712
Montano-Murillo RNguyen CKazi RSubramanian SDiVerdi SMartinez-Plasencia D(2020)Slicing-Volume: Hybrid 3D/2D Multi-target Selection Technique for Dense Virtual Environments2020 IEEE Conference on Virtual Reality and 3D User Interfaces (VR)10.1109/VR46266.2020.00023(53-62)Online publication date: Mar-2020
https://doi.org/10.1109/VR46266.2020.00023
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents