research-article

A Comprehensive Classification of 3D Selection and Manipulation Techniques

Authors:

Matthias Weise,

Raphael Zender,

Ulrike LuckeAuthors Info & Claims

MuC '19: Proceedings of Mensch und Computer 2019

Pages 321 - 332

https://doi.org/10.1145/3340764.3340777

Published: 08 September 2019 Publication History

Abstract

The importance of 3D interaction is constantly increasing - not least because of new developments in ubiquitous computing and augmented and virtual reality. Current 3D user interfaces allow for an expressive and accurate input in three-dimensional space. 3D interaction techniques are responsible for mapping the three-dimensional input onto actions within the system and for returning appropriate feedback to the user. For developers of applications using 3D interaction and for designers of new 3D interaction techniques it is important to understand how existing techniques differ and how they can be classified. In this work we summarize existing characterizations of 3D interaction and adapt them to allow a comprehensive classification of 3D interaction techniques for selection and manipulation of virtual objects.

References

[1]

Ferran Argelaguet and Carlos Andujar. 2013. A survey of 3D object selection techniques for virtual environments. Computers & Graphics 37, 3, 121--136.

Digital Library

[2]

Felipe Bacim, Regis Kopper, and Doug A. Bowman. 2013. Design and evaluation of 3D selection techniques based on progressive refinement. International Journal of Human-Computer Studies 71, 7-8, 785--802.

Digital Library

[3]

Eric A. Bier. 1990. Snap-dragging in three dimensions. In Proceedings of the 1990 symposium on Interactive 3D graphics. ACM, New York, NY, 193--204.

Digital Library

[4]

Costas Boletsis, Jarl E. Cedergren, and Stian Kongsvik. 2017. HCI Research in Virtual Reality: A Discussion of Problem-solving https://brage.bibsys.no/xmlui/bitstream/11250/2456626/1/2017-hci_in_vr.pdf. Retrieved from.

[5]

Benoît Bossavit, Asier Marzo, Oscar Ardaiz, Luis D. de Cerio, and Alfredo Pina. 2014. Design Choices and Their Implications for 3D Mid-Air Manipulation Techniques. Presence: Teleoperators and Virtual Environments 23, 4, 377--392.

Digital Library

[6]

Doug A. Bowman, Jian Chen, Chadwick A. Wingrave, John F. Lucas, Andrew Ray, Nicholas F. Polys, Qing Li, Yonca Haciahmetoglu, Ji-Sun Kim, Seonho Kim, Robert Boehringer, and Tao Ni. 2006. New directions in 3D user interfaces. IJVR 5, 2, 3--14.

[7]

Doug A. Bowman and Larry F. Hodges. 1997. An evaluation of techniques for grabbing and manipulating remote objects in immersive virtual environments. In Proceedings of the 1997 symposium on Interactive 3D graphics, Andy van Dam, Ed. ACM, New York, NY.

Digital Library

[8]

Doug A. Bowman, Donald B. Johnson, and Larry F. Hodges. 1999. Testbed Evaluation of Virtual Environment Interaction Techniques. In Proceedings of the ACM symposium on Virtual reality software and technology. ACM, New York, NY, 26--33.

Digital Library

[9]

Doug A. Bowman, Ryan P. McMahan, and Eric D. Ragan. 2012. Questioning naturalism in 3D user interfaces. Communications of the ACM 55, 9, 78--88.

Digital Library

[10]

William Buxton. 1983. Lexical and Pragmatic Considerations of Input Structures. ACM SIGGRAPH Computer Graphics 17, 1, 31--37.

Digital Library

[11]

Jeffrey Cashion, Chadwick Wingrave, and Joseph J. LaViola. 2012. Dense and dynamic 3D selection for game-based virtual environments. IEEE transactions on visualization and computer graphics 18, 4, 634--642.

Digital Library

[12]

Jeffrey Cashion, Chadwick Wingrave, and Joseph J. LaViola. 2013. Optimal 3D selection technique assignment using real-time contextual analysis. In 2013 IEEE Symposium on 3D User Interfaces (3DUI). 16 - 17 March 2013, Orlando, Florida, USA. IEEE, Piscataway, NJ, 107--110.

[13]

Emmanuelle Chapoulie, Theophanis Tsandilas, Lora Oehlberg, Wendy Mackay, and George Drettakis. 2015. Finger-based manipulation in immersive spaces and the real world. In 2015 IEEE Symposium on 3D User Interfaces (3DUI). 23 - 24 March 2015, Arles, France. IEEE, Piscataway, NJ, 109--116.

[14]

Scott Frees, G. D. Kessler, and Edwin Kay. 2007. PRISM interaction for enhancing control in immersive virtual environments. ACM Trans. Comput.-Hum. Interact. 14, 1, 2-es.

Digital Library

[15]

Michael Goesele and Wolfgang Stuerzlinger. 1999. Semantic Constraints for Scene Manipulation. In Proceedings of the 15th Spring Conference on Computer Graphics (SCCG-99), J. Zára, Ed., 140--146.

[16]

Gerwin d. Haan, Michal Koutek, and Frits H. Post. 2005. IntenSelect: Using Dynamic Object Rating for Assisting 3D Object Selection. In Proceedings of the 11th Eurographics conference on Virtual Environments, Erik Kjems, Ed. Eurographics Association, Aire-la-Ville, Switzerland.

Digital Library

[17]

Edwin L. Hutchins, James D. Hollan, and Donald A. Norman. 1985. Direct Manipulation Interfaces. Human-Computer Interaction 1, 4, 311--338.

Digital Library

[18]

Jason Jerald. 2016. The VR book. Human-centered design for virtual reality (First edition). ACM books, 8. Morgan & Claypool, San Rafael.

Digital Library

[19]

Paul Kabbash, William Buxton, and Abigail Sellen. 1994. Two-handed input in a compound task. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, New York, NY, 417--423.

Digital Library

[20]

Werner A. König, Jens Gerken, Stefan Dierdorf, and Harald Reiterer. 2009. Adaptive Pointing - Design and Evaluation of a Precision Enhancing Technique for Absolute Pointing Devices. In Human-computer interaction - INTERACT 2009. 12th IFIP TC 13 international conference, Tom Gross, Jan Gulliksen, Paula Kotzé, Lars Oestreicher, Philippe Palanque, Raquel O. Prates and Marco Winckler, Eds. Lecture notes in computer science, 5726. Springer, Berlin, 658--671.

Digital Library

[21]

Regis Kopper, Felipe Bacim, and Doug A. Bowman. 2011. Rapid and accurate 3D selection by progressive refinement. In IEEE Symposium on 3D User Interfaces (3DUI), 2011. IEEE, Piscataway, NJ, 67--74.

Digital Library

[22]

Regis Kopper, Doug A. Bowman, Mara G. Silva, and Ryan P. McMahan. 2010. A human motor behavior model for distal pointing tasks. International Journal of Human-Computer Studies 68, 10, 603--615.

Digital Library

[23]

Joseph J. LaViola Jr, Ernst Kruijff, Ryan P. McMahan, Doug Bowman, and Ivan P. Poupyrev. 2017. 3D user interfaces. Theory and practice. Addison-Wesley Professional.

[24]

Jiandong Liang and Mark Green. 1994. JDCAD. A highly interactive 3D modeling system. Computers & Graphics 18, 4, 499--506.

[25]

William E. Marsh, Jonathan W. Kelly, Julie Dickerson, and James H. Oliver. 2014. Fuzzy Navigation Engine: Mitigating the Cognitive Demands of Semi-Natural Locomotion. Presence: Teleoperators and Virtual Environments 23, 3, 300--319.

Digital Library

[26]

Ryan P. McMahan. 2011. Exploring the effects of higher-fidelity display and interaction for virtual reality games.

[27]

Ryan P. McMahan, Doug Gorton, Joe Gresock, Will McConnell, and Doug A. Bowman. 2006. Separating the effects of level of immersion and 3D interaction techniques. In VRST Cyprus 2006. ACM Symposium Virtual Reality Software and Technology, November 1 - 3, 2006, Limassol, Cyprus. ACM Press, New York, N.Y, 108.

Digital Library

[28]

Ryan P. McMahan, Chengyuan Lai, and Swaroop K. Pal. 2016. Interaction Fidelity: The Uncanny Valley of Virtual Reality Interactions. In Virtual, augmented and mixed reality. 8th international conference, VAMR 2016, held as part of HCI International 2016, Stephanie Lackey and Randall Shumaker, Eds. Lecture notes in computer science Information systems and applications, incl. Internet/Web and HCI, 9740. Springer, Cham, Heidelberg, 59--70.

[29]

Daniel Mendes, Fernando Fonseca, Bruno Araujo, Alfredo Ferreira, and Joaquim Jorge. 2014. Mid-air interactions above stereoscopic interactive tables. In 2014 IEEE Symposium on 3D User Interfaces (3DUI). 29 - 30 March 2014, Minneapolis, Minnesota, USA. IEEE, Piscataway, NJ, 3--10.

[30]

Daniel Mendes, Daniel Medeiros, Mauricio Sousa, Ricardo Ferreira, Alberto Raposo, Alfredo Ferreira, and Joaquim Jorge. 2017. Mid-air modeling with Boolean operations in VR. In 2017 IEEE Symposium on 3D User Interfaces (3DUI). IEEE, Piscataway, NJ, 154--157.

[31]

Daniel Mendes, Daniel Medeiros, Maurício Sousa, Eduardo Cordeiro, Alfredo Ferreira, and Joaquim A. Jorge. 2017. Design and evaluation of a novel out-of-reach selection technique for VR using iterative refinement. Computers & Graphics 67, 95--102.

Digital Library

[32]

Mark Mine. 1995. ISAAC: A virtual environment tool for the interactive construction of virtual worlds. UNC Chapel Hill Computer Science Technical Report TR95-020.

Digital Library

[33]

Mark R. Mine. 1995. Virtual Environment Interaction Techniques. UNC Chapel Hill computer science technical report TR95-018.

Digital Library

[34]

Mark R. Mine, Frederick P. Brooks Jr., and Carlo H. Sequin. 1997. Moving objects in space: exploiting proprioception in virtual-environment interaction. In Proceedings of the 24th annual conference on Computer graphics and interactive techniques, G. S. Owen, Ed. ACM Press/Addison-Wesley Publishing Co., 19--26.

Digital Library

[35]

Nassima Ouramdane, Samir Otmane, Frédéric Davesne, and Malik Mallem. 2006. FOLLOW-ME: a new 3D interaction technique based on virtual guides and granularity of interaction. In Proceedings of the 2006 ACM international conference on Virtual reality continuum and its applications. ACM, New York, NY, 137.

Digital Library

[36]

Russell N. Owen, Gordon Kurtenbach, George W. Fitzmaurice, Thomas Baudel, and William Buxton. 2005. When it gets more difficult, use both hands: exploring bimanual curve manipulation. In Graphics interface 2005, Kori Inkpen, Ed. Canadian Information Processing Society, Mississauga.

Digital Library

[37]

Frol Periverzov and Horea Ilies. 2015. IDS. The intent driven selection method for natural user interfaces. In 2015 IEEE Symposium on 3D User Interfaces (3DUI). 23 - 24 March 2015, Arles, France. IEEE, Piscataway, NJ, 121--128.

[38]

I. Poupyrev, T. Ichikawa, S. Weghorst, and M. Billinghurst. 1998. Egocentric Object Manipulation in Virtual Environments. Empirical Evaluation of Interaction Techniques. Computer Graphics Forum 17, 3, 41--52.

[39]

Ivan Poupyrev, Mark Billinghurst, Suzanne Weghorst, and Tadao Ichikawa. 1996. The go-go interaction technique: non-linear mapping for direct manipulation in VR. In Proceedings of the 9th annual ACM symposium on User interface software and technology. ACM, New York, NY, 79--80.

Digital Library

[40]

Ivan Poupyrev and Tadao Ichikawa. 1999. Manipulating Objects in Virtual Worlds. Categorization and Empirical Evaluation of Interaction Techniques. Journal of Visual Languages & Computing 10, 1, 19--35.

Digital Library

[41]

Ivan Poupyrev, Suzanne Weghorst, Mark Billinghurst, and Ichikawa Tadao. 1997. A framework and testbed for studying manipulation techniques for immersive VR. In Proceedings of the ACM symposium on Virtual reality software and technology. ACM, New York, NY.

Digital Library

[42]

Ivan Poupyrev, Suzanne Weghorst, and Sidney Fels. 2000. Non-isomorphic 3D rotational techniques. In Proceedings of the SIGCHI conference on Human Factors in Computing Systems. ACM, New York, NY, 540--547.

Digital Library

[43]

Leonardo P. Soares, Marcio S. Pinho, and Regis Kopper. 2017. Design and preliminary evaluation of an EGO-exocentric technique for cooperative manipulation. In 2017 IEEE Symposium on 3D User Interfaces (3DUI). IEEE, Piscataway, NJ, 203--204.

[44]

Peng Song, Wooi B. Goh, William Hutama, Chi-Wing Fu, and Xiaopei Liu. 2012. A handle bar metaphor for virtual object manipulation with mid-air interaction. In CHI 2012, it's the experience. The 30th ACM Conference on Human Factors in Computing Systems; Austin, Texas, USA, May 5 - 10, 2012. ACM, New York, NY, 1297.

Digital Library

[45]

Richard Stoakley, Matthew J. Conway, and Randy Pausch. 1995. Virtual reality on a WIM: interactive worlds in miniature. In CHI '95. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM Press/Addison-Wesley Publishing Co, New York, NY, USA.

Digital Library

[46]

W. Stuerzlinger and G. Smith. 2002. Efficient manipulation of object groups in virtual environments. In IEEE virtual reality 2002. Proceedings, 24 - 28 March 2002, Orlando, Florida. IEEE Computer Soc, Los Alamitos, Calif., 251--258.

Digital Library

[47]

Amy C. Ulinski, Zachary Wartell, Paula Goolkasian, Evan A. Suma, and Larry F. Hodges. 2009. Selection performance based on classes of bimanual actions. In IEEE Symposium on 3D User Interfaces, 2009. 3DUI 2009; Lafayette, Louisiana, USA, March 14 - 15, 2009. IEEE, Piscataway, NJ, 51--58.

Digital Library

[48]

Lode Vanacken, Tovi Grossman, and Karin Coninx. 2007. Exploring the Effects of Environment Density and Target Visibility on Object Selection in 3D Virtual Environments. In Proceedings / 3DUI, IEEE Symposium on 3D User Interfaces 2007, Charlotte, North Carolina, USA, March 10 - 11, 2007. Institute of Electrical and Electronics Engineers, Piscataway, NJ.

[49]

Manuel Veit, Antonio Capobianco, and Dominique Bechmann. 2010. Dynamic decomposition and integration of degrees of freedom for 3-D positioning. In Proceedings of the 17th ACM Symposium on Virtual Reality Software and Technology. Hong Kong, Hong Kong - November 22 - 24, 2010. ACM, New York, NY, 131.

Digital Library

[50]

Colin Ware and Jeff Rose. 1999. Rotating virtual objects with real handles. ACM Trans. Comput.-Hum. Interact. 6, 2, 162--180.

Digital Library

[51]

Carolin Wienrich, Nina Döllinger, Simon Kock, and Klaus Gramann. 2019. User-Centered Extension of a Locomotion Typology: Movement-Related Sensory Feedback and Spatial Learning. In IEEE Virtual Reality 2019. IEEE, Piscataway, N.J.

[52]

Curtis Wilkes and Doug A. Bowman. 2008. Advantages of velocity-based scaling for distant 3D manipulation. In Proceedings of the 2008 ACM symposium on Virtual reality software and technology. ACM, New York, NY, 23.

Digital Library

[53]

Chadwick A. Wingrave, Ryan Tintner, Bruce N. Walker, Doug A. Bowman, and Larry F. Hodges. 2005. Exploring Individual Differences in Raybased Selection; Strategies and Traits. In IEEE Virtual Reality 2005. IEEE, Piscataway, N.J.

Digital Library

Cited By

Yu DDingler TVelloso EGoncalves J(2024)Object Selection and Manipulation in VR Headsets: Research Challenges, Solutions, and Success MeasurementsACM Computing Surveys10.1145/370641757:4(1-34)Online publication date: 30-Nov-2024
https://dl.acm.org/doi/10.1145/3706417
Ma JQian JZhou THuang J(2023)FocalPointProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35808567:1(1-26)Online publication date: 28-Mar-2023
https://dl.acm.org/doi/10.1145/3580856
Shuai KLi YLiang H(2023)Effects of Object Complexity in Occlusion, Structure, and Texture on 3D Virtual Object Observation in Virtual Reality2023 Asia Conference on Cognitive Engineering and Intelligent Interaction (CEII)10.1109/CEII60565.2023.00013(24-28)Online publication date: 15-Dec-2023
https://doi.org/10.1109/CEII60565.2023.00013
Show More Cited By

Index Terms

A Comprehensive Classification of 3D Selection and Manipulation Techniques
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms
      1. Mixed / augmented reality
      2. Virtual reality
    2. Interaction techniques

Recommendations

Combining bimanual interaction and teleportation for 3D manipulation on multi-touch wall-sized displays
VRST '16: Proceedings of the 22nd ACM Conference on Virtual Reality Software and Technology

While multi-touch devices are well established in our everyday life, they are currently becoming larger and larger. Large screens such as wall-sized displays are now equipped with multi-touch capabilities. Multi-touch wall-sized displays will become ...
3DTouch and HOMER-S: intuitive manipulation techniques for one-handed handheld augmented reality
VRIC '13: Proceedings of the Virtual Reality International Conference: Laval Virtual

Existing interaction techniques for mobile AR often use the multi-touch capabilities of the device's display for object selection and manipulation. To provide full 3D manipulation by touch in an integral way, existing approaches use complex multi finger ...
DrillSample: precise selection in dense handheld augmented reality environments
VRIC '13: Proceedings of the Virtual Reality International Conference: Laval Virtual

One of the primary tasks in a dense mobile augmented reality (AR) environment is to ensure precise selection of an object, even if it is occluded or highly similar to surrounding virtual scene objects. Existing interaction techniques for mobile AR ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

MuC '19: Proceedings of Mensch und Computer 2019

September 2019

863 pages

ISBN:9781450371988

DOI:10.1145/3340764

Copyright © 2019 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 08 September 2019

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

MuC'19

MuC'19: Mensch-und-Computer

September 8 - 11, 2019

Hamburg, Germany

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

8
Total Citations
View Citations
455
Total Downloads

Downloads (Last 12 months)75
Downloads (Last 6 weeks)4

Reflects downloads up to 06 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Yu DDingler TVelloso EGoncalves J(2024)Object Selection and Manipulation in VR Headsets: Research Challenges, Solutions, and Success MeasurementsACM Computing Surveys10.1145/370641757:4(1-34)Online publication date: 30-Nov-2024
https://dl.acm.org/doi/10.1145/3706417
Ma JQian JZhou THuang J(2023)FocalPointProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35808567:1(1-26)Online publication date: 28-Mar-2023
https://dl.acm.org/doi/10.1145/3580856
Shuai KLi YLiang H(2023)Effects of Object Complexity in Occlusion, Structure, and Texture on 3D Virtual Object Observation in Virtual Reality2023 Asia Conference on Cognitive Engineering and Intelligent Interaction (CEII)10.1109/CEII60565.2023.00013(24-28)Online publication date: 15-Dec-2023
https://doi.org/10.1109/CEII60565.2023.00013
Giannini FBernardo MLupinetti KAnastasi SMonica LMonti MAugugliaro G(2022)Digital content interaction in 3D environments2022 IEEE International Conference on Metrology for Extended Reality, Artificial Intelligence and Neural Engineering (MetroXRAINE)10.1109/MetroXRAINE54828.2022.9967669(404-409)Online publication date: 26-Oct-2022
https://doi.org/10.1109/MetroXRAINE54828.2022.9967669
M. Bagher MSajjadi PWallgrün JLaFemina PKlippel A(2022)Virtual reality for geospatial education: immersive technologies enhance sense of embodimentCartography and Geographic Information Science10.1080/15230406.2022.212256950:3(233-248)Online publication date: 14-Nov-2022
https://doi.org/10.1080/15230406.2022.2122569
Eroglu SStefan FChevalier ARoettger DZielasko DKuhlen TWeyers B(2021)Design and Evaluation of a Free-Hand VR-based Authoring Environment for Automated Vehicle Testing2021 IEEE Virtual Reality and 3D User Interfaces (VR)10.1109/VR50410.2021.00020(1-10)Online publication date: Mar-2021
https://doi.org/10.1109/VR50410.2021.00020
Weise MZender RLucke U(2020)How Can I Grab That?i-com10.1515/icom-2020-001119:2(67-85)Online publication date: 6-Aug-2020
https://doi.org/10.1515/icom-2020-0011
Malekmakan MStuerzlinger WRiecke B(2020)Analyzing the Trade-off between Selection and Navigation in VRProceedings of the 26th ACM Symposium on Virtual Reality Software and Technology10.1145/3385956.3422123(1-3)Online publication date: 1-Nov-2020
https://dl.acm.org/doi/10.1145/3385956.3422123

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents