research-article

Public Access

FocalPoint: Adaptive Direct Manipulation for Selecting Small 3D Virtual Objects

Authors:

Jeff HuangAuthors Info & Claims

Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, Volume 7, Issue 1

Article No.: 22, Pages 1 - 26

https://doi.org/10.1145/3580856

Published: 28 March 2023 Publication History

Abstract

We propose FocalPoint, a direct manipulation technique in smartphone augmented reality (AR) for selecting small densely-packed objects within reach, a fundamental yet challenging task in AR due to the required accuracy and precision. FocalPoint adaptively and continuously updates a cylindrical geometry for selection disambiguation based on the user's selection history and hand movements. This design is informed by a preliminary study which revealed that participants preferred selecting objects appearing in particular regions of the screen. We evaluate FocalPoint against a baseline direct manipulation technique in a 12-participant study with two tasks: selecting a 3 mm wide target from a pile of cubes and virtually decorating a house with LEGO pieces. FocalPoint was three times as accurate for selecting the correct object and 5.5 seconds faster on average; participants using FocalPoint decorated their houses more and were more satisfied with the result. We further demonstrate the finer control enabled by FocalPoint in example applications of robot repair, 3D modeling, and neural network visualizations.

Supplemental Material

ZIP File - ma

Supplemental movie, appendix, image and software files for, FocalPoint: Adaptive Direct Manipulation for Selecting Small 3D Virtual Objects

Download
65.26 MB

References

[1]

Shan An, Xiajie Zhang, Dong Wei, Haogang Zhu, Jianyu Yang, and Konstantinos A. Tsintotas. 2021. Fast Monocular Hand Pose Estimation on Embedded Systems. https://doi.org/10.48550/ARXIV.2102.07067

[2]

C. Andujar and F. Argelaguet. 2006. Friction surfaces: scaled ray-casting manipulation for interacting with 2D GUIs. In Eurographics Symposium on Virtual Environments, Ming Lin and Roger Hubbold (Eds.). The Eurographics Association. https://doi.org/10.2312/EGVE/EGVE06/101-108

[3]

Myroslav Bachynskyi, Gregorio Palmas, Antti Oulasvirta, Jürgen Steimle, and Tino Weinkauf. 2015. Performance and Ergonomics of Touch Surfaces: A Comparative Study Using Biomechanical Simulation. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (Seoul, Republic of Korea) (CHI '15). Association for Computing Machinery, New York, NY, USA, 1817--1826. https://doi.org/10.1145/2702123.2702607

Digital Library

[4]

Felipe Bacim, Mahdi Nabiyouni, and Doug A. Bowman. 2014. Slice-n-Swipe: A free-hand gesture user interface for 3D point cloud annotation. In 2014 IEEE Symposium on 3D User Interfaces (3DUI). 185--186. https://doi.org/10.1109/3DUI.2014.6798882

[5]

Huidong Bai, Gun A. Lee, Mukundan Ramakrishnan, and Mark Billinghurst. 2014. 3D Gesture Interaction for Handheld Augmented Reality. In SIGGRAPH Asia 2014 Mobile Graphics and Interactive Applications (Shenzhen, China) (SA '14). Association for Computing Machinery, New York, NY, USA, Article 7, 6 pages. https://doi.org/10.1145/2669062.2669073

Digital Library

[6]

Hrvoje Benko and Steven Feiner. 2007. Balloon Selection: A Multi-Finger Technique for Accurate Low-Fatigue 3D Selection. In 2007 IEEE Symposium on 3D User Interfaces. https://doi.org/10.1109/3DUI.2007.340778

[7]

Elisheva Bonchek-Dokow and Gal A Kaminka. 2014. Towards computational models of intention detection and intention prediction. Cognitive Systems Research 28 (2014), 44--79.

Digital Library

[8]

Volkert Buchmann, Stephen Violich, Mark Billinghurst, and Andy Cockburn. 2004. FingARtips: Gesture Based Direct Manipulation in Augmented Reality. In Proceedings of the 2nd International Conference on Computer Graphics and Interactive Techniques in Australasia and South East Asia (Singapore) (GRAPHITE '04). Association for Computing Machinery, New York, NY, USA, 212--221. https://doi.org/10.1145/988834.988871

Digital Library

[9]

Jeffrey Cashion, Chadwick Wingrave, and Joseph J. LaViola Jr. 2012. Dense and Dynamic 3D Selection for Game-Based Virtual Environments. IEEE Transactions on Visualization and Computer Graphics 18, 4 (2012), 634--642. https://doi.org/10.1109/TVCG.2012.40

Digital Library

[10]

Gerwin de Haan, Michal Koutek, and Frits H. Post. 2005. IntenSelect: Using Dynamic Object Rating for Assisting 3D Object Selection. In Proceedings of the 11th Eurographics Conference on Virtual Environments (Aalborg, Denmark) (EGVE'05). Eurographics Association, Goslar, DEU, 201--209.

[11]

Henrique G Debarba, Jerônimo G Grandi, Anderson Maciel, Luciana Nedel, and Ronan Boulic. 2013. Disambiguation canvas: A precise selection technique for virtual environments. In IFIP Conference on Human-Computer Interaction. Springer, 388--405.

[12]

William Delamare, Céline Coutrix, and Laurence Nigay. 2013. Mobile Pointing Task in the Physical World: Balancing Focus and Performance While Disambiguating. In Proceedings of the 15th International Conference on Human-Computer Interaction with Mobile Devices and Services (Munich, Germany) (MobileHCI '13). Association for Computing Machinery, New York, NY, USA, 89--98. https://doi.org/10.1145/2493190.2493232

Digital Library

[13]

Augusto Esteves, Elizabeth Bouquet, Ken Pfeuffer, and Florian Alt. 2022. One-Handed Input for Mobile Devices via Motion Matching and Orbits Controls. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 6, 2, Article 51 (jul 2022), 24 pages. https://doi.org/10.1145/3534624

Digital Library

[14]

Alex Olwal Steven Feiner. 2003. The flexible pointer: An interaction technique for selection in augmented and virtual reality. In Proc. UIST, Vol. 3. 81--82.

[15]

Andrew Forsberg, Kenneth Herndon, and Robert Zeleznik. 1996. Aperture Based Selection for Immersive Virtual Environments. In Proceedings of the 9th Annual ACM Symposium on User Interface Software and Technology (Seattle, Washington, USA) (UIST '96). Association for Computing Machinery, New York, NY, USA, 95--96. https://doi.org/10.1145/237091.237105

Digital Library

[16]

Euan Freeman, Julie Williamson, Sriram Subramanian, and Stephen Brewster. 2018. Point-and-Shake: Selecting from Levitating Object Displays. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI '18). Association for Computing Machinery, New York, NY, USA, 1--10. https://doi.org/10.1145/3173574.3173592

Digital Library

[17]

Scott Frees. 2010. Context-driven interaction in immersive virtual environments. Virtual reality 14, 4 (2010), 277--290.

[18]

Scott Frees, G. Drew Kessler, and Edwin Kay. 2007. PRISM Interaction for Enhancing Control in Immersive Virtual Environments. ACM Trans. Comput.-Hum. Interact. 14, 1 (may 2007), 2-es. https://doi.org/10.1145/1229855.1229857

Digital Library

[19]

Liuhao Ge, Zhou Ren, Yuncheng Li, Zehao Xue, Yingying Wang, Jianfei Cai, and Junsong Yuan. 2019. 3D Hand Shape and Pose Estimation from a Single RGB Image. arXiv. https://doi.org/10.48550/ARXIV.1903.00812

[20]

György Gergely and Gergely Csibra. 2003. Teleological reasoning in infancy: The naive theory of rational action. Trends in cognitive sciences 7, 7 (2003), 287--292.

[21]

Leo Gombač, Klen Čopič Pucihar, Matjaž Kljun, Paul Coulton, and Jan Grbac. 2016. 3D Virtual Tracing and Depth Perception Problem on Mobile AR. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems (San Jose, California, USA) (CHI EA '16). Association for Computing Machinery, New York, NY, USA, 1849--1856. https://doi.org/10.1145/2851581.2892412

Digital Library

[22]

Tovi Grossman and Ravin Balakrishnan. 2006. The Design and Evaluation of Selection Techniques for 3D Volumetric Displays. In Proceedings of the 19th Annual ACM Symposium on User Interface Software and Technology (Montreux, Switzerland) (UIST '06). Association for Computing Machinery, New York, NY, USA, 3--12. https://doi.org/10.1145/1166253.1166257

Digital Library

[23]

Faizan Haque, Mathieu Nancel, and Daniel Vogel. 2015. Myopoint: Pointing and Clicking Using Forearm Mounted Electromyography and Inertial Motion Sensors. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (Seoul, Republic of Korea) (CHI '15). Association for Computing Machinery, New York, NY, USA, 3653--3656. https://doi.org/10.1145/2702123.2702133

Digital Library

[24]

Otmar Hilliges, David Kim, Shahram Izadi, Malte Weiss, and Andrew Wilson. 2012. HoloDesk: Direct 3d Interactions with a Situated See-through Display. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Austin, Texas, USA) (CHI '12). Association for Computing Machinery, New York, NY, USA, 2421--2430. https://doi.org/10.1145/2207676.2208405

Digital Library

[25]

B.Jackson, B. Jelke, and G. Brown. 2018. Yea Big, Yea High: A 3D User Interface for Surface Selection by Progressive Refinement in Virtual Environments. In 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). 320--326. https://doi.org/10.1109/VR.2018.8447559

[26]

Richard H. Jacoby, Mark Ferneau, and Jim Humphries. 1994. Gestural interaction in a virtual environment. In Stereoscopic Displays and Virtual Reality Systems, Scott S. Fisher, John O. Merritt, and Mark T. Bolas (Eds.), Vol. 2177. International Society for Optics and Photonics, SPIE, 355 - 364. https://doi.org/10.1117/12.173892

[27]

James Jessiman. 1995. LDraw, LEGO CAD software package. LDraw Organization. https://www.ldraw.org/

[28]

Michelle E Kiger and Lara Varpio. 2020. Thematic analysis of qualitative data: AMEE Guide No. 131. Medical teacher 42, 8 (2020), 846--854.

[29]

Minseok Kim and Jae Yeol Lee. 2016. Touch and Hand Gesture-Based Interactions for Directly Manipulating 3D Virtual Objects in Mobile Augmented Reality. Multimedia Tools Appl. 75, 23 (dec 2016), 16529--16550. https://doi.org/10.1007/s11042-016-3355-9

Digital Library

[30]

Shalva Kohen, Carmine Elvezio, and Steven Feiner. 2020. MiXR: A Hybrid AR Sheet Music Interface for Live Performance. In 2020 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct). 76--77. https://doi.org/10.1109/ISMAR-Adjunct51615.2020.00035

[31]

Regis Kopper, Felipe Bacim, and Doug A. Bowman. 2011. Rapid and accurate 3D selection by progressive refinement. In 2011 IEEE Symposium on 3D User Interfaces (3DUI). 67--74. https://doi.org/10.1109/3DUI.2011.5759219

[32]

Yann LeCun, Corinna Cortes, and Christopher J.C. Burges. 1998. The MNIST database of handwritten digits. http://yann.lecun.com/exdb/mnist/.

[33]

Jiandong Liang and Mark Green. 1994. JDCAD: A highly interactive 3D modeling system. Computers & graphics 18, 4 (1994), 499--506.

[34]

Yiqin Lu, Chun Yu, and Yuanchun Shi. 2020. Investigating Bubble Mechanism for Ray-Casting to Improve 3D Target Acquisition in Virtual Reality. In 2020 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). 35--43. https://doi.org/10.1109/VR46266.2020.00021

[35]

John Finley Lucas. 2005. Design and Evaluation of 3D Multiple Object Selection Techniques. Ph.D. Dissertation. Virginia Tech.

[36]

ManoMotion. 2022. ManoMotion Gesture Technology. ManoMotion. https://www.manomotion.com/

[37]

Andrew N Meltzoff, Alison Gopnik, and Betty M Repacholi. 1999. Toddlers' understanding of intentions, desires and emotions: Explorations of the dark ages. In Developing theories of intention: Social understanding and self-control. Lawrence Erlbaum Associates Publishers, Mahwah, NJ, USA, 17--41.

[38]

Mathias Moehring and Bernd Froehlich. 2011. Natural Interaction Metaphors for Functional Validations of Virtual Car Models. IEEE Transactions on Visualization and Computer Graphics 17, 9 (2011), 1195--1208. https://doi.org/10.1109/TVCG.2011.36

Digital Library

[39]

Annette Mossel, Benjamin Venditti, and Hannes Kaufmann. 2013. DrillSample: Precise Selection in Dense Handheld Augmented Reality Environments. In Proceedings of the Virtual Reality International Conference: Laval Virtual (Laval, France) (VRIC '13). Association for Computing Machinery, New York, NY, USA, Article 10, 10 pages. https://doi.org/10.1145/2466816.2466827

Digital Library

[40]

Dimitris Mourtzis, Vasilios Zogopoulos, and E Vlachou. 2017. Augmented reality application to support remote maintenance as a service in the robotics industry. Procedia Cirp 63 (2017), 46--51.

[41]

Florian Müller, Mohammadreza Khalilbeigi, Niloofar Dezfuli, Alireza Sahami Shirazi, Sebastian Günther, and Max Mühlhäuser. 2015. A Study on Proximity-Based Hand Input for One-Handed Mobile Interaction. In Proceedings of the 3rd ACM Symposium on Spatial User Interaction (Los Angeles, California, USA) (SUI '15). Association for Computing Machinery, New York, NY, USA, 53--56. https://doi.org/10.1145/2788940.2788955

Digital Library

[42]

A. Olwal, H. Benko, and S. Feiner. 2003. SenseShapes: using statistical geometry for object selection in a multimodal augmented reality. In The Second IEEE and ACM International Symposium on Mixed and Augmented Reality, 2003. Proceedings. 300--301. https://doi.org/10.1109/ISMAR.2003.1240730

[43]

Michaêl Ortega. 2013. Hook: Heuristics for selecting 3D moving objects in dense target environments. In 2013 IEEE Symposium on 3D User Interfaces (3DUI). 119--122. https://doi.org/10.1109/3DUI.2013.6550208

[44]

Pekka Parhi, Amy K. Karlson, and Benjamin B. Bederson. 2006. Target Size Study for One-Handed Thumb Use on Small Touchscreen Devices. In Proceedings of the 8th Conference on Human-Computer Interaction with Mobile Devices and Services (Helsinki, Finland) (MobileHCI '06). Association for Computing Machinery, New York, NY, USA, 203--210. https://doi.org/10.1145/1152215.1152260

Digital Library

[45]

Frol Periverzov and Horea Ilieş. 2015. IDS: The intent driven selection method for natural user interfaces. In 2015 IEEE Symposium on 3D User Interfaces (3DUI). 121--128. https://doi.org/10.1109/3DUI.2015.7131736

[46]

Jiamin Ping, Bruce H. Thomas, James Baumeister, Jie Guo, Dongdong Weng, and Yue Liu. 2020. Effects of shading model and opacity on depth perception in optical see-through augmented reality. Journal of the Society for Information Display 28, 11 (2020), 892--904. https://doi.org/10.1002/jsid.947 arXiv:https://onlinelibrary.wiley.com/doi/pdf/10.1002/jsid.947

[47]

Thammathip Piumsomboon, Adrian Clark, Mark Billinghurst, and Andy Cockburn. 2013. User-Defined Gestures for Augmented Reality. In Human-Computer Interaction - INTERACT 2013, Paula Kotzé, Gary Marsden, Gitte Lindgaard, Janet Wesson, and Marco Winckler (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 282--299.

Digital Library

[48]

Ivan Poupyrev, Mark Billinghurst, Suzanne Weghorst, and Tadao Ichikawa. 1996. The Go-Go Interaction Technique: Non-Linear Mapping for Direct Manipulation in VR. In Proceedings of the 9th Annual ACM Symposium on User Interface Software and Technology (Seattle, Washington, USA) (UIST '96). Association for Computing Machinery, New York, NY, USA, 79--80. https://doi.org/10.1145/237091.237102

Digital Library

[49]

Jing Qian, Jiaju Ma, Xiangyu Li, Benjamin Attal, Haoming Lai, James Tompkin, John F. Hughes, and Jeff Huang. 2019. Portal-Ble: Intuitive Free-Hand Manipulation in Unbounded Smartphone-Based Augmented Reality. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology (New Orleans, LA, USA) (UIST '19). Association for Computing Machinery, New York, NY, USA, 133--145. https://doi.org/10.1145/3332165.3347904

Digital Library

[50]

Jing Qian, David A. Shamma, Daniel Avrahami, and Jacob Biehl. 2020. Modality and Depth in Touchless Smartphone Augmented Reality Interactions. In ACM International Conference on Interactive Media Experiences (Cornella, Barcelona, Spain) (IMX '20). Association for Computing Machinery, New York, NY, USA, 74--81. https://doi.org/10.1145/3391614.3393648

Digital Library

[51]

Jing Qian, Tongyu Zhou, Meredith Young-Ng, Jiaju Ma, Angel Cheung, Xiangyu Li, Ian Gonsher, and Jeff Huang. 2021. Portalware: Exploring Free-Hand AR Drawing with a Dual-Display Smartphone-Wearable Paradigm. In Designing Interactive Systems Conference 2021 (Virtual Event, USA) (DIS '21). Association for Computing Machinery, New York, NY, USA, 205--219. https://doi.org/10.1145/3461778.3462098

Digital Library

[52]

Gang Ren and Eamonn O'Neill. 2013. Special Section on Touching the 3rd Dimension: 3D Selection with Freehand Gesture. Comput. Graph. 37, 3 (may 2013), 101--120. https://doi.org/10.1016/j.cag.2012.12.006

Digital Library

[53]

Jaime Ruiz, Yang Li, and Edward Lank. 2011. User-Defined Motion Gestures for Mobile Interaction. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Vancouver, BC, Canada) (CHI '11). Association for Computing Machinery, New York, NY, USA, 197--206. https://doi.org/10.1145/1978942.1978971

Digital Library

[54]

Kunhee Ryu, Joong-Jae Lee, and Jung-Min Park. 2019. GG interaction: a gaze-grasp pose interaction for 3d virtual object selection. Journal on Multimodal User Interfaces 13, 4 (2019), 383--393.

[55]

Nazmus Saquib, Rubaiat Habib Kazi, Li-Yi Wei, and Wilmot Li. 2019. Interactive Body-Driven Graphics for Augmented Video Performance. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI '19). Association for Computing Machinery, New York, NY, USA, 1--12. https://doi.org/10.1145/3290605.3300852

Digital Library

[56]

Andreas Schreiber and Marcel Bock. 2019. Visualization and Exploration of Deep Learning Networks in 3D and Virtual Reality. In HCI International 2019 - Posters, Constantine Stephanidis (Ed.). Springer International Publishing, Cham, 206--211.

[57]

Irving Seidman. 2006. Interviewing as qualitative research: A guide for researchers in education and the social sciences. Teachers College Press, New York, NY.

[58]

Hyunggoog Seo, Jaedong Kim, Kwanggyoon Seo, Bumki Kim, and Junyong Noh. 2021. Overthere: A Simple and Intuitive Object Registration Method for an Absolute Mid-Air Pointing Interface. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 5, 3, Article 127 (sep 2021), 24 pages. https://doi.org/10.1145/3478128

Digital Library

[59]

Ludwig Sidenmark, Christopher Clarke, Xuesong Zhang, Jenny Phu, and Hans Gellersen. 2020. Outline Pursuits: Gaze-Assisted Selection of Occluded Objects in Virtual Reality. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI '20). Association for Computing Machinery, New York, NY, USA, 1--13. https://doi.org/10.1145/3313831.3376438

Digital Library

[60]

Snap Inc. 2022. Snap AR. Snap Inc. https://ar.snap.com/en-US

[61]

Anthony Steed and Chris Parker. 2004. 3D Selection Strategies for Head Tracked and Non-Head Tracked Operation of Spatially Immersive Displays. In 8th international immersive projection technology workshop, Vol. 2. 8 pages.

[62]

Junwei Sun and Wolfgang Stuerzlinger. 2019. Selecting and Sliding Hidden Objects in 3D Desktop Environments. In Proceedings of the 45th Graphics Interface Conference on Proceedings of Graphics Interface 2019 (Kingston, Canada) (GI'19). Canadian Human-Computer Communications Society, Waterloo, CAN, Article 8, 8 pages. https://doi.org/10.20380/GI2019.08

Digital Library

[63]

Minghui Sun, Mingming Cao, Limin Wang, and Qian Qian. 2020. PhoneCursor: Improving 3D Selection Performance With Mobile Device in AR. IEEE Access 8 (2020), 70616--70626. https://doi.org/10.1109/ACCESS.2020.2986037

[64]

Lode Vanacken, Tovi Grossman, and Karin Coninx. 2007. Exploring the Effects of Environment Density and Target Visibility on Object Selection in 3D Virtual Environments. In 2007 IEEE Symposium on 3D User Interfaces. https://doi.org/10.1109/3DUI.2007.340783

[65]

Philipp Wacker, Oliver Nowak, Simon Voelker, and Jan Borchers. 2019. ARPen: Mid-Air Object Manipulation Techniques for a Bimanual AR System with Pen & Smartphone. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI '19). Association for Computing Machinery, New York, NY, USA, 1--12. https://doi.org/10.1145/3290605.3300849

Digital Library

[66]

Xiyao Wang, Lonni Besançon, David Rousseau, Mickael Sereno, Mehdi Ammi, and Tobias Isenberg. 2020. Towards an Understanding of Augmented Reality Extensions for Existing 3D Data Analysis Tools. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI '20). Association for Computing Machinery, New York, NY, USA, 1--13. https://doi.org/10.1145/3313831.3376657

Digital Library

[67]

Matthias Weise, Raphael Zender, and Ulrike Lucke. 2019. A Comprehensive Classification of 3D Selection and Manipulation Techniques. In Proceedings of Mensch Und Computer 2019 (Hamburg, Germany) (MuC'19). Association for Computing Machinery, New York, NY, USA, 321--332. https://doi.org/10.1145/3340764.3340777

Digital Library

[68]

Matt Whitlock, Ethan Harnner, Jed R. Brubaker, Shaun Kane, and Danielle Albers Szafir. 2018. Interacting with Distant Objects in Augmented Reality. In 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). 41--48. https://doi.org/10.1109/VR.2018.8446381

[69]

Curtis Wilkes and Doug A. Bowman. 2008. Advantages of Velocity-Based Scaling for Distant 3D Manipulation. In Proceedings of the 2008 ACM Symposium on Virtual Reality Software and Technology (Bordeaux, France) (VRST '08). Association for Computing Machinery, New York, NY, USA, 23--29. https://doi.org/10.1145/1450579.1450585

Digital Library

[70]

Pui Chung Wong, Hongbo Fu, and Kening Zhu. 2016. Back-Mirror: Back-of-Device One-Handed Interaction on Smartphones. In SIGGRAPH ASIA 2016 Mobile Graphics and Interactive Applications (Macau) (SA '16). Association for Computing Machinery, New York, NY, USA, Article 10, 5 pages. https://doi.org/10.1145/2999508.2999522

Digital Library

[71]

Jonathan Wonner, Jérôme Grosjean, Antonio Capobianco, and Dominique Bechmann. 2012. Starfish: A Selection Technique for Dense Virtual Environments. In Proceedings of the 18th ACM Symposium on Virtual Reality Software and Technology (Toronto, Ontario, Canada) (VRST '12). Association for Computing Machinery, New York, NY, USA, 101--104. https://doi.org/10.1145/2407336.2407356

Digital Library

[72]

Rulei Yu and Lei Shi. 2018. A user-based taxonomy for deep learning visualization. Visual Informatics 2, 3 (2018), 147--154. https://doi.org/10.1016/j.visinf.2018.09.001

[73]

Cik Suhaimi Yusof, Huidong Bai, Mark Billinghurst, and Mohd Shahrizal Sunar. 2016. A review of 3D gesture interaction for handheld augmented reality. Jurnal Teknologi 78, 2--2 (2016).

[74]

Fan Zhang, Valentin Bazarevsky, Andrey Vakunov, Andrei Tkachenka, George Sung, Chuo-Ling Chang, and Matthias Grundmann. 2020. MediaPipe Hands: On-device Real-time Hand Tracking. https://doi.org/10.48550/ARXIV.2006.10214

[75]

Tengxiang Zhang, Xin Yi, Ruolin Wang, Jiayuan Gao, Yuntao Wang, Chun Yu, Simin Li, and Yuanchun Shi. 2019. Facilitating Temporal Synchronous Target Selection through User Behavior Modeling. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 3, 4, Article 159 (dec 2019), 24 pages. https://doi.org/10.1145/3369839

Digital Library

[76]

Feng Zhou, Henry Been-Lirn Duh, and Mark Billinghurst. 2008. Trends in augmented reality tracking, interaction and display: A review of ten years of ISMAR. In 2008 7th IEEE/ACM International Symposium on Mixed and Augmented Reality. 193--202. https://doi.org/10.1109/ISMAR.2008.4637362

Digital Library

Cited By

Bashar MBatmaz A(2024)Virtual Task Environments Factors Explored in 3D Selection StudiesProceedings of the 50th Graphics Interface Conference10.1145/3670947.3670983(1-16)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3670947.3670983
Tan XLv XJiang JZhang L(2024)Understanding Real-Time Collaborative Programming: A Study of Visual Studio Live ShareACM Transactions on Software Engineering and Methodology10.1145/364367233:4(1-28)Online publication date: 20-Apr-2024
https://dl.acm.org/doi/10.1145/3643672

Index Terms

FocalPoint: Adaptive Direct Manipulation for Selecting Small 3D Virtual Objects
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms
      1. Mixed / augmented reality
    2. Interaction techniques
      1. Gestural input
      2. Pointing

Recommendations

Haptics in Augmented Reality
ICMCS '99: Proceedings of the IEEE International Conference on Multimedia Computing and Systems - Volume 2

An augmented reality system merges synthetic sensory information into a user's perception of a three-dimensional environment. An important performance goal for an augmented reality system is that the user perceives a single seamless environment. In most ...
Pseudo-softness evaluation in grasping a virtual object with a bare hand
SIGGRAPH '16: ACM SIGGRAPH 2016 Posters

Bare hand interaction with a virtual object reduces uncomfortableness with devices mounted on a user's hand. There are some studies on the bare hand interaction[Benko et al. 2012], however a virtual object is supposed to be a hard object or a user ...
Can Haptic Feedback on One Virtual Object Increase the Presence of Another Virtual Object?
VRST '22: Proceedings of the 28th ACM Symposium on Virtual Reality Software and Technology

This paper investigated whether increased presence from experiencing haptic feedback on one virtual object can transfer to another virtual object. Two similar studies were run in different environments: an immersive virtual environment and a mixed ...

Comments

Information & Contributors

Information

Published In

cover image Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies

Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies Volume 7, Issue 1

March 2023

1243 pages

EISSN:2474-9567

DOI:10.1145/3589760

Issue’s Table of Contents

Copyright © 2023 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 28 March 2023

Published in IMWUT Volume 7, Issue 1

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed

Funding Sources

National Science Foundation

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
648
Total Downloads

Downloads (Last 12 months)316
Downloads (Last 6 weeks)39

Reflects downloads up to 06 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Bashar MBatmaz A(2024)Virtual Task Environments Factors Explored in 3D Selection StudiesProceedings of the 50th Graphics Interface Conference10.1145/3670947.3670983(1-16)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3670947.3670983
Tan XLv XJiang JZhang L(2024)Understanding Real-Time Collaborative Programming: A Study of Visual Studio Live ShareACM Transactions on Software Engineering and Methodology10.1145/364367233:4(1-28)Online publication date: 20-Apr-2024
https://dl.acm.org/doi/10.1145/3643672

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

Media

Figures

Other

Tables

View Issue’s Table of Contents