research-article

T(ether): spatially-aware handhelds, gestures and proprioception for multi-user 3D modeling and animation

Authors:

Matthew Blackshaw,

Zachary Barryte,

Hiroshi IshiiAuthors Info & Claims

SUI '14: Proceedings of the 2nd ACM symposium on Spatial user interaction

Pages 90 - 93

https://doi.org/10.1145/2659766.2659785

Published: 04 October 2014 Publication History

Abstract

T(ether) is a spatially-aware display system for multi-user, collaborative manipulation and animation of virtual 3D objects. The handheld display acts as a window into virtual reality, providing users with a perspective view of 3D data. T(ether) tracks users' heads, hands, fingers and pinching, in addition to a handheld touch screen, to enable rich interaction with the virtual scene. We introduce gestural interaction techniques that exploit proprioception to adapt the UI based on the hand's position above, behind or on the surface of the display. These spatial interactions use a tangible frame of reference to help users manipulate and animate the model in addition to controlling environment properties. We report on initial user observations from an experiment for 3D modeling, which indicate T(ether)'s potential for embodied viewport control and 3D modeling interactions.

Supplementary Material

suppl.mov (suifp0177-file3.m4v)

Supplemental video

Download
33.76 MB

References

[1]

Agrawala, M., Beers, A., McDowall, I., Fröhlich, B., Bolas, M., and Hanrahan, P. The two-user Responsive Workbench: support for collaboration through individual views of a shared space. Proc. SIGGRAPH '97, 327--332.

Digital Library

[2]

Bau, O., Poupyrev, I., Israr, A., and Harrison, C. TeslaTouch: electrovibration for touch surfaces. Proc. UIST '10. 283--292.

Digital Library

[3]

Bowman, D., and Hodges, L., F. An evaluation of techniques for grabbing and manipulating remote objects in immersive virtual environments. Proc. I3D '97, 35--39.

Digital Library

[4]

Fitzmaurice, G.W. Situated Information Spaces and Spatially Aware Palmtop Computers. Com. ACM (1993), 36(7), 38--49.

Digital Library

[5]

Grossman, T. and Balakrishnan, R. Collaborative interaction with volumetric displays. Proc. CHI '08, 383--392.

Digital Library

[6]

Henrysson, A., Billinghurst, M., and Ollila, M. Virtual object manipulation using a mobile phone. Proc. ICAT '05, 164--171.

Digital Library

[7]

Leithinger, D., Lakatos, D., DeVincenzi, A., Blackshaw, M., and Ishii, H. Direct and gestural interaction with relief: a 2.5D shape display. Proc. UIST '11, 541--548.

Digital Library

[8]

McKenna, M. Interactive viewpoint control and threedimensional operations. Proc. I3D '92, 53--56.

Digital Library

[9]

Mine, M. R. 1996. Working in a Virtual World: Interaction Techniques Used in the Chapel Hill Immersive Modeling Program. Technical Report.

Digital Library

[10]

Piekarski, W., Thomas, B. H. Through-Walls Collaboration. IEEE Pervasive Computing 8(3), 42--49.

Digital Library

[11]

Poupyrev, I., Tomokazu, N., Weghorst, S., Virtual Notepad: handwriting in immersive VR. Proc. VR '98. 126--132.

Digital Library

[12]

Shaw, C. Pain and Fatigue in Desktop VR. Proc. GI '98. 185192.

[13]

Spindler, M., Büschel, W., and Dachselt, R. Use Your Head: Tangible Windows for 3D Information Spaces in a Tabletop environment. Proc. ITS '12, 245--254.

Digital Library

[14]

Szalavári, Z., Schmalstieg, D., Fuhrmann, A. and Gervautz, M. Studierstube: An environment for collaboration in augmented reality. Virtual Reality (1998), 3:37--48.

[15]

Szalavári, Zs, Gervautz, M. The Personal Interaction Panel -- a Two-Handed Interface for Augmented Reality. Computer Graphics Forum (1997), 16(3).

[16]

Tsang, M., Fitzmaurice, G, Kurtenbach, G., Khan A., and Buxton, B. Boom chameleon: simultaneous capture of 3D viewpoint, voice and gesture annotations on a spatially-aware display. Proc. UIST '02, 111--120.

Digital Library

[17]

Yee, K-P. Peephole displays: pen interaction on spatially aware handheld computers. Proc. CHI '03, 1--8.

Digital Library

[18]

Yokokohji, Y., Hollis, R. L., and Kanade, T. What you can see is what you can feel Development of a visual/haptic interface to virtual environment. Proc. VRAIS '96, 46--53.

Digital Library

Cited By

Hill CHunt CCrowder SFiedler BMoore EEisenberg A(2023)Investigating Sensory Extensions as Input for Interactive SimulationsProceedings of the Seventeenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3569009.3573108(1-7)Online publication date: 26-Feb-2023
https://dl.acm.org/doi/10.1145/3569009.3573108
Zou QBai HGao LLee GFowler ABillinghurst M(2023)Stylus and Gesture Asymmetric Interaction for Fast and Precise Sketching in Virtual RealityInternational Journal of Human–Computer Interaction10.1080/10447318.2023.227829440:23(8124-8141)Online publication date: 15-Nov-2023
https://doi.org/10.1080/10447318.2023.2278294
Babic TReiterer HHaller M(2022)Understanding and Creating Spatial Interactions with Distant Displays Enabled by Unmodified Off-The-Shelf SmartphonesMultimodal Technologies and Interaction10.3390/mti61000946:10(94)Online publication date: 19-Oct-2022
https://doi.org/10.3390/mti6100094
Show More Cited By

Index Terms

T(ether): spatially-aware handhelds, gestures and proprioception for multi-user 3D modeling and animation
1. Computing methodologies
  1. Computer graphics
2. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Balloon selection revisited: multi-touch selection techniques for stereoscopic data
AVI '12: Proceedings of the International Working Conference on Advanced Visual Interfaces

With the increasing distribution of multi-touch capable devices multi-touch interaction becomes more and more ubiquitous. Especially the interaction with complex data (e.g. medical or geographical data), which until today mostly rely on mice and ...
Development strategies for tangible interaction on horizontal surfaces
TEI '10: Proceedings of the fourth international conference on Tangible, embedded, and embodied interaction

Tangible interactions on horizontal surfaces are increasingly relevant for collaborative applications, embodied interaction, musical performance, and interaction with 3D information. This unique studio opportunity introduces approaches to developing ...
Exploring 3D manipulation on large stereoscopic displays
PerDis '16: Proceedings of the 5th ACM International Symposium on Pervasive Displays

In the last years stereoscopic 3D has seen a drastic increase in popularity especially in terms of consumer-ready hardware and software. While the technology for input (smart-phone, Kinect, etc.) as well as output (passive/active stereoscopic and auto-...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

SUI '14: Proceedings of the 2nd ACM symposium on Spatial user interaction

October 2014

174 pages

ISBN:9781450328203

DOI:10.1145/2659766

General Chair:
Andy Wilson
Microsoft Research, USA
,
Program Chairs:
Frank Steinicke
University of Hamburg, Germany
,
Evan Suma
University of Southern California, USA
,
Wolfgang Stuerzlinger
York University, Canada

Copyright © 2014 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 04 October 2014

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Vetenskapsrädet

Conference

SUI '14

Sponsor:

SUI '14: Symposium on Spatial User Interaction

October 4 - 5, 2014

Hawaii, Honolulu, USA

Acceptance Rates

SUI '14 Paper Acceptance Rate 18 of 62 submissions, 29%;

Overall Acceptance Rate 86 of 279 submissions, 31%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

20
Total Citations
View Citations
498
Total Downloads

Downloads (Last 12 months)20
Downloads (Last 6 weeks)3

Reflects downloads up to 08 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Hill CHunt CCrowder SFiedler BMoore EEisenberg A(2023)Investigating Sensory Extensions as Input for Interactive SimulationsProceedings of the Seventeenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3569009.3573108(1-7)Online publication date: 26-Feb-2023
https://dl.acm.org/doi/10.1145/3569009.3573108
Zou QBai HGao LLee GFowler ABillinghurst M(2023)Stylus and Gesture Asymmetric Interaction for Fast and Precise Sketching in Virtual RealityInternational Journal of Human–Computer Interaction10.1080/10447318.2023.227829440:23(8124-8141)Online publication date: 15-Nov-2023
https://doi.org/10.1080/10447318.2023.2278294
Babic TReiterer HHaller M(2022)Understanding and Creating Spatial Interactions with Distant Displays Enabled by Unmodified Off-The-Shelf SmartphonesMultimodal Technologies and Interaction10.3390/mti61000946:10(94)Online publication date: 19-Oct-2022
https://doi.org/10.3390/mti6100094
Koutny RMiesenberger K(2021)An Accessible User Interface Concept for Non-Verbal and Spatial Aspects of Business Meetings for Blind and Visually Impaired PeopleProceedings of Mensch und Computer 202110.1145/3473856.3474020(125-130)Online publication date: 5-Sep-2021
https://dl.acm.org/doi/10.1145/3473856.3474020
Suzuki RKazi RWei LDiVerdi SLi WLeithinger DIqbal SMacLean KChevalier FMueller S(2020)RealitySketchProceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology10.1145/3379337.3415892(166-181)Online publication date: 20-Oct-2020
https://dl.acm.org/doi/10.1145/3379337.3415892
Wacker PWagner AVoelker SBorchers JBernhaupt RMueller FVerweij DAndres JMcGrenere JCockburn AAvellino IGoguey ABjørn PZhao SSamson BKocielnik R(2020)Heatmaps, Shadows, Bubbles, Rays: Comparing Mid-Air Pen Position Visualizations in Handheld ARProceedings of the 2020 CHI Conference on Human Factors in Computing Systems10.1145/3313831.3376848(1-11)Online publication date: 21-Apr-2020
https://dl.acm.org/doi/10.1145/3313831.3376848
He ZDu RPerlin K(2020)CollaboVR: A Reconfigurable Framework for Creative Collaboration in Virtual Reality2020 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)10.1109/ISMAR50242.2020.00082(542-554)Online publication date: Nov-2020
https://doi.org/10.1109/ISMAR50242.2020.00082
Lee-Cultura SGiannakos M(2020)Embodied Interaction and Spatial Skills: A Systematic Review of Empirical StudiesInteracting with Computers10.1093/iwcomp/iwaa02332:4(331-366)Online publication date: 11-Nov-2020
https://doi.org/10.1093/iwcomp/iwaa023
He ZRosenberg KPerlin KBrewster SFitzpatrick GCox AKostakos V(2019)Exploring Configuration of Mixed Reality Spaces for CommunicationExtended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems10.1145/3290607.3312761(1-6)Online publication date: 2-May-2019
https://dl.acm.org/doi/10.1145/3290607.3312761
Wacker PNowak OVoelker SBorchers JBrewster SFitzpatrick GCox AKostakos V(2019)ARPenProceedings of the 2019 CHI Conference on Human Factors in Computing Systems10.1145/3290605.3300849(1-12)Online publication date: 2-May-2019
https://dl.acm.org/doi/10.1145/3290605.3300849
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten