Article

Gesture + play: full-body interaction for virtual environments

Authors:

Tollmar Konrad,

David Demirdjian,

Trevor DarrellAuthors Info & Claims

CHI EA '03: CHI '03 Extended Abstracts on Human Factors in Computing Systems

Pages 620 - 621

https://doi.org/10.1145/765891.765894

Published: 05 April 2003 Publication History

Get Access

Abstract

Navigating virtual environments usually requires a wired interface, game console, or keyboard. The advent of perceptual interface techniques allows a new option, the passive and untethered sensing of users' pose and gesture to allow them maneuver through virtual worlds. We show new algorithms for passive, real-time articulated tracking with standard cameras and personal computers. Several different interaction styles are compared, based on an analysis of the space of possible perceptual interface abstractions for full-body navigation and the results of a wizard-of-oz study of user preferences. In this demo we show our prototype system with users guiding avatars through a series of 3-D virtual game worlds.

References

[1]

Intel Research, The OpenCV Open Source Computer Vision Library, http://www.intel.com/research/mrl/ research /opencv/

Google Scholar

[2]

Krueger, M., Artificial Reality. Addison-Wesley, 1983.

Google Scholar

[3]

Maes, P., Darrell, T., Blumberg, B., and Pentland, A., The ALIVE System: Wireless, Full-Body Interaction with Autonomous Agents, ACM Multimedia Systems, Special Issue on Multimedia and Multisensory Virtual Worlds, Spring 1996

Digital Library

Google Scholar

[4]

Pt. Grey Research, Digiclops Stereo Camera, www.ptgrey.com

Google Scholar

[5]

Wyshynski Susan, The Vivid Group. The Mandala VR System. SIGGRAPH'91 Virtual Reality and Hypermedia show, 1991

Google Scholar

[6]

Zimmerman, T. G, Smith, J. R., Paradiso, J. A, Allport, D., and Gershenfeld, N., Applying Electric Field Sensing to Human-Computer Interfaces, CHI'95 Human Factors in Computing Systems, Denver, CO (1995), pp. 280--287.

Digital Library

Google Scholar

Cited By

View all

Zhou QChua CKnibbe JGoncalves JVelloso EKitamura YQuigley AIsbister KIgarashi TBjørn PDrucker S(2021)Dance and Choreography in HCI: A Two-Decade RetrospectiveProceedings of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411764.3445804(1-14)Online publication date: 6-May-2021
https://dl.acm.org/doi/10.1145/3411764.3445804
Chen WLadeveze NClavel CBourdot P(2016)Refined experiment of the altered human joystick for user cohabitation in multi-stereocopic immersive CVEs2016 IEEE Third VR International Workshop on Collaborative Virtual Environments (3DCVE)10.1109/3DCVE.2016.7563558(1-8)Online publication date: Mar-2016
https://doi.org/10.1109/3DCVE.2016.7563558
Chen WLadeveze NClavel CMestre DBourdot P(2015)User cohabitation in multi-stereoscopic immersive virtual environment for individual navigation tasks2015 IEEE Virtual Reality (VR)10.1109/VR.2015.7223323(47-54)Online publication date: Mar-2015
https://doi.org/10.1109/VR.2015.7223323
Show More Cited By

Index Terms

Gesture + play: full-body interaction for virtual environments
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
  2. Computer graphics
    1. Image manipulation
      1. Image processing
2. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Incorporating Kinesthetic Creativity and Gestural Play into Immersive Modeling
MOCO '17: Proceedings of the 4th International Conference on Movement Computing

The 3D modeling methods and approach presented in this paper attempt to bring the richness and spontaneity of human kinesthetic interaction in the physical world to the process of shaping digital form, by exploring playfully creative interaction ...
Tangible play: research and design for tangible and tabletop games
IUI '07: Proceedings of the 12th international conference on Intelligent user interfaces

This workshop addresses questions related to the areas of tangible interaction, game design and emerging technologies for tangible and tabletop games. We bring together researchers and practitioners from diverse fields related to these topics, such as ...
3D gesture interaction for handheld augmented reality
SA '14: SIGGRAPH Asia 2014 Mobile Graphics and Interactive Applications

In this paper, we present a prototype for exploring natural gesture interaction with Handheld Augmented Reality (HAR) applications, using visual tracking based AR and freehand gesture based interaction detected by a depth camera. We evaluated this ...

Comments

Information & Contributors

Information

Published In

CHI EA '03: CHI '03 Extended Abstracts on Human Factors in Computing Systems

April 2003

471 pages

ISBN:1581136374

DOI:10.1145/765891

Conference Chairs:
Gilbert Cockton
University of Sunderland, UK
,
Panu Korhonen
Nokia Research Center, Finland

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 05 April 2003

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Article

Conference

CHI03

Sponsor:

CHI03: Human Factors in Computing Systems

April 5 - 10, 2003

Florida, Ft. Lauderdale, USA

Acceptance Rates

Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

10
Total Citations
View Citations
1,006
Total Downloads

Downloads (Last 12 months)8
Downloads (Last 6 weeks)1

Reflects downloads up to 23 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Zhou QChua CKnibbe JGoncalves JVelloso EKitamura YQuigley AIsbister KIgarashi TBjørn PDrucker S(2021)Dance and Choreography in HCI: A Two-Decade RetrospectiveProceedings of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411764.3445804(1-14)Online publication date: 6-May-2021
https://dl.acm.org/doi/10.1145/3411764.3445804
Chen WLadeveze NClavel CBourdot P(2016)Refined experiment of the altered human joystick for user cohabitation in multi-stereocopic immersive CVEs2016 IEEE Third VR International Workshop on Collaborative Virtual Environments (3DCVE)10.1109/3DCVE.2016.7563558(1-8)Online publication date: Mar-2016
https://doi.org/10.1109/3DCVE.2016.7563558
Chen WLadeveze NClavel CMestre DBourdot P(2015)User cohabitation in multi-stereoscopic immersive virtual environment for individual navigation tasks2015 IEEE Virtual Reality (VR)10.1109/VR.2015.7223323(47-54)Online publication date: Mar-2015
https://doi.org/10.1109/VR.2015.7223323
Rautaray SAgrawal A(2015)Vision based hand gesture recognition for human computer interactionArtificial Intelligence Review10.1007/s10462-012-9356-943:1(1-54)Online publication date: 1-Jan-2015
https://dl.acm.org/doi/10.1007/s10462-012-9356-9
Jang SElmqvist NRamani KWilson ASteinicke FSuma EStuerzlinger W(2014)GestureAnalyzerProceedings of the 2nd ACM symposium on Spatial user interaction10.1145/2659766.2659772(30-39)Online publication date: 4-Oct-2014
https://dl.acm.org/doi/10.1145/2659766.2659772
Asaari MRosdi BSuandi S(2014)Intelligent Biometric Group Hand Tracking (IBGHT) database for visual hand tracking research and developmentMultimedia Tools and Applications10.1007/s11042-012-1212-z70:3(1869-1898)Online publication date: 1-Jun-2014
https://dl.acm.org/doi/10.1007/s11042-012-1212-z
Penner EParker JKapralos BKatchabaw MRajnovich J(2007)The virtual window simulatorProceedings of the 2007 conference on Future Play10.1145/1328202.1328213(54-60)Online publication date: 14-Nov-2007
https://dl.acm.org/doi/10.1145/1328202.1328213
Samanci ÖChen YMazalek AInakage MLee NTscheligi MBernhaupt RNatkin S(2007)Tangible comicsProceedings of the international conference on Advances in computer entertainment technology10.1145/1255047.1255082(171-178)Online publication date: 13-Jun-2007
https://dl.acm.org/doi/10.1145/1255047.1255082
Ye ZDykstra-Erickson ETscheligi M(2004)Genres as a tool for understanding and analyzing user experience in gamesCHI '04 Extended Abstracts on Human Factors in Computing Systems10.1145/985921.985929(773-774)Online publication date: 24-Apr-2004
https://dl.acm.org/doi/10.1145/985921.985929
Kaiser EOlwal AMcGee DBenko HCorradini ALi XCohen PFeiner SOviatt SDarrell TMaybury MWahlster W(2003)Mutual disambiguation of 3D multimodal interaction in augmented and virtual realityProceedings of the 5th international conference on Multimodal interfaces10.1145/958432.958438(12-19)Online publication date: 5-Nov-2003
https://dl.acm.org/doi/10.1145/958432.958438

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Incorporating Kinesthetic Creativity and Gestural Play into Immersive Modeling

Tangible play: research and design for tangible and tabletop games

3D gesture interaction for handheld augmented reality