skip to main content
10.1145/1027933.1027982acmconferencesArticle/Chapter ViewAbstractPublication Pagesicmi-mlmiConference Proceedingsconference-collections
Article

Software infrastructure for multi-modal virtual environments

Published: 13 October 2004 Publication History

Abstract

Virtual environment systems, especially those supporting multi-modal interactions require a robust and flexible software infrastructure that supports a wide range of devices, interaction techniques, and target applications. In addition to interactivity needs, a key factor of robustness of the software is the minimization of latency and more importantly, reduction of jitter (the variability of latency). This paper presents a flexible software infrastructure that has demonstrated robustness in initial prototyping. The infrastructure, based on the VESS Libraries from the University of Central Florida, simplifies the task of creating multi-modal virtual environments. Our extensions to VESS include numerous features to support new input and output devices for new sensory modalities and interaction techniques, as well as some control over latency and jitter.

References

[1]
W. T. Barfield & T. Caudell. Fundamentals of Wearable Computers and Augmented Reality. Mahwah, NJ, Lawrence Erlbaum and Associates. 2001 .
[2]
T. B. Sheridan. Defining Our Terms, In Presence, Vol. 1, Number 2, MIT pp. 272--274. 1992.
[3]
S. Oviatt. Multi-modal Interfaces. Chapter in Handbook of Human-Computer Interaction. Mahwah, NJ, Lawrence Erlbaum and Associates. 2002.
[4]
S. K. Card, T. P. Moran, & A. Newell. The Psychology of Human Computer Interaction. Hillsdale, NJ. Lawrence Erlbaum Associates. 1983.
[5]
G. V. Popescu, G. C. Burdea, & H. Trefftz. Multi-modal Interaction Modeling. Chapter in Handbook of Virtual Environments. Mahwah, NJ, Lawrence Erlbaum Associates 2002.
[6]
N. I. Durlach, & A. S. Mavor. Virtual Reality: Scientific and Technological Challenges. Washington, DC, National Academy Press. 1995.
[7]
B. D. Adelstein, E. R. Johnston., & S. R. Ellis. Dynamic Response of Electromagnetic Spatial Displacement Trackers. In Presence, Vol. 5, Number 3, MIT. Summer 1996.
[8]
R. H. Jacoby, B. D. Adelstein, & S. R. Ellis. Improved Temporal Response in Virtual Environments Through System Hardware and Software Reorganization. In Proceedings of SPIE, 2653: Stereoscopic Displays and Virtual Reality Systems III, Society of Photographic and Information Engineers. 1996.
[9]
M. Meehan, S. Razzaque, M. C. Whitton, & F. P. Brooks. Effect of Latency on Presence in Stressful Virtual Environments. In Proceedings of IEEE Virtual Reality 2003 (VR '03). Institute of Electrical and Electronics Engineers, 2003.
[10]
http://www.sense8.com/products/wtk.html
[11]
C. Shawn, J. Liang, M. Green, & Y. Sun. The Decoupled Simulation Model for Virtual Reality Systems. In Proceedings of the ACM SIGCHI Human Factors in Computer Systems Conference. 1992.
[12]
http://www.vrco.com/products/cavelib_main.html
[13]
A. Bierbaum, C. Just, P. Hartling, & K. Meinert VR Juggler: A Virtual Platform for Basic Virtual Reality Application Development. In Proceedings of the IEEE Virtual Reality 2001 Conference. Yokohama, Japan. March 2001.
[14]
L. Arsenault, J. Kelso, R. Kriz, & F. Das Neves. DIVERSE: A Software Toolkit to Integrate Distributed Simulations with Heterogeneous Virtual Environments. In Proceedings of the 7th Annual Joint Aerospace Weapons Systems Support, Sensors, and Simulation Symposium and Exhibition, San Diego, CA. July 2001.
[15]
G. D. Kessler, D. A. Bowman, & L. F. Hodges. The Simple Virtual Environment Library: An Extensible Framework for Building VE Applications. In Presence, MIT.April 2000.
[16]
K. A. Parsons. A Research Testbed for Virtual Environment Training Applications for Dismounted Soldiers. In Proceedings of the IMAGE 98 Conference, Image Society, 1998.
[17]
J. Daly, B. Kline, & G. A. Martin. VESS: Coordinating Graphics, Audio, and User Interaction in Virtual Reality Applications. In Proceedings of the IEEE Virtual Reality 2002 Conference, Orlando, FL, March 2002.
[18]
http://www.sgi.com/software/performer/
[19]
http://www.openscenegraph.org/
[20]
K. S. Park and R.V. Kenyon. Effects of Network Characteristics on Human Performance in a Collaborative Virtual Environ, In Proceedings of the IEEE Virtual Reality 1999 Conference, Houston, TX, March 1999.

Cited By

View all

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
ICMI '04: Proceedings of the 6th international conference on Multimodal interfaces
October 2004
368 pages
ISBN:1581139950
DOI:10.1145/1027933
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 13 October 2004

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. augmented environments
  2. haptics
  3. latency
  4. multi-modal interfaces
  5. olfaction
  6. software infrastructure
  7. virtual environments

Qualifiers

  • Article

Conference

ICMI04
Sponsor:

Acceptance Rates

Overall Acceptance Rate 453 of 1,080 submissions, 42%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)2
  • Downloads (Last 6 weeks)0
Reflects downloads up to 14 Sep 2024

Other Metrics

Citations

Cited By

View all

View Options

Get Access

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media