research-article

Navigation and interaction in a real-scale digital mock-up using natural language and user gesture

Authors:

J.-R. Chardonnet,

A. GentyAuthors Info & Claims

VRIC '14: Proceedings of the 2014 Virtual Reality International Conference

Article No.: 28, Pages 1 - 4

https://doi.org/10.1145/2617841.2620716

Published: 09 April 2014 Publication History

Abstract

This paper tries to demonstrate a very new real-scale 3D system and sum up some firsthand and cutting edge results concerning multi-modal navigation and interaction interfaces. This work is part of the CALLISTO-SARI collaborative project. It aims at constructing an immersive room, developing a set of software tools and some navigation/interaction interfaces. Two sets of interfaces will be introduced here: 1) interaction devices, 2) natural language (speech processing) and user gesture. The survey on this system using subjective observation (Simulator Sickness Questionnaire, SSQ) and objective measurements (Center of Gravity, COG) shows that using natural languages and gesture-based interfaces induced less cyber-sickness comparing to device-based interfaces. Therefore, gesture-based is more efficient than device-based interfaces.

References

[1]

David EE Carmein. Omni-directional treadmill. Patent, November 28 2000. US Patent 6,152,854.

[2]

Eric Chang, Yu Shi, Jian-Lai Zhou, and Chao Huang. Speech lab in a box: a mandarin speech toolbox to jumpstart speech related research. In INTERSPEECH, pages 2799--2802, 2001.

[3]

Alessandro De Luca, Raffaella Mattone, and Paolo Robuffo Giordano. Acceleration-level control of the cybercarpet. In IEEE Robotics and Automation (ICRA), 2330--2335, 2007.

[4]

Alessandro De Luca, Raffaella Mattone, Paolo Robuffo Giordano, and HH Bulthoff. Control design and experimental evaluation of the 2d cyberwalk platform. In IEEE/RSJ Intelligent Robots and Systems (IROS), 5051--5058, 2009.

Digital Library

[5]

Chris Hand. A survey of 3d interaction techniques. In Computer graphics forum, volume 16, pages 269--281. Wiley Online Library, 1997.

[6]

Nis Hjortskov, Dag Rissen, Anne Katrine Blangsted, Nils Fallentin, Ulf Lundberg, and Karen Søgaard. The effect of mental stress on heart rate variability and blood pressure during computer work. European journal of applied physiology, 92(1-2):84--89, 2004.

[7]

Paul W Hodges and Bang H Bui. A comparison of computer-based methods for the determination of onset of muscle contraction using electromyography. Electroencephalography and Clinical Neurophysiology/Electromyography and Motor Control, 101(6):511--519, 1996.

[8]

Robert S Kennedy, Norman E Lane, Kevin S Berbaum, and Michael G Lilienthal. Simulator sickness questionnaire: An enhanced method for quantifying simulator sickness. The international journal of aviation psychology, 3(3):203--220, 1993.

[9]

Chin-Teng Lin, Shang-Wen Chuang, Yu-Chieh Chen, Li-Wei Ko, Sheng-Fu Liang, and Tzyy-Ping Jung. Eeg effects of motion sickness induced in a dynamic virtual reality environment. In IEEE Engineering in Medicine and Biology Society (EMBS), 3872--3875, 2007.

[10]

Maud Marchal, Julien Pettré, and Anatole Lécuyer. Joyman: A human-scale joystick for navigating in virtual worlds. In IEEE 3D User Interfaces (3DUI), 19--26, 2011.

Digital Library

[11]

M. A. Mirzaei, "Study the effect of the navigation parameters on the level of visually induced motion sickness", Annual technical report, Arts et Métiers ParisTech, May 2013, France.

[12]

M Ali Mirzaei, Jean-Rémy Chardonnet, Frédéric Merienne, and Christian Pere. Improvement of the real-time gesture analysis by a new mother wavelet and the application for the navigation inside a scale-one 3d system. In IEEE Advanced Video and Signal Based Surveillance, 270--275, 2013.

[13]

Carlos H Morimoto and Marcio RM Mimica. Eye gaze tracking techniques for interactive applications. Computer Vision and Image Understanding, 98(1):4--24, 2005.

Digital Library

[14]

Manohar N Murthi and Bhaskar D Rao. Minimum variance distortionless response (mvdr) modeling of voiced speech. In IEEE Acoustics, Speech, and Signal Processing (ICASSP), volume 3, pages 1687--1690, 1997.

Digital Library

[15]

Anselmo Frizera Neto, Wanderley Cardoso Celeste, Vinicius Ruiz Martins, et al. Human-machine interface based on electro-biological signals for mobile vehicles. In IEEE Industrial Electronics, volume 4, pages 2954--2959, 2006.

[16]

Jan M Noyes and Daniel PJ Bruneau. A self-analysis of the nasa-tlx workload measure. Ergonomics, 50(4):514--519, 2007.

[17]

M Oinuma, K Hirayanagi, K Yajima, M Igarashi, and Y Arakawa. Changes in cardio-respiratory function, heart rate variability, and electrogastrogram preceding motion sickness-like symptoms induced by virtual reality stimulus. Japanese Journal of Aerospace and Environmental Medicine, 41(3):99--109, 2004.

[18]

Thierry Paillard, Frederic Noe, Terence Riviere, Vincent Marion, Richard Montoya, and Philippe Dupui. Postural performance and strategy in the unipedal stance of soccer players at different levels of competition. Journal of athletic training, 41(2):172, 2006.

[19]

Marco Pedrotti, Mohammad Ali Mirzaei, Adrien Tedesco, Jean-Rémy Chardonnet, Frédéric Mérienne, Simone Benedetto, and Thierry Baccino. Automatic stress classification with pupil diameter analysis. International Journal of Human-Computer Interaction, 30(3):220--236, 2014.

[20]

Gang Ren, Chuan Li, Eamonn O'Neill, and Philip Willis. 3d freehand gestural navigation for interactive public displays. IEEE Computer Graphics and Applications, 33(2):47--55, 2013.

Digital Library

[21]

Mattias Roupé, Petra Bosch-Sijtsema, and Mikael Johansson. Interactive navigation interface for virtual reality using the human body. Computers, Environment and Urban Systems, 43:42--50, 2014.

[22]

Takeshi Shimba. An estimation of center of gravity from force platform data. Journal of Biomechanics, 17(1):53--60, 1984.

[23]

Mel Slater. Measuring presence: A response to the witmer and singer presence questionnaire. Presence: Teleoperators and Virtual Environments, 8(5):560--565, 1999.

Digital Library

[24]

Evan A Suma, Belinda Lange, Albert Rizzo, David M Krum, and Mark Bolas. Faast: The flexible action and articulated skeleton toolkit. In IEEE Virtual Reality Conference (VR), 247--248, 2011.

Digital Library

[25]

Ivan Tashev. Kinect development kit: A toolkit for gesture- and speech-based human-machine interaction {best of the web}. Signal Processing Magazine, IEEE, 30(5):129--131, 2013.

[26]

Martin Usoh, Kevin Arthur, Mary C Whitton, Rui Bastos, Anthony Steed, Mel Slater, and Frederick P Brooks Jr. Walking> walking-in-place> flying, in virtual environments. In Siggraph, volume 99, pages 359--364, 1999.

Digital Library

[27]

Gerald Westheimer. Eye movement responses to a horizontally moving visual stimulus. Archives of Ophthalmology, 52(6):932, 1954.

[28]

J Zhang, Chon Wai Lip, Soh-Khim Ong, and Andrew YC Nee. Development of a shoe-mounted assistive user interface for navigation. International Journal of Sensor Networks, 9(1):3--12, 2011.

Digital Library

Cited By

Hombeck JVoigt HLawonn K(2024)Voice user interfaces for effortless navigation in medical virtual reality environmentsComputers & Graphics10.1016/j.cag.2024.104069(104069)Online publication date: Sep-2024
https://doi.org/10.1016/j.cag.2024.104069
Monteiro PCoelho HGonçalves GMelo MBessa M(2023)Exploring the user experience of hands-free VR interaction methods during a Fitts’ taskComputers and Graphics10.1016/j.cag.2023.10.005117:C(1-12)Online publication date: 1-Dec-2023
https://dl.acm.org/doi/10.1016/j.cag.2023.10.005
Xiao YLiu THan YYue KLiu Y(2022)Investigation of the turning speed for immersive environments using freehand‐based techniqueJournal of the Society for Information Display10.1002/jsid.117630:12(894-904)Online publication date: 30-Aug-2022
https://doi.org/10.1002/jsid.1176
Show More Cited By

Index Terms

Navigation and interaction in a real-scale digital mock-up using natural language and user gesture

Recommendations

Gesture-based interaction: a new dimension for mobile user interfaces
AVI '12: Proceedings of the International Working Conference on Advanced Visual Interfaces

Today, smart phones with touchscreens and sensors are the predominant, fastest growing class of consumer computing devices. However, because these devices are used in diverse situations, and have unique capabilities and form factors, they also raise new ...
A Real Time Vision-Based Hand Gesture Interaction
AMS '10: Proceedings of the 2010 Fourth Asia International Conference on Mathematical/Analytical Modelling and Computer Simulation

Moving beyond mouse and keyboard, the evolution of human-computer interaction (HCI) has been an interest research in recent years which witnessed the development from text-based like using a keyboard to graphic user interface (GUI) based on a mouse, ...
Finger identification and hand gesture recognition techniques for natural user interface
APCHI '13: Proceedings of the 11th Asia Pacific Conference on Computer Human Interaction

The natural user interface using hand gesture have been popular field in Human-Computer-Interaction(HCI). Many research papers have been proposed in this field. They proposed vision-based, glove-based and depth-based approach for hand gesture ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

VRIC '14: Proceedings of the 2014 Virtual Reality International Conference

April 2014

193 pages

ISBN:9781450326261

DOI:10.1145/2617841

Copyright © 2014 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Laval Virtual: Laval Virtual

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 09 April 2014

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Fonds Unique Interministériel

Conference

VRIC '14

Sponsor:

Laval Virtual

VRIC '14: Virtual Reality International Conference - Laval Virtual 2014

April 9 - 11, 2014

Laval, France

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

9
Total Citations
View Citations
171
Total Downloads

Downloads (Last 12 months)5
Downloads (Last 6 weeks)0

Reflects downloads up to 31 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Hombeck JVoigt HLawonn K(2024)Voice user interfaces for effortless navigation in medical virtual reality environmentsComputers & Graphics10.1016/j.cag.2024.104069(104069)Online publication date: Sep-2024
https://doi.org/10.1016/j.cag.2024.104069
Monteiro PCoelho HGonçalves GMelo MBessa M(2023)Exploring the user experience of hands-free VR interaction methods during a Fitts’ taskComputers and Graphics10.1016/j.cag.2023.10.005117:C(1-12)Online publication date: 1-Dec-2023
https://dl.acm.org/doi/10.1016/j.cag.2023.10.005
Xiao YLiu THan YYue KLiu Y(2022)Investigation of the turning speed for immersive environments using freehand‐based techniqueJournal of the Society for Information Display10.1002/jsid.117630:12(894-904)Online publication date: 30-Aug-2022
https://doi.org/10.1002/jsid.1176
Monteiro PGoncalves GCoelho HMelo MBessa M(2021)Hands-free interaction in immersive virtual reality: A systematic reviewIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2021.306768727:5(2702-2713)Online publication date: May-2021
https://doi.org/10.1109/TVCG.2021.3067687
Assila ABeladjine DMessaadia M(2020)Towards AR/VR Maturity Model Adapted to the Building Information ModelingProduct Lifecycle Management Enabling Smart X10.1007/978-3-030-62807-9_59(753-765)Online publication date: 10-Nov-2020
https://doi.org/10.1007/978-3-030-62807-9_59
Sampaio A(2018)Enhancing BIM Methodology with VR TechnologyState of the Art Virtual Reality and Augmented Reality Knowhow10.5772/intechopen.74070Online publication date: 23-May-2018
https://doi.org/10.5772/intechopen.74070
Sampaio AMartins O(2017)VR model of bridge constructionProceedings of the Virtual Reality International Conference - Laval Virtual 201710.1145/3110292.3110314(1-3)Online publication date: 22-Mar-2017
https://dl.acm.org/doi/10.1145/3110292.3110314
Sampaio A(2017)4D/BIM model linked to VR technologyProceedings of the Virtual Reality International Conference - Laval Virtual 201710.1145/3110292.3110298(1-4)Online publication date: 22-Mar-2017
https://dl.acm.org/doi/10.1145/3110292.3110298
Genty A(2015)Virtual Reality for the construction industry, The CALLISTO-SARI project, benefits for BOUYGUES CONSTRUCTION.Proceedings of the 2015 Virtual Reality International Conference10.1145/2806173.2806185(1-7)Online publication date: 8-Apr-2015
https://dl.acm.org/doi/10.1145/2806173.2806185

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents