A fast and robust gesture recognition system for exhibit gaming scenarios
Pages 343 - 350
Abstract
With no doubt, advanced human-computer interaction technologies represent one of the key selling points of all the most popular new gaming consoles. Players, in fact, can now interact realistically with their gaming environments, not suffering anymore from that lack of authenticity that was caused by the use of a simple joysticks or mice. Such incredible result has been achieved by means of new advanced hardware specialized in the recognition of players' gestures. In this work, we show that the same objective can be attained utilizing an off-the-shelf webcam and a robust gesture recognition software system. In particular, our novel gesture recognition system, which is based on artificial vision algorithms, leads to a fast and robust interpretation of hand gestures. This type of technology has proven to be particularly efficient for immersive gaming experiences. The efficacy was demonstrated through a game, which has been enjoyed by hundreds of visitors at the 2010 Shanghai World Expo.
References
[1]
M. Roccetti, G. Marfia, "Recognizing Intuitive Pre-defined Gestures for Cultural Specific Interactions: An Image-based Approach," in Proc. IEEE DENVECT'11, Las Vegas (USA), 2011.
[2]
M. Roccetti, G. Marfia, M. Zanichelli, The Art and Craft of Making the Tortellino: Playing with a Digital Gesture Recognizer for Preparing Pasta Culinary Recipes", ACM Comput. Entertain., vol. 8, n. 4, 2010.
[3]
Available online, accessed on the 2nd of February 2011: http://www.cs.unibo.it/~marfia/tortellinox-perience.mov
[4]
Available online, accessed on the 2nd of February 2011: http://www.newscientist.com/blogs/onepercent/2011/01/computer-game-that-teaches-you.html
[5]
T.B. Moeslund, A. Hilton, V. Krüger, "A Survey of Advances in Vision-based Human Motion Capture and Analysis," Comput. Vis. Image Underst., Elsevier, New York, pp. 90--126, November 2006.
[6]
S. Mitra, T. Acharaya, "Gesture Recognition: a Survey," Trans. On Sys., Man and Cyb., IEEE, New York, pp. 311--324, May 2007.
[7]
M. Roccetti, P. Salomoni, "A Web-based Synchronized Multimedia System for Distance Education," in Proc. of the 2001 ACM symposium on Applied computing (SAC '01), New York, NY, USA, pp. 94--98, 2001.
[8]
D. Campbell, "Physical gaming: Out of the Lap and into the Living Room," in Proc. of the 7th IEEE/ACM International Symposium on Mixed and Augmented Reality, Cambridge, 2008.
[9]
M. Pasch, N. Bianchi-Berthouze, B. Van Dijk, A. Nijholt, "Movement-based Sports Video Games: Investigating Motivation and Gaming Experience," Elsevier Entertainment Computing, vol. 1, n. 2, pp. 49--61, 2009.
[10]
S. Ferretti, M. Roccetti, "Fast Delivery of Game Events with an Optimistic Synchronization Mechanism in Massive Multiplayer Online Games," in Proc. of the 2005 ACM SIGCHI International Conference on Advances in computer entertainment technology, Valencia, pp. 405--412, 2005.
[11]
T. Selker, W. Burleson, "Context-aware Design and Interaction in Computer Systems," IBM Systems Journal, vol. 39, no. 3.4, pp. 880--891, 2000.
[12]
R. Y. Wang, J. Popovic, "Real-time Hand-tracking with a Color Glove," ACM Trans. Graph., vol. 28, n. 3, pp. 1--8, 2009.
[13]
A. Rhalibi, M. Merabti, P. Fergus, S. Yuanyuan, "Perceptual User Interface as Games Controller," in Proc. 5th IEEE Consumer Communications and Networking Conference, Las Vegas, pp. 1059--1064, 2008.
[14]
C. Harrison, A. K. Dey, "Lean and Zoom: Proximity-Aware User Interface and Content Magnification," in Proc. of the twenty-sixth annual ACM SIGCHI conference on Human factors in computing systems, Florence, pp. 507--510, 2008.
[15]
D. Bannach, O. Amft, K. S. Kunze, E. A. Heinz, G. Troster, P. Lukowicz, "Waving Real Hand Gestures Recorded by Wearable Motion Sensors to a Virtual Car and Driver in a Mixed-Reality Parking Game," in Proc. IEEE Symposium on Computational Intelligence and Games, Hololulu, Hawaii, USA, pp. 32--39, 2007.
[16]
L. Kratz, M. Smith, F. J. Lee, "Wiizards: 3D Gesture Recognition for Game Play Input," in Proc. of the ACM 2007 conference on Future Play (Future Play '07), Toronto, Ontario, Canada, pp. 209--212, 2007.
[17]
E. Tse, S. Greenberg, C. Shen, C. Forlines, "Multimodal Multiplayer Tabletop Gaming," ACM Comput. Entertain., vol. 5, n. 2, 2007.
[18]
M. Roccetti, G. Marfia, A. Semeraro, "An All-In-Software Hand Gesture Recognition System for Immersive Gaming Experiences," submitted for publication to an international journal, 2011.
Index Terms
- A fast and robust gesture recognition system for exhibit gaming scenarios
Recommendations
Robust hand gesture recognition with kinect sensor
MM '11: Proceedings of the 19th ACM international conference on MultimediaHand gesture based Human-Computer-Interaction (HCI) is one of the most natural and intuitive ways to communicate between people and machines, since it closely mimics how human interact with each other. In this demo, we present a hand gesture recognition ...
Developing a Gesture-Based Game for Deaf/Mute People Using Microsoft Kinect
CISIS '12: Proceedings of the 2012 Sixth International Conference on Complex, Intelligent, and Software Intensive Systems (CISIS)It is essential to get disabled people involved and connected to each other and to the rest of the society. Games can be used for this purpose as well as encouraging them to be active physically. However, many of the current interactive games interact ...
Multi-scenario gesture recognition using Kinect
CGAMES '12: Proceedings of the 2012 17th International Conference on Computer Games: AI, Animation, Mobile, Interactive Multimedia, Educational & Serious Games (CGAMES)Hand gesture recognition (HGR) is an important research topic because some situations require silent communication with sign languages. Computational HGR systems assist silent communication, and help people learn a sign language. In this article, a ...
Comments
Information & Contributors
Information
Published In
March 2011
527 pages
ISBN:9781936968008
- General Chairs:
- Jason Liu,
- Francesco Quaglia,
- Program Chairs:
- Stephan Eidenbenz,
- Stephen Gilmore
Sponsors
- ICST
In-Cooperation
Publisher
ICST (Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering)
Brussels, Belgium
Publication History
Published: 21 March 2011
Check for updates
Author Tags
Qualifiers
- Research-article
Conference
SIMUTools '11
Sponsor:
SIMUTools '11: 4th International ICST Conference on Simulation Tools and Techniques
March 21 - 25, 2011
Barcelona, Spain
Acceptance Rates
Overall Acceptance Rate 20 of 73 submissions, 27%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 144Total Downloads
- Downloads (Last 12 months)4
- Downloads (Last 6 weeks)1
Reflects downloads up to 15 Jan 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in