research-article

Accessible games for blind children, empowered by binaural sound

Authors:

Konstantinos Drossos,

Nikolaos Zormpas,

George Giannakopoulos,

Andreas FlorosAuthors Info & Claims

PETRA '15: Proceedings of the 8th ACM International Conference on PErvasive Technologies Related to Assistive Environments

Article No.: 5, Pages 1 - 8

https://doi.org/10.1145/2769493.2769546

Published: 01 July 2015 Publication History

Abstract

Accessible games have been researched and developed for many years, however, blind people still have very limited access and knowledge of them. This can pose a serious limitation, especially for blind children, since in recent years electronic games have become one of the most common and wide spread means of entertainment and socialization. For our implementation we use binaural technology which allows the player to hear and navigate the game space by adding localization information to the game sounds. With our implementation and user studies we provide insight on what constitutes an accessible game for blind people as well as a functional game engine for such games. The game engine developed allows the quick development of games for the visually impaired. Our work provides a good starting point for future developments on the field and, as the user studies show, was very well perceived by the visually impaired children that tried it.

References

[1]

M. M. Blattner, D. A. Sumikawa, and R. M. Greenberg. Earcons and icons: Their structure and common design principles. Hum.-Comput. Interact., 4(1):11--44, Mar. 1989.

Digital Library

[2]

J. Desloge, W. Rabinowitz, and P. Zurek. Microphone-array hearing aids with binaural output .i. fixed-processing systems. Speech and Audio Processing, IEEE Transactions on, 5(6):529--542, 1997.

[3]

K. Drossos, A. Floros, A. Giannakoulopoulos, and N. Kanellopoulos. Investigating the impact of sound angular position on the listener affective state. Affective Computing, IEEE Transactions on, PP(99):1--1, 2015.

[4]

K. Drossos, A. Floros, and K. Koukoudis. Gestural user interface for audio multitrack real-time stereo mixing. In Proceedings of the 8th Audio Mostly Conference, AM '13, pages 2:1--2:6, New York, NY, USA, 2013. ACM.

Digital Library

[5]

K. Drossos, S. Mimilakis, A. Floros, and N. Kanellopoulos. Stereo goes mobile: Spatial enhancement for short-distance loudspeaker setups. In Intelligent Information Hiding and Multimedia Signal Processing (IIH-MSP), 2012 Eighth International Conference on, pages 432--435, July 2012.

Digital Library

[6]

Epicycle. Blindside - the audio adventure game. Electronically - Video Game, Feb 2015.

[7]

Y. Eriksson and D. Gärdenfors. Computer games for children with visual impairments. International Journal on Disability and Human Development, 4(3):161--168, May 2011.

[8]

A. Floros, N.-A. Tatlas, and S. Potirakis. Sonic perceptual crossings: A tic-tac-toe audio game. In Proceedings of the 6th Audio Mostly Conference: A Conference on Interaction with Sound, AM '11, pages 88--94, New York, NY, USA, 2011. ACM.

Digital Library

[9]

J. Friberg and D. Gärdenfors. Audio games: New perspectives on game audio. In Proceedings of the 2004 ACM SIGCHI International Conference on Advances in Computer Entertainment Technology, ACE '04, pages 148--154, New York, NY, USA, 2004. ACM.

Digital Library

[10]

B. Gardner and K. Martin. Hrtf measurements of a kemar dummy-head microphone. Technical Report 280, MIT Media Lab Perceptual Computing, 1994.

[11]

W. W. Gaver. Auditory icons: Using sound in computer interfaces. Hum.-Comput. Interact., 2(2):167--177, June 1986.

Digital Library

[12]

M. Jeub and P. Vary. Binaural dereverberation based on a dual-channel wiener filter with optimized noise field coherence. In Acoustics Speech and Signal Processing (ICASSP), 2010 IEEE International Conference on, pages 4710--4713, 2010.

[13]

G. Kramer, B. Walker, T. Bonebright, P. Cook, J. Flowers, N. Miner, and J. Neuhoff. Sonification report: Status of the field and research agenda. White paper Master, National Science Foundation, 1998.

[14]

N. Moustakas, A. Floros, and N. Grigoriou. Interactive audio realities: An augmented / mixed reality audio game prototype. In Audio Engineering Society Convention 130, May 2011.

[15]

L. V. Nickerson and T. Hermann. Interactive sonifcation of grid-based games. In Proceedings of the Audio Mostly Conference - A Conference on Interaction with Sound, pages 27--34, 2008.

[16]

J. Sánchez, A. Tadres, A. Pascual-Leone, and L. Merabet. Blind children navigation through gaming and associated brain plasticity. In Virtual Rehabilitation International Conference, 2009, pages 29--36, June 2009.

[17]

Somethinelse. Papa sangre. Electronically - Video Game, Feb 2015.

[18]

F. Winberg and S. O. Hellström. Investigating auditory direct manipulation: Sonifying the towers of hanoi. In CHI '00 Extended Abstracts on Human Factors in Computing Systems, CHI EA '00, pages 281--282, New York, NY, USA, 2000. ACM.

Digital Library

[19]

B. Yuan and E. Folmer. Blind hero: Enabling guitar hero for the visually impaired. In Proceedings of the 10th International ACM SIGACCESS Conference on Computers and Accessibility, Assets '08, pages 169--176, New York, NY, USA, 2008. ACM.

Digital Library

Cited By

Schubhan MAltmeyer MRogers KDegraen DLessel PKrüger A(2024)Auditory, Visual, or Both? Comparing Visual and Auditory Representations of Game Elements in a Gamified Image-Tagging TaskProceedings of the ACM on Human-Computer Interaction10.1145/36770598:CHI PLAY(1-28)Online publication date: 15-Oct-2024
https://dl.acm.org/doi/10.1145/3677059
Abdoulqadir CLoizides FHoyos S(2024)Enhancing Mobile Game Accessibility: Guidelines for Users with Visual and Dexterity Dual ImpairmentsHuman-Centered Software Engineering10.1007/978-3-031-64576-1_16(255-263)Online publication date: 1-Jul-2024
https://doi.org/10.1007/978-3-031-64576-1_16
Davern SCooney OGessinger ICowan B(2023)Investigating the Usability of a Speech Agent-based Role-playing GameProceedings of the 5th International Conference on Conversational User Interfaces10.1145/3571884.3604306(1-5)Online publication date: 19-Jul-2023
https://dl.acm.org/doi/10.1145/3571884.3604306
Show More Cited By

Index Terms

Accessible games for blind children, empowered by binaural sound
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction techniques
      1. Auditory feedback

Recommendations

Designing universally accessible games
SPECIAL ISSUE: Media Arts and Games

Today, computer games are one of the major sources of entertainment. Computer games are usually far more demanding than typical interactive applications in terms of motor and sensory skills needed for interaction control, due to special-purpose input ...
ShadowRine: Accessible game for blind users, and accessible action RPG for visually impaired gamers
2016 IEEE International Conference on Systems, Man, and Cybernetics (SMC)
Though some games for visually impaired persons have been developed, most of games that use only auditory information present challenges for sighted persons. Moreover, unfortunately, it is still difficult for visually impaired persons to play the same ...
Accessible smartphones for blind users: A case study for a wayfinding system

While progress on assistive technologies have been made, some blind users still face several problems opening and using basic functionalities when interacting with touch interfaces. Sometimes, people with visual impairments may also have problems ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

PETRA '15: Proceedings of the 8th ACM International Conference on PErvasive Technologies Related to Assistive Environments

July 2015

526 pages

ISBN:9781450334525

DOI:10.1145/2769493

Conference Chair:
Fillia Makedon
University of Texas Arlington
,
Program Chairs:
Gian-Luca Mariottini,
Oliver Korn,
Illias Maglogiannis,
Vangelis Metsis

Copyright © 2015 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

NSF: National Science Foundation
University of Texas at Austin: University of Texas at Austin
Univ. of Piraeus: University of Piraeus
NCRS: Demokritos National Center for Scientific Research
Ionian: Ionian University, GREECE

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 July 2015

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

PETRA '15

Sponsor:

NSF
University of Texas at Austin
Univ. of Piraeus
NCRS
Ionian

PETRA '15: 8th PErvasive Technologies Related to Assistive Environments

July 1 - 3, 2015

Corfu, Greece

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

26
Total Citations
View Citations
511
Total Downloads

Downloads (Last 12 months)51
Downloads (Last 6 weeks)4

Reflects downloads up to 17 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Schubhan MAltmeyer MRogers KDegraen DLessel PKrüger A(2024)Auditory, Visual, or Both? Comparing Visual and Auditory Representations of Game Elements in a Gamified Image-Tagging TaskProceedings of the ACM on Human-Computer Interaction10.1145/36770598:CHI PLAY(1-28)Online publication date: 15-Oct-2024
https://dl.acm.org/doi/10.1145/3677059
Abdoulqadir CLoizides FHoyos S(2024)Enhancing Mobile Game Accessibility: Guidelines for Users with Visual and Dexterity Dual ImpairmentsHuman-Centered Software Engineering10.1007/978-3-031-64576-1_16(255-263)Online publication date: 1-Jul-2024
https://doi.org/10.1007/978-3-031-64576-1_16
Davern SCooney OGessinger ICowan B(2023)Investigating the Usability of a Speech Agent-based Role-playing GameProceedings of the 5th International Conference on Conversational User Interfaces10.1145/3571884.3604306(1-5)Online publication date: 19-Jul-2023
https://dl.acm.org/doi/10.1145/3571884.3604306
Turchet LTomasetti M(2023)Immersive networked music performance systems: identifying latency factors2023 Immersive and 3D Audio: from Architecture to Automotive (I3DA)10.1109/I3DA57090.2023.10289169(1-6)Online publication date: 5-Sep-2023
https://doi.org/10.1109/I3DA57090.2023.10289169
Spöhrer M(2022)Playing With Auditory Environments in Audio GamesResearch Anthology on Game Design, Development, Usage, and Social Impact10.4018/978-1-6684-7589-8.ch032(644-661)Online publication date: 7-Oct-2022
https://doi.org/10.4018/978-1-6684-7589-8.ch032
Bolesnikov AKang JGirouard A(2022)Understanding Tabletop Games Accessibility: Exploring Board and Card Gaming Experiences of People who are Blind and Low VisionProceedings of the Sixteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3490149.3501327(1-17)Online publication date: 13-Feb-2022
https://dl.acm.org/doi/10.1145/3490149.3501327
Theil ABuchweitz LSchulz AKorn O(2022)Understanding the perceptions and experiences of the deafblind community about digital gamesDisability and Rehabilitation: Assistive Technology10.1080/17483107.2021.200802618:8(1347-1356)Online publication date: 19-Jan-2022
https://doi.org/10.1080/17483107.2021.2008026
Darin TAndrade RSánchez J(2022)Usability evaluation of multimodal interactive virtual environments for learners who are blindInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2021.102732158:COnline publication date: 1-Feb-2022
https://dl.acm.org/doi/10.1016/j.ijhcs.2021.102732
Sekhavat YAzadehfar MZarei HRoohi S(2022)Sonification and interaction design in computer games for visually impaired individualsMultimedia Tools and Applications10.1007/s11042-022-11984-3Online publication date: 28-Jan-2022
https://doi.org/10.1007/s11042-022-11984-3
Lee YLee CCho J(2021)3D Sound Coding Color for the Visually ImpairedElectronics10.3390/electronics1009103710:9(1037)Online publication date: 27-Apr-2021
https://doi.org/10.3390/electronics10091037
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents