skip to main content
10.1145/1878803.1878853acmconferencesArticle/Chapter ViewAbstractPublication PagesassetsConference Proceedingsconference-collections
demonstration

Color-audio encoding interface for visual substitution: see color matlab-based demo

Published: 25 October 2010 Publication History

Abstract

Providing the blind with substitute visual perception is a relentless challenge confronting researchers of diverse areas. The See ColOr (Seeing Color with an Orchestra) system translates aimed-at regions of a color scene into 2D-spatialized sound signals represented by musical instruments. Associating sounds with colors is achieved thanks to an efficient quantization of the regions' HSL representation (Hue, Saturation, Luminosity). See ColOr can be used both for exploring static images and as a mobility aid. In this report, we introduce its general framework for color-audio encoding of images to provide visually impaired individuals with a low-cost application for color perception substitution, using the sense of hearing instead of sight. The experimental tests using a demo implementation have shown the feasibility and usefulness of this approach.

References

[1]
Bologna, G. Deville, B. Pun, T. 2009. On the use of the auditory pathway to represent image scenes in real-time. Neurocomputing Vol. 72, Issues 4-6: 839--849.
[2]
Bologna, G. Deville, B. Pun, T. 2007. Identifying major components of pictures by audio encoding of colors. Lecture Notes in Computer Science Vol. 4528/ IWINAC (2): 81--89.
[3]
Meers, S. and Ward, K. A vision system for providing the blind with 3D color perception of the environment. Proc. Asia-Pacific Workshop on Visual Information Processing - Hong Kong, December 11-13, 2005: pag. 102--108.
[4]
Ordonez, C. Navarun, G. Barreto, A. Sound spatialization as a navigational aid in virtual environments. Proc. 6th CSI Conference - Orlando Fl, July 14-18, 2002: pag. 297--302.

Cited By

View all

Index Terms

  1. Color-audio encoding interface for visual substitution: see color matlab-based demo

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    ASSETS '10: Proceedings of the 12th international ACM SIGACCESS conference on Computers and accessibility
    October 2010
    346 pages
    ISBN:9781605588810
    DOI:10.1145/1878803

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 25 October 2010

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. color
    2. hsl
    3. instruments
    4. matlab
    5. sonification
    6. visual substitution

    Qualifiers

    • Demonstration

    Conference

    ASSETS '10
    Sponsor:

    Acceptance Rates

    Overall Acceptance Rate 436 of 1,556 submissions, 28%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)4
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 25 Dec 2024

    Other Metrics

    Citations

    Cited By

    View all

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media