extended-abstract

Object-Based Access: Enhancing Accessibility with Data-Driven Media

Author:

Alexandre NevskyAuthors Info & Claims

IMX '23: Proceedings of the 2023 ACM International Conference on Interactive Media Experiences

Pages 402 - 406

https://doi.org/10.1145/3573381.3596500

Published: 29 August 2023 Publication History

Abstract

Audiovisual media is an integral part of many people’s everyday lives. People with accessibility needs, especially people with complex accessibility needs, however, may face challenges accessing this content. This doctoral work addresses this problem by investigating how complex accessibility needs can be met by content personalisation by leveraging data-driven methods. To this end, I will collaborate with people with aphasia, a complex language impairment, as an exemplar community of people with complex accessibility needs. To better understand the needs of people with aphasia, I will use collaborative design techniques to meet the needs of end users. This will involve them in the design, development and evaluation of systems that demonstrate the benefits of content personalisation as an accessibility intervention. This paper outlines the background and motivation to this PhD, the work that has already been completed, and current planned future work.

References

[1]

Gökçe Elif Baykal, Maarten Van Mechelen, and Eva Eriksson. 2020. Collaborative Technologies for Children with Special Needs. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. ACM. https://doi.org/10.1145/3313831.3376291

Digital Library

[2]

Alexy Bhowmick and Shyamanta M. Hazarika. 2017. An insight into assistive technology for the visually impaired and blind people: state-of-the-art and future trends. Journal on Multimodal User Interfaces 11, 2 (Jan. 2017), 149–172. https://doi.org/10.1007/s12193-016-0235-6

[3]

Pradipta Biswas, Pat Langdon, Carlos Duarte, and José Coelho. 2011. Multimodal adaptation through simulation for digital TV interface. In Proceedings of the 9th European Conference on Interactive TV and Video. ACM. https://doi.org/10.1145/2000119.2000167

Digital Library

[4]

Aditya Bodi, Pooyan Fazli, Shasta Ihorn, Yue-Ting Siu, Andrew T Scott, Lothar Narins, Yash Kant, Abhishek Das, and Ilmi Yoon. 2021. Automated Video Description for Blind and Low Vision Users. In Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems. ACM. https://doi.org/10.1145/3411763.3451810

Digital Library

[5]

Jade Cartwright and Kym A. E. Elliott. 2009. Promoting strategic television viewing in the context of progressive language impairment. Aphasiology (2009). https://doi.org/10.1080/02687030801942932

[6]

Chris Code, Ilias Papathanasiou, Silvia Rubio-Bruno, María de la Paz Cabana, Maria Marta Villanueva, Line Haaland-Johansen, Tatjana Prizl-Jakovac, Ana Leko, Nada Zemva, Ruth Patterson, Richard Berry, Elizabeth Rochon, Carol Leonard, and Amelie Robert. 2015. International patterns of the public awareness of aphasia. International Journal of Language and Communication Disorders 51, 3 (Nov. 2015), 276–284. https://doi.org/10.1111/1460-6984.12204

[7]

Enrique Costa-Montenegro, Fátima M. García-Doval, Jonathan Juncal-Martínez, and Belén Barragáns-Martínez. 2015. SubTitleMe, subtitles in cinemas in mobile devices. Universal Access in the Information Society 15, 3 (June 2015), 461–472. https://doi.org/10.1007/s10209-015-0420-5

Digital Library

[8]

Jasmine Cox, Rhianne Jones, Chris Northwood, Jonathan Tutcher, and Ben Robinson. 2017. Object-Based Production. In Adjunct Publication of the 2017 ACM International Conference on Interactive Experiences for TV and Online Video. ACM. https://doi.org/10.1145/3084289.3089912

Digital Library

[9]

Humphrey Curtis, Timothy Neate, and Carlota Vazquez Gonzalez. 2022. State of the Art in AAC: A Systematic Review and Taxonomy. In The 24th International ACM SIGACCESS Conference on Computers and Accessibility. ACM. https://doi.org/10.1145/3517428.3544810

Digital Library

[10]

Charles Ellis, Clara Dismuke, and Kathryn K. Edwards. 2010. Longitudinal trends in aphasia in the United States. NeuroRehabilitation 27, 4 (Dec. 2010), 327–333. https://doi.org/10.3233/nre-2010-0616

[11]

Joseph L. Fleiss and Jacob Cohen. 1973. The Equivalence of Weighted Kappa and the Intraclass Correlation Coefficient as Measures of Reliability. Educational and Psychological Measurement 33, 3 (Oct. 1973), 613–619. https://doi.org/10.1177/001316447303300309

[12]

Benjamin M. Gorman, Michael Crabb, and Michael Armstrong. 2021. Adaptive Subtitles: Preferences and Trade-Offs in Real-Time Media Adaption. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. ACM. https://doi.org/10.1145/3411764.3445509

Digital Library

[13]

Brian Grellmann, Timothy Neate, Abi Roper, Stephanie Wilson, and Jane Marshall. 2018. Investigating Mobile Accessibility Guidance for People with Aphasia. In Proceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility (Galway, Ireland) (ASSETS ’18). Association for Computing Machinery, New York, NY, USA, 410–413. https://doi.org/10.1145/3234695.3241011

Digital Library

[14]

Zdenek Hanzlicek, Jindrich Matousek, and Daniel Tihelka. 2008. Towards automatic audio track generation for Czech TV broadcasting: Initial experiments with subtitles-to-speech synthesis. In 2008 9th International Conference on Signal Processing. IEEE. https://doi.org/10.1109/icosp.2008.4697710

[15]

Elfed Howells and David Jackson. 2021. Object-Based Media Report. https://www.ofcom.org.uk/research-and-data/technology/general/object-based-media

[16]

Claire Kearney-Volpe, Shannon Holloway, and Amy Hurst. 2019. Entertainment for All. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems. ACM. https://doi.org/10.1145/3290607.3312882

Digital Library

[17]

Esme Kirk-Wade. 2022. UK disability statistics: Prevalence and life experiences. House of Commons Library (July 2022). https://commonslibrary.parliament.uk/research-briefings/cbp-9602/

[18]

Kelly Mack, Emma McDonnell, Dhruv Jain, Lucy Lu Wang, Jon E. Froehlich, and Leah Findlater. 2021. What Do We Mean by “Accessibility Research”?. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. ACM. https://doi.org/10.1145/3411764.3445412

Digital Library

[19]

Mark McGill, John H. Williamson, and Stephen Brewster. 2016. Examining The Role of Smart TVs and VR HMDs in Synchronous At-a-Distance Media Consumption. ACM Transactions on Computer-Human Interaction 23, 5 (Nov. 2016), 1–57. https://doi.org/10.1145/2983530

Digital Library

[20]

Mario Montagud, Jaume Segura-Garcia, J. Antonio De Rus, and Rafael Fayos Jordán. 2020. Towards an Immersive and Accessible Virtual Reconstruction of Theaters from the Early Modern. In ACM International Conference on Interactive Media Experiences. ACM. https://doi.org/10.1145/3391614.3399390

Digital Library

[21]

Martez Mott, John Tang, Shaun Kane, Edward Cutrell, and Meredith Ringel Morris. 2020. “I just went into it assuming that I wouldn't be able to have the full experience”. In The 22nd International ACM SIGACCESS Conference on Computers and Accessibility. ACM. https://doi.org/10.1145/3373625.3416998

Digital Library

[22]

Timothy Neate, Aikaterini Bourazeri, Abi Roper, Simone Stumpf, and Stephanie Wilson. 2019. Co-Created Personas. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. ACM. https://doi.org/10.1145/3290605.3300880

Digital Library

[23]

Cristian Pamparău and Radu-Daniel Vatavu. 2022. The User Experience of Journeys in the Realm of Augmented Reality Television. In ACM International Conference on Interactive Media Experiences. ACM. https://doi.org/10.1145/3505284.3529969

Digital Library

[24]

Melissa L. Rethlefsen, Shona Kirtley, Siw Waffenschmidt, Ana Patricia Ayala, David Moher, Matthew J. Page, and Jonathan B. Koffel. 2021. PRISMA-S: an extension to the PRISMA Statement for Reporting Literature Searches in Systematic Reviews. Systematic Reviews 10, 1 (Jan. 2021). https://doi.org/10.1186/s13643-020-01542-z

[25]

Abi Roper, Ian Davey, Stephanie Wilson, Timothy Neate, Jane Marshall, and Brian Grellmann. 2018. Usability Testing - An Aphasia Perspective. In Proceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility. ACM. https://doi.org/10.1145/3234695.3241481

Digital Library

[26]

Andy P. Siddaway, Alex M. Wood, and Larry V. Hedges. 2019. How to Do a Systematic Review: A Best Practice Guide for Conducting and Reporting Narrative Reviews, Meta-Analyses, and Meta-Syntheses. Annual Review of Psychology 70, 1 (Jan. 2019), 747–770. https://doi.org/10.1146/annurev-psych-010418-102803

[27]

Rodrigo L. S. Silva and Frâncila Weidt Neiva. 2016. Systematic Literature Review in Computer Science - A Practical Guide. (2016). https://doi.org/10.13140/RG.2.2.35453.87524

[28]

Laurianne Sitbon, Ross Brown, and Lauren Fell. 2019. Turning Heads: Designing Engaging Immersive Video Experiences to Support People with Intellectual Disability when Learning Everyday Living Skills. In The 21st International ACM SIGACCESS Conference on Computers and Accessibility. ACM. https://doi.org/10.1145/3308561.3353787

Digital Library

[29]

Marian Ursu, Davy Smith, Jonathan Hook, Shauna Concannon, and John Gray. 2020. Authoring Interactive Fictional Stories in Object-Based Media (OBM). In ACM International Conference on Interactive Media Experiences. ACM. https://doi.org/10.1145/3391614.3393654

Digital Library

[30]

Radu-Daniel Vatavu. 2021. Accessibility of Interactive Television and Media Experiences: Users with Disabilities Have Been Little Voiced at IMX and TVX. In ACM International Conference on Interactive Media Experiences. ACM. https://doi.org/10.1145/3452918.3465485

Digital Library

[31]

Johana María Rosas Villena, Bruno Costa Ramos, Renata Pontin M. Fortes, and Rudinei Goularte. 2014. Web Videos – Concerns About Accessibility based on User Centered Design. Procedia Computer Science 27 (2014), 481–490. https://doi.org/10.1016/j.procs.2014.02.052

[32]

Agnieszka Walczak. 2017. Audio description on smartphones: making cinema accessible for visually impaired audiences. Universal Access in the Information Society 17, 4 (Aug. 2017), 833–840. https://doi.org/10.1007/s10209-017-0568-2

[33]

Lauren Ward and Ben Shirley. 2019. Personalization in Object-based Audio for Accessibility: A Review of Advancements for Hearing Impaired Listeners. Journal of the Audio Engineering Society 67, 7/8 (Aug. 2019), 584–597. https://doi.org/10.17743/jaes.2019.0021

[34]

Lauren Ward, Ben Shirley, and Jon Francombe. 2018. Accessible Object-based Audio Using Hierarchical Narrative Importance Metadata. Journal of the Audio Engineering Society (2018).

[35]

Stephanie Wilson, Abi Roper, Jane Marshall, Julia Galliers, Niamh Devane, Tracey Booth, and Celia Woolf. 2015. Codesign for people with aphasia through tangible design languages. CoDesign 11, 1 (Jan. 2015), 21–34. https://doi.org/10.1080/15710882.2014.997744

[36]

Claes Wohlin. 2014. Guidelines for Snowballing in Systematic Literature Studies and a Replication in Software Engineering. In Proceedings of the 18th International Conference on Evaluation and Assessment in Software Engineering (London, England, United Kingdom) (EASE ’14). Association for Computing Machinery, New York, NY, USA, Article 38, 10 pages. https://doi.org/10.1145/2601248.2601268

Digital Library

Cited By

Hinojosa-Becerra MMarín-Gutiérrez IMaldonado-Espinosa M(2024)Capítulo 6. Inteligencia Artificial y la producción audiovisualEspejo de Monografías de Comunicación Social10.52495/c6.emcs.23.ti12(117-139)Online publication date: 13-May-2024
https://doi.org/10.52495/c6.emcs.23.ti12

Index Terms

Object-Based Access: Enhancing Accessibility with Data-Driven Media
1. Human-centered computing
  1. Accessibility
    1. Accessibility systems and tools
    2. Empirical studies in accessibility

Recommendations

"I Wish You Could Make the Camera Stand Still": Envisioning Media Accessibility Interventions with People with Aphasia
ASSETS '24: Proceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility

Audiovisual media is integral to modern living, yet is not always accessible to all. Modern accessibility interventions, such as subtitles, support many, however, communities with complex communication needs are largely unconsidered. In this work, we ...
Investigating Mobile Accessibility Guidance for People with Aphasia
ASSETS '18: Proceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility

The World Wide Web Consortium's (W3C) Web Content Accessibility Guidelines (WCAG 2.0) have become widely accepted as the standard for web accessibility evaluation. This poster investigates how the mobile version of these guidelines caters for people ...
Developing accessibility multimedia services: the case of EasyTV
PETRA '20: Proceedings of the 13th ACM International Conference on PErvasive Technologies Related to Assistive Environments

People with various degrees of disabilities (e.g., visually or hearing impaired) often find it difficult to access mainstream products and services and thus they are excluded from enjoying audio-visual services on an equal basis as people without ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

IMX '23: Proceedings of the 2023 ACM International Conference on Interactive Media Experiences

June 2023

465 pages

ISBN:9798400700286

DOI:10.1145/3573381

Editors:
Patrick Le Callet
Nantes Université, France
,
Matthieu Perreira Da Silva
Nantes Université, France
,
Toinon Vigier
Nantes Université, France
,
Koray Tahiroğlu
Aalto University, Finland
,
Niall Murray
Technological University of the Shannon, Ireland
,
Giuseppe Valenzise
Université Paris-Saclay, France
,
Mea Wang
University of Calgary, Canada

Copyright © 2023 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 29 August 2023

Check for updates

Author Tags

Qualifiers

Extended-abstract
Research
Refereed limited

Conference

IMX '23

Sponsor:

IMX '23: ACM International Conference on Interactive Media Experiences

June 12 - 15, 2023

Nantes, France

Acceptance Rates

Overall Acceptance Rate 69 of 245 submissions, 28%

Upcoming Conference

IMX '25

Sponsor:
sigchi

ACM International Conference on Interactive Media Experiences

June 3 - 6, 2025

Niter?i , Brazil

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
104
Total Downloads

Downloads (Last 12 months)73
Downloads (Last 6 weeks)3

Reflects downloads up to 13 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Hinojosa-Becerra MMarín-Gutiérrez IMaldonado-Espinosa M(2024)Capítulo 6. Inteligencia Artificial y la producción audiovisualEspejo de Monografías de Comunicación Social10.52495/c6.emcs.23.ti12(117-139)Online publication date: 13-May-2024
https://doi.org/10.52495/c6.emcs.23.ti12

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents