research-article

A proposal to adapt the semiotic inspection method to analyze screen reader mediated interaction

Authors:

Lucas Pedroso Carvalho,

Raquel Oliveira Prates,

André Pimenta FreireAuthors Info & Claims

IHC '19: Proceedings of the 18th Brazilian Symposium on Human Factors in Computing Systems

Article No.: 4, Pages 1 - 11

https://doi.org/10.1145/3357155.3358455

Published: 22 October 2019 Publication History

Abstract

An interactive system with high accessibility and communicability provides many benefits to users' experience. These benefits are mainly related to visually impaired users so that they can achieve their goals in a given context of use. This study presents an analysis of the communication process of the Semiotic Engineering theory applied in the context of visually impaired people who use screen readers. The screen reader mediates the user interaction with the designer's metamessage, acting as a translator. However, the translation can often introduce problems that are not experienced by users who do not use screen readers to interact with the systems. Thus, this paper presents a proposal to adapt the Semiotic Inspection Method (SIM) to analyze the screen reader mediated interaction (SIM-SR). The method includes new steps in the segmented SIM analysis to examine the screen reader translation and the its contrast with the designer's intended metamessage. Hence, SIM-SR allows the evaluator to identify potential accessibility and communicability issues that may impact the personal experience of users interacting through screen reader mediation.

References

[1]

Fernando Alonso, José Luis Fuertes, Ángel Lucas González, and Loïc Martínez. 2010. On the Testability of WCAG 2.0 for Beginners. In Proceedings of the 2010 International Cross Disciplinary Conference on Web Accessibility (W4A) (W4A '10). ACM, New York, NY, USA, Article 9, 9 pages.

Digital Library

[2]

Glívia A. R. Barbosa, Raquel O. Prates, and Luiz P. D. Corrêa. 2011. AnÃLise Da Sociabilidade De Comunidades Online Para Os UsuÁRios Surdos: Um Estudo De Caso Do Orkut. In Proceedings of the 10th Brazilian Symposium on Human Factors in Computing Systems and the 5th Latin American Conference on Human-Computer Interaction (IHC+CLIHC '11). Brazilian Computer Society, Porto Alegre, Brazil, Brazil, 237--246. http://dl.acm.org/citation.cfm?id=2254436.2254478

[3]

Simone Barbosa and Bruno Silva. 2010. Interação humano-computador. Elsevier Brasil, Brazil.

[4]

Giorgio Brajnik. 2006. Web Accessibility Testing: When the Method is the Culprit. In Proceedings of the 10th International Conference on Computers Helping People with Special Needs (ICCHP'06). Springer-Verlag, Berlin, Heidelberg, 156--163.

Digital Library

[5]

Giorgio Brajnik. 2008. A Comparative Test of Web Accessibility Evaluation Methods. In Proceedings of the 10th International ACM SIGACCESS Conference on Computers and Accessibility (Assets '08). ACM, New York, NY, USA, 113--120.

Digital Library

[6]

Lucas Pedroso Carvalho, Caíque Bruno Fortunato, Raquel Oliveira Prates, and André Pimenta Freire. 2018. Análise de Acessibilidade no Ambiente Virtual de Aprendizagem Moodle: Um Estudo de Caso do Uso do MIS com Leitores de Tela. In Conferência Internacional sobre Informática na Educação, Vol. 14. University of Chile, Chile, 174--185.

[7]

Lucas Pedroso Carvalho, Bruno Piovesan Melchiori Peruzza, Flávia Santos, Lucas Pereira Ferreira, and André Pimenta Freire. 2016. Accessible Smart Cities?: Inspecting the Accessibility of Brazilian Municipalities' Mobile Applications. In Proceedings of the 15th Brazilian Symposium on Human Factors in Computer Systems (IHC '16). ACM, New York, NY, USA, Article 17, 10 pages.

Digital Library

[8]

Luiz Paulo Damilton Corrêa, Flávio R. S. Coutinho, Raquel Oliveira Prates, and Luiz Chaimowicz. 2012. Uso Do MIS Para Avaliar Signos Sonoros: Quando Um Problema de Comunicabilidade se Torna Um Problema de Acessibilidade. In Proceedings of the 11th Brazilian Symposium on Human Factors in Computing Systems (IHC '12). Brazilian Computer Society, Porto Alegre, Brazil, Brazil, 47--56. http://dl.acm.org/citation.cfm?id=2393536.2393543

[9]

Flávio Coutinho, Raquel O Prates, and Luiz Chaimowicz. 2012. Evaluating and Investigating Game Accessibility for Deaf Players with the Semiotic Inspection Method.

[10]

Presidência da República. 2004. Decreto n°5.296/2004. Brasil. Casa Civil - Subchefia para Assuntos Jurídicos, Brasília.

[11]

Presidência da República. 2015. Lei Brasileira de Inclusão da Pessoa com Deficiência. Brasil. Casa Civil - Subchefia para Assuntos Jurídicos, Brasília.

[12]

Clarisse Sieckenius de Souza. 2005. The Semiotic Engineering of Human-Computer Interaction (Acting with Technology). The MIT Press, London, England.

[13]

Clarisse Sieckenius de Souza, Carla Faria Leitão, Raquel Oliveira Prates, and Elton José da Silva. 2006. The Semiotic Inspection Method. In Proceedings of VII Brazilian Symposium on Human Factors in Computing Systems (IHC '06). ACM, New York, NY, USA, 148--157.

Digital Library

[14]

Clarisse Sieckenius De Souza and Carla Faria Leitão. 2009. Semiotic engineering methods for scientific research in HCI. Synthesis Lectures on Human-Centered Informatics 2, 1 (2009), 1--122.

[15]

Andres Gonzalez and Loretta Guarino Reid. 2005. Platform-independent Accessibility API: Accessible Document Object Model. In Proceedings of the 2005 International Cross-Disciplinary Workshop on Web Accessibility (W4A) (W4A '05). ACM, New York, NY, USA, 63--71.

Digital Library

[16]

ISO. 2008. ISO 9241-171: Ergonomics of Human-System Interaction - Part 171: Guidance on Software Accessibility.

[17]

Andrew Kirkpatrick, Joshue O Connor, Alastair Campbell, and Michael Cooper. 2018. Web Content Accessibility Guidelines (WCAG) 2.1. Disponível em https://www.w3.org/TR/WCAG21/. Último acesso em 7 junho de 2019. World Wide Web Consortium (W3C).

[18]

Aron Daniel Lopes, Vinicius Carvalho Pereira, and Cristiano Maciel. 2017. An analysis of deictic signs in computer interfaces: contributions to the Semiotic Inspection Method. Journal of Visual Languages & Computing 40 (2017), 51--64. Semiotics, Human-Computer Interaction and End-User Development.

[19]

Charles Sanders Peirce. 1992, 1998. The essential Peirce: selected philosophical writings. Vol. 1, 2. Indiana University Press, Bloomington, IN, USA.

[20]

Christopher Power, André Freire, Helen Petrie, and David Swallow. 2012. Guidelines Are Only Half of the Story: Accessibility Problems Encountered by Blind Users on the Web. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12). ACM, New York, NY, USA, 433--442.

Digital Library

[21]

Raquel O. Prates, Clarisse S. de Souza, and Simone D. J. Barbosa. 2000. Methods and Tools: A Method for Evaluating the Communicability of User Interfaces. interactions 7, 1 (Jan. 2000), 31--38.

Digital Library

[22]

Soraia Reis and Raquel O. Prates. 2011. Applicability of the Semiotic Inspection Method: A Systematic Literature Review. In Proceedings of the 10th Brazilian Symposium on Human Factors in Computing Systems and the 5th Latin American Conference on Human-Computer Interaction (IHC+CLIHC '11). Brazilian Computer Society, Porto Alegre, Brazil, Brazil, 177--186. http://dl.acm.org/citation.cfm?id=2254436.2254468

[23]

Eduardo Hideki Tanaka. 2009. Método baseado em heurísticas para avaliação de acessibilidade em sistemas de informação. Ph.D. Dissertation. Universidade Estadual de Campinas, Campinas.

[24]

Francisco A. M. Valério, Tatiane G. Guimarães, Raquel O. Prates, and Heloisa Candello. 2017. Here's What I Can Do: Chatbots' Strategies to Convey Their Features to Users. In Proceedings of the XVI Brazilian Symposium on Human Factors in Computing Systems (IHC 2017). ACM, New York, NY, USA, Article 28, 10 pages.

Digital Library

[25]

WebAIM. 2017. Screen Reader User Survey #7 Results. Disponível em https://webaim.org/projects/screenreadersurvey7/.

[26]

Yeliz Yesilada, Giorgio Brajnik, and Simon Harper. 2009. How Much Does Expertise Matter?: A Barrier Walkthrough Study with Experts and Non-experts. In Proceedings of the 11th International ACM SIGACCESS Conference on Computers and Accessibility (Assets '09). ACM, New York, NY, USA, 203--210.

Digital Library

Cited By

Teran LMelo GSilva ISalles RRocha TMota M(2024)A Set of Professional Tools to Support the Design and Evaluation of Real-Time Payment Systems and Emergent UsersJournal on Interactive Systems10.5753/jis.2024.420715:1(790-809)Online publication date: 1-Aug-2024
https://doi.org/10.5753/jis.2024.4207
Da Costa Nunes ESilva PSouza RMonteiro I(2024)Investigating Accessibility at the Brazilian Symposium on Human Factors in Computing Systems (IHC)Proceedings of the XXIII Brazilian Symposium on Human Factors in Computing Systems10.1145/3702038.3702098(1-18)Online publication date: 7-Oct-2024
https://dl.acm.org/doi/10.1145/3702038.3702098
Da Costa Nunes ERibeiro GMonteiro IGonçalves E(2023)Digital Accessibility at the Brazilian Symposium on Human Factors in Computing Systems (IHC): An Updated Systematic Literature ReviewProceedings of the XXII Brazilian Symposium on Human Factors in Computing Systems10.1145/3638067.3638075(1-15)Online publication date: 16-Oct-2023
https://dl.acm.org/doi/10.1145/3638067.3638075
Show More Cited By

Index Terms

A proposal to adapt the semiotic inspection method to analyze screen reader mediated interaction
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. HCI theory, concepts and models

Recommendations

Beyond Barriers: A Practical Analysis of the SIM-SR Method to Inspect the Communicability of Interactive Systems for Visually Impaired Users
IHC '21: Proceedings of the XX Brazilian Symposium on Human Factors in Computing Systems

The availability and use of interactive systems have increased considerably. However, evaluating the accessibility and communicability of such systems for a range of users is essential to improve their quality. Human-Computer Interaction (HCI) ...
Non-visual skimming on touch-screen devices
IUI '13: Proceedings of the 2013 international conference on Intelligent user interfaces

While reading on touch-screens, sighted users can quickly pan through content, skim it, and pick out bits and pieces of information before deciding to read it more carefully. In contrast, blind users have to rely on the screen reader to narrate the ...
Developing an accessible interaction model for touch screen mobile devices: preliminary results
IHC+CLIHC '11: Proceedings of the 10th Brazilian Symposium on Human Factors in Computing Systems and the 5th Latin American Conference on Human-Computer Interaction

Mobile devices are becoming the mass IT platform of the future, reaching people that have never accessed the digital world. Aiming at digitally including visually impaired people also, it is necessary to address solutions that overcome natural barriers ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

IHC '19: Proceedings of the 18th Brazilian Symposium on Human Factors in Computing Systems

October 2019

679 pages

ISBN:9781450369718

DOI:10.1145/3357155

General Chairs:
Rodrigo Laiola Guimaraes
Universidade Federal do Espirito Santo (UFES)
,
Celso Alberto Saibel Santos
Universidade Federal do Espirito Santo (UFES)
,
Program Chairs:
Vagner Figueredo de Santana
IBM Research
,
Artur Kronbauer
Universidade Salvador (UNIFACS)

Copyright © 2019 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SBC: Brazilian Computer Society

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 22 October 2019

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

IHC '19

Sponsor:

SBC

IHC '19: XVIII Brazilian Symposium on Human Factors in Computing Systems

October 22 - 25, 2019

Espírito Santo, Vitória, Brazil

Acceptance Rates

IHC '19 Paper Acceptance Rate 56 of 165 submissions, 34%;

Overall Acceptance Rate 331 of 973 submissions, 34%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
144
Total Downloads

Downloads (Last 12 months)15
Downloads (Last 6 weeks)3

Reflects downloads up to 28 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Teran LMelo GSilva ISalles RRocha TMota M(2024)A Set of Professional Tools to Support the Design and Evaluation of Real-Time Payment Systems and Emergent UsersJournal on Interactive Systems10.5753/jis.2024.420715:1(790-809)Online publication date: 1-Aug-2024
https://doi.org/10.5753/jis.2024.4207
Da Costa Nunes ESilva PSouza RMonteiro I(2024)Investigating Accessibility at the Brazilian Symposium on Human Factors in Computing Systems (IHC)Proceedings of the XXIII Brazilian Symposium on Human Factors in Computing Systems10.1145/3702038.3702098(1-18)Online publication date: 7-Oct-2024
https://dl.acm.org/doi/10.1145/3702038.3702098
Da Costa Nunes ERibeiro GMonteiro IGonçalves E(2023)Digital Accessibility at the Brazilian Symposium on Human Factors in Computing Systems (IHC): An Updated Systematic Literature ReviewProceedings of the XXII Brazilian Symposium on Human Factors in Computing Systems10.1145/3638067.3638075(1-15)Online publication date: 16-Oct-2023
https://dl.acm.org/doi/10.1145/3638067.3638075
Pedroso Carvalho LRibeiro de Souza JOliveira Prates RPimenta Freire A(2023)SIM-SR—Semiotic Inspection Method Mediated by Screen Reader: Analysing the Benefits of Bringing Communicability to the Accessibility Evaluation TableInteracting with Computers10.1093/iwc/iwad02335:2(276-300)Online publication date: 4-Mar-2023
https://doi.org/10.1093/iwc/iwad023
Carvalho Ldos Santos Mde Souza JPrates RFreire AMonteiro Ida Hora Rodrigues Kde Gois Ribeiro Darin TFreire AMota M(2021)Beyond BarriersProceedings of the XX Brazilian Symposium on Human Factors in Computing Systems10.1145/3472301.3484365(1-11)Online publication date: 18-Oct-2021
https://dl.acm.org/doi/10.1145/3472301.3484365

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents