Work in Progress

"I Want To Be Able To Change The Speed And Size Of The Avatar": Assessing User Requirements For Animated Sign Language Translation Interfaces

Authors:

Barbara Gleißl,

Dieter Wallach,

Nicole JochemsAuthors Info & Claims

CHI EA '23: Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems

Article No.: 167, Pages 1 - 7

https://doi.org/10.1145/3544549.3585675

Published: 19 April 2023 Publication History

Abstract

Despite research having shown that signing users vary in their preferences and needs of distinct sign language (SL) parameters, current research on SL avatars lacks consideration of the UI context’s options for individualization or configuration of such parameters. Our paper addresses this gap as it presents our ability-oriented online survey, in which we asked native signers about parameters they would like to configure, as well content types that should be offered for translation within travel contexts. Our results indicate that parameters with a direct influence on the understandability of the avatar are most important for individual adjustments and situations with high time-pressure are valued highly for translation within travelling contexts. Also, our study design revealed that assessing the language background of participants in the form of an example-based self-assessment can help achieve more sensitive results, emphasizing the need for adequate research approaches.

Supplementary Material

MP4 File (3544549.3585675-talk-video.mp4)

Pre-recorded Video Presentation

Download
69.01 MB

References

[1]

Nicoletta Adamo-Villani and Ronnie B. Wilbur. 2015. ASL-Pro: American Sign Language Animation with Prosodic Elements. In Universal Access in Human-Computer Interaction. Access to Interaction(Lecture Notes in Computer Science), Margherita Antona and Constantine Stephanidis (Eds.). Springer International Publishing, Cham, 307–318. https://doi.org/10.1007/978-3-319-20681-3_29

[2]

Sedeeq Al-khazraji, Becca Dingman, and Matt Huenerfauth. 2020. Empirical Investigation of Users’ Preferred Timing Parameters for American Sign Language Animations. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems(CHI EA ’20). Association for Computing Machinery, New York, NY, USA, 1–7. https://doi.org/10.1145/3334480.3382989

Digital Library

[3]

Sedeeq Al-khazraji, Becca Dingman, Sooyeon Lee, and Matt Huenerfauth. 2021. At a Different Pace: Evaluating Whether Users Prefer Timing Parameters in American Sign Language Animations to Differ from Human Signers’ Timing. In The 23rd International ACM SIGACCESS Conference on Computers and Accessibility. ACM, Virtual Event USA, 1–12. https://doi.org/10.1145/3441852.3471214

Digital Library

[4]

Melissa L Anderson, Timothy Riker, Stephanie Hakulin, Jonah Meehan, Kurt Gagne, Todd Higgins, Elizabeth Stout, Emma Pici-D’Ottavio, Kelsey Cappetta, and Kelly S Wolf Craig. 2020. Deaf ACCESS: Adapting Consent Through Community Engagement and State-of-the-Art Simulation. The Journal of Deaf Studies and Deaf Education 25, 1 (2020), 115–125.

[5]

Keith Atkinson, Jaclyn Barnes, Judith Albee, Peter Anttila, Judith Haataja, Kanak Nanavati, Kelly Steelman, and Charles Wallace. 2016. Breaking Barriers to Digital Literacy: An Intergenerational Social-Cognitive Approach. In Proceedings of the 18th International ACM SIGACCESS Conference on Computers and Accessibility. ACM, Reno Nevada USA, 239–244. https://doi.org/10.1145/2982142.2982183

Digital Library

[6]

Christiane Attig, Sebastian Mach, Daniel Wessel, Thomas Franke, Franziska Schmalfuß, and Josef F. Krems. 2018. Technikaffinität als Ressource für die Arbeit in Industrie 4.0. aw&I Conference 3 (Sept. 2018), 1–9. https://doi.org/10.14464/awic.v3i0.251

[7]

George Balch and Donna Mertens. 1999. Focus Group Design and Group Dynamics: Lessons from Deaf and Hard of Hearing Participants. American Journal of Evaluation 20, 2 (1999), 265–277.

[8]

Lucas Bernhard, Fabrizio Nunnari, Amelie Unger, Judith Bauerdiek, Christian Dold, Marcel Hauck, Alexander Stricker, Tobias Baur, Alexander Heimerl, Elisabeth André, Melissa Reinecker, Cristina España-Bonet, Yasser Hamidullah, Stephan Busemann, Patrick Gebhard, Corinna Jäger, Sonja Wecker, Yvonne Kossel, Henrik Müller, Kristoffer Waldow, Arnulph Fuhrmann, Martin Misiak, and Dieter Wallach. 2022. Towards Automated Sign Language Production: A Pipeline for Creating Inclusive Virtual Humans. In Proceedings of the 15th International Conference on PErvasive Technologies Related to Assistive Environments(PETRA ’22). Association for Computing Machinery, New York, NY, USA, 260–268. https://doi.org/10.1145/3529190.3529202

Digital Library

[9]

Heike Brock and Shigeaki Nishina. 2020. Quantifying Sign Avatar Perception: How Imperfect Is Insufficient?. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems(CHI EA ’20). Association for Computing Machinery, New York, NY, USA, 1–8. https://doi.org/10.1145/3334480.3375222

Digital Library

[10]

Cristina Calvo-Porral and Rogelio Pesqueira-Sanchez. 2020. Generational Differences in Technology Behaviour: Comparing Millennials and Generation X. Kybernetes 49, 11 (Jan. 2020), 2755–2772. https://doi.org/10.1108/K-09-2019-0598

[11]

Sara J. Czaja and Chin Chin Lee. 2007. The Impact of Aging on Access to Technology. Universal Access in the Information Society 5, 4 (April 2007), 341–349. https://doi.org/10.1007/s10209-006-0060-x

Digital Library

[12]

Jamie DeCoster, Marcello Gallucci, and Anne-Marie Iselin. 2011. Best Practices for Using Median Splits, Artificial Categorization, and Their Continuous Alternatives. Journal of Experimental Psychopathology 2 (May 2011), 197–209. https://doi.org/10.5127/jep.008310

[13]

Sarah Ebling and John Glauert. 2016. Building a Swiss German Sign Language Avatar with JASigning and Evaluating It among the Deaf Community. Universal Access in the Information Society 15, 4 (Nov. 2016), 577–587. https://doi.org/10.1007/s10209-015-0408-1

Digital Library

[14]

Alexis Heloir, Quan Nguyen, and Michael Kipp. 2011. Signing Avatars: A Feasibility Study. The Second International Workshop on Sign Language Translation and Avatar Technology (SLTAT) (2011), 8.

[15]

Matt Huenerfauth. 2008. Evaluation of a Psycholinguistically Motivated Timing Model for Animations of American Sign Language. In Proceedings of the 10th International ACM SIGACCESS Conference on Computers and Accessibility(Assets ’08). Association for Computing Machinery, New York, NY, USA, 129–136. https://doi.org/10.1145/1414471.1414496

Digital Library

[16]

Matt Huenerfauth. 2009. A Linguistically Motivated Model for Speed and Pausing in Animations of American Sign Language. ACM Transactions on Accessible Computing 2, 2 (June 2009), 9:1–9:31. https://doi.org/10.1145/1530064.1530067

Digital Library

[17]

Matt Huenerfauth. 2015. Best Practices for Conducting Evaluations of Sign Language Animation. Journal on Technology and Persons with Disabilities 3 (2015), 20–32.

[18]

Matt Huenerfauth and Vicki Hanson. 2009. Sign Language in the Interface: Access for Deaf Signers. In The Universal Access Handbook, Constantine Stephanidis (Ed.). Vol. 20091047. CRC Press, 1–18. https://doi.org/10.1201/9781420064995-c38

[19]

Vince Jennings, Ralph Elliott, Richard Kennaway, and John Glauert. 2010. Requirements For A Signing Avatar. sign-lang@ LREC 2010 (2010), 133–136.

[20]

Hernisa Kacorri, Matt Huenerfauth, Sarah Ebling, Kasmira Patel, and Mackenzie Willard. 2015. Demographic and Experiential Factors Influencing Acceptance of Sign Language Animation by Deaf Users. In Proceedings of the 17th International ACM SIGACCESS Conference on Computers & Accessibility(ASSETS ’15). Association for Computing Machinery, Lisbon, Portugal, 147–154. https://doi.org/10.1145/2700648.2809860

Digital Library

[21]

Michael Kipp, Alexis Heloir, and Quan Nguyen. 2011. Sign Language Avatars: Animation and Comprehensibility. In Intelligent Virtual Agents, David Hutchison, Takeo Kanade, Josef Kittler, Jon M. Kleinberg, Friedemann Mattern, John C. Mitchell, Moni Naor, Oscar Nierstrasz, C. Pandu Rangan, Bernhard Steffen, Madhu Sudan, Demetri Terzopoulos, Doug Tygar, Moshe Y. Vardi, Gerhard Weikum, Hannes Högni Vilhjálmsson, Stefan Kopp, Stacy Marsella, and Kristinn R. Thórisson (Eds.). Vol. 6895. Springer Berlin Heidelberg, Berlin, Heidelberg, 113–126. https://doi.org/10.1007/978-3-642-23974-8_13

[22]

Michael Kipp, Quan Nguyen, Alexis Heloir, and Silke Matthes. 2011. Assessing the Deaf User Perspective on Sign Language Avatars. In The Proceedings of the 13th International ACM SIGACCESS Conference on Computers and Accessibility(ASSETS ’11). Association for Computing Machinery, New York, NY, USA, 107–114. https://doi.org/10.1145/2049536.2049557

Digital Library

[23]

Harlan Lane. 2005. Ethnicity, Ethics, and the Deaf-World. Journal of Deaf Studies and Deaf Education 10, 3 (2005), 291–310.

[24]

LimeSurvey. 2020. License & Trademark. https://community.limesurvey.org/licence-trademark/.

[25]

Michael McKee, Deirdre Schlehofer, and Denise Thew. 2013. Ethical Issues in Conducting Research With Deaf Populations. American Journal of Public Health 103, 12 (2013), 2174–2178.

[26]

Amelie Nolte, Karolin Lueneburg, Dieter P. Wallach, and Nicole Jochems. 2022. Creating Personas for Signing User Populations: An Ability-Based Approach to User Modelling in HCI. In Proceedings of the 24th International ACM SIGACCESS Conference on Computers and Accessibility(ASSETS ’22). Association for Computing Machinery, New York, NY, USA, 1–6. https://doi.org/10.1145/3517428.3550364

Digital Library

[27]

Amelie Nolte, Jacob O. Wobbrock, Torben Volkmann, and Nicole Jochems. 2022. Implementing Ability-Based Design: A Systematic Approach to Conceptual User Modeling. ACM Transactions on Accessible Computing 15, 4 (July 2022), 1–26. https://doi.org/10.1145/3551646

Digital Library

[28]

Fabrizio Nunnari, Judith Bauerdiek, Lucas Bernhard, Cristina España-Bonet, Corinna Jäger, Amelie Unger, Kristoffer Waldow, Sonja Wecker, Elisabeth André, Stephan Busemann, Christian Dold, Arnulph Fuhrmann, Patrick Gebhard, Yasser Hamidullah, Marcel Hauck, Yvonne Kossel, Martin Misiak, Dieter Wallach, and Alexander Stricker. 2021. AVASAG: A German Sign Language Translation System for Public Services (Short Paper). In Proceedings of the 1st International Workshop on Automatic Translation for Signed and Spoken Languages (AT4SSL). Association for Machine Translation in the Americas, Virtual, 43–48.

[29]

Roland Pfau, Markus Steinbach, and Bencie Woll. 2012. Sign Language: An International Handbook. Sign Language 90, 4 (Aug. 2012), 977–980. https://doi.org/10.1515/9783110261325

[30]

Lorna C. Quandt, Athena Willis, Melody Schwenk, Kaitlyn Weeks, and Ruthie Ferster. 2021. Attitudes toward Signing Human Avatars Vary Depending on Hearing Status, Age of Signed Language Exposure, and Avatar Type. https://doi.org/10.31234/osf.io/g2wuc

[31]

Karen Renaud and Judy van Biljon. 2008. Predicting Technology Acceptance and Adoption by the Elderly: A Qualitative Study. In Proceedings of the 2008 annual research conference of the South African Institute of Computer Scientists and Information Technologists on IT research in developing countries: riding the wave of technology. Association for Computing Machinery, South Africa, 210–219.

[32]

Floris Roelofsen, Lyke Esselink, Shani Mende-Gillings, Maartje de Meulder, Nienke Sijm, and Anika Smeijers. 2021. Online Evaluation of Text-to-sign Translation by Deaf End Users: Some Methodological Recommendations (Short Paper). In Proceedings of the 1st International Workshop on Automatic Translation for Signed and Spoken Languages (AT4SSL). Association for Machine Translation in the Americas, Virtual, 82–87.

[33]

Amelie Unger, Dieter P. Wallach, and Nicole Jochems. 2021. Lost in Translation: Challenges and Barriers to Sign Language-Accessible User Research. In The 23rd International ACM SIGACCESS Conference on Computers and Accessibility(ASSETS ’21). Association for Computing Machinery, New York, NY, USA, 1–5. https://doi.org/10.1145/3441852.3476473

Digital Library

[34]

Margriet Verlinden, Corrie Tijsseling, and Han Frowein. 2001. Sign Language on the WWW. In Proceedings of 18th Int. Symposium on Human Factors in Telecommunication. Bergen, Norway, 1–8.

[35]

Ronnie B. Wilbur. 2009. Effects of Varying Rate of Signing on ASL Manual Signs and Nonmanual Markers. Language and Speech 52, 2-3 (June 2009), 245–285. https://doi.org/10.1177/0023830909103174

[36]

Jacob O. Wobbrock, Krzysztof Z. Gajos, Shaun K. Kane, and Gregg C. Vanderheiden. 2018. Ability-Based Design. Commun. ACM 61, 6 (May 2018), 62–71. https://doi.org/10.1145/3148051

Digital Library

[37]

Jacob O. Wobbrock, Shaun K. Kane, Krzysztof Z. Gajos, Susumu Harada, and Jon Froehlich. 2011. Ability-Based Design: Concept, Principles and Examples. ACM Transactions on Accessible Computing 3, 3 (April 2011), 9:1–9:27. https://doi.org/10.1145/1952383.1952384

Digital Library

Cited By

Tran NLadner RBragg D(2023)U.S. Deaf Community Perspectives on Automatic Sign Language TranslationProceedings of the 25th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3597638.3614507(1-7)Online publication date: 22-Oct-2023
https://dl.acm.org/doi/10.1145/3597638.3614507

Index Terms

"I Want To Be Able To Change The Speed And Size Of The Avatar": Assessing User Requirements For Animated Sign Language Translation Interfaces
1. Human-centered computing
  1. Accessibility
    1. Empirical studies in accessibility

Recommendations

Assessing the deaf user perspective on sign language avatars
ASSETS '11: The proceedings of the 13th international ACM SIGACCESS conference on Computers and accessibility

Signing avatars have the potential to become a useful and even cost-effective method to make written content more accessible for Deaf people. However, avatar research is characterized by the fact that most researchers are not members of the Deaf ...
Mobile sign language translation system for deaf community
W4A '12: Proceedings of the International Cross-Disciplinary Conference on Web Accessibility

Nowadays, web technologies are a very efficient way to ensure communication between a large and heterogeneous audience. Furthermore, web information is mainly based on textual and multimedia content and consequently, some people with special needs, such ...
Method to Define User Interfaces in the Requirements Analysis Phase
EICS '18: Proceedings of the ACM SIGCHI Symposium on Engineering Interactive Computing Systems

Many requirements for quality in use are elicited in the late development phase. However, if requirements are elicited in the late development phase, the development may return to the previous phase or some requirements cannot be realized due to costs ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI EA '23: Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems

April 2023

3914 pages

ISBN:9781450394222

DOI:10.1145/3544549

Editors:
Albrecht Schmidt
LMU Munich, Germany
,
Kaisa Väänänen
Tampere University, Finland
,
Tesh Goyal
Google Research, USA
,
Per Ola Kristensson
University of Cambridge, UK
,
Anicia Peters
University of Namibia, Namibia

Copyright © 2023 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 19 April 2023

Check for updates

Author Tags

Qualifiers

Work in progress
Research
Refereed limited

Funding Sources

German Federal Ministry of Education and Research

Conference

CHI '23

Sponsor:

SIGCHI

CHI '23: CHI Conference on Human Factors in Computing Systems

April 23 - 28, 2023

Hamburg, Germany

Acceptance Rates

Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
169
Total Downloads

Downloads (Last 12 months)97
Downloads (Last 6 weeks)9

Reflects downloads up to 26 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Tran NLadner RBragg D(2023)U.S. Deaf Community Perspectives on Automatic Sign Language TranslationProceedings of the 25th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3597638.3614507(1-7)Online publication date: 22-Oct-2023
https://dl.acm.org/doi/10.1145/3597638.3614507

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Full Text

View this article in Full Text.

HTML Format

View this article in HTML Format.

Figures

Tables

Media

View full text|Download PDF

View Table of Conten