skip to main content
10.1145/3434074.3447279acmconferencesArticle/Chapter ViewAbstractPublication PageshriConference Proceedingsconference-collections
extended-abstract

Sign Language and Emotion Understanding

Published: 08 March 2021 Publication History

Abstract

Sign language is the primary form of communication of the deaf community. It is one of the only channels of communication between the hearing impaired community and the rest of society. While there are many existing SLR systems that focus on the recognition of manual gestures, few consider the non manual components of sign language, such as facial expressions. The role of these non manual features are comparable to pitch, intonation and nuances that are observed in spoken language. Our prototype combines manual SLR with emotion recognition to form a singular system that can recognise both facial expressions and sign language gestures.

Supplementary Material

MP4 File (hrivd1013vf.mp4)
Supplemental video

Cited By

View all
  • (2023)Virtual emotional gestures to assist in the examination of the mental health of the deaf‐mutesComputer Animation and Virtual Worlds10.1002/cav.216534:3-4Online publication date: 16-May-2023

Index Terms

  1. Sign Language and Emotion Understanding

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Conferences
      HRI '21 Companion: Companion of the 2021 ACM/IEEE International Conference on Human-Robot Interaction
      March 2021
      756 pages
      ISBN:9781450382908
      DOI:10.1145/3434074
      • General Chairs:
      • Cindy Bethel,
      • Ana Paiva,
      • Program Chairs:
      • Elizabeth Broadbent,
      • David Feil-Seifer,
      • Daniel Szafir
      Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

      Sponsors

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 08 March 2021

      Check for updates

      Author Tags

      1. machine learning
      2. neural networks
      3. sign language

      Qualifiers

      • Extended-abstract

      Conference

      HRI '21
      Sponsor:

      Acceptance Rates

      Overall Acceptance Rate 192 of 519 submissions, 37%

      Upcoming Conference

      HRI '25
      ACM/IEEE International Conference on Human-Robot Interaction
      March 4 - 6, 2025
      Melbourne , VIC , Australia

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)35
      • Downloads (Last 6 weeks)2
      Reflects downloads up to 04 Feb 2025

      Other Metrics

      Citations

      Cited By

      View all
      • (2023)Virtual emotional gestures to assist in the examination of the mental health of the deaf‐mutesComputer Animation and Virtual Worlds10.1002/cav.216534:3-4Online publication date: 16-May-2023

      View Options

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Figures

      Tables

      Media

      Share

      Share

      Share this Publication link

      Share on social media