extended-abstract

DYSIGN: Towards Computational Screening of Dyslexia and Dysgraphia Based on Handwriting Quality

Authors:

Hana Ali Rashid,

Abdul SamadAuthors Info & Claims

IDC '23: Proceedings of the 22nd Annual ACM Interaction Design and Children Conference

Pages 532 - 536

https://doi.org/10.1145/3585088.3593890

Published: 19 June 2023 Publication History

Abstract

Specific Learning Difficulties such as Dyslexia and Dysgraphia are characterized by struggles in reading and writing. Their diagnosis and intervention are critical as if left unattended, they can cause hindrance in academic activity, self-esteem, and long-term quality of life. Owing to the complex traditional processes for diagnosis, social stigma, and the general lack of availability of remedial therapists and clinical psychologists in Pakistan, this study explores the potential of handwriting quality features to be used in computationally screening for SLDs to make screening more accessible. This project consists of exploratory data analysis of handwriting scans of 25 children thus far, in the age group of 5 to 15, generating various handwriting quality features and using classification models to assess their potential. Our preliminary results are promising, with approximately 80% accuracy, thus showing potential for increased accuracy when paired with larger data samples and further feature generation.

References

[1]

2015. The Research. https://www.lexplore.com/how-does-it-work/the-research/

[2]

2016. Dytective por Change Dyslexia. https://www.changedyslexia.org/

[3]

2020. Dystech - Assess and Monitor Reading Performance Online. https://dystech.com.au/

[4]

Barbara Arfé, Francesca Corato, Eleonora Pizzocaro, and Anne Merella. 2020. The Effects of Script and Orthographic Complexity on the Handwriting and Spelling Performance of Children With Dyslexia. Journal of Learning Disabilities 53, 2 (April 2020), 96–108. https://doi.org/10.1177/0022219419892845

[5]

Thomais Asvestopoulou, Victoria Manousaki, Antonis Psistakis, Erjona Nikolli, Vassilios Andreadakis, Ioannis M. Aslanides, Yannis Pantazis, Ioannis Smyrnakis, and Maria Papadopouli. 2019. Towards a Robust and Accurate Screening Tool for Dyslexia with Data Augmentation using GANs. In 2019 IEEE 19th International Conference on Bioinformatics and Bioengineering (BIBE). 775–782. https://doi.org/10.1109/BIBE.2019.00145 ISSN: 2471-7819.

[6]

Peter Drotár and Marek Dobeš. 2020. Dysgraphia detection through machine learning. Scientific Reports 10, 1 (Dec. 2020), 21541. https://doi.org/10.1038/s41598-020-78611-9 Number: 1 Publisher: Nature Publishing Group.

[7]

Ombretta Gaggi, Claudio Enrico Palazzi, Matteo Ciman, Giorgia Galiazzo, Sandro Franceschini, Milena Ruffino, Simone Gori, and Andrea Facoetti. 2017. Serious Games for Early Identification of Developmental Dyslexia. Computers in Entertainment 15, 2 (April 2017), 4:1–4:24. https://doi.org/10.1145/2629558

Digital Library

[8]

Thomas Gargot, Thibault Asselborn, Hugues Pellerin, Ingrid Zammouri, Salvatore M. Anzalone, Laurence Casteran, Wafa Johal, Pierre Dillenbourg, David Cohen, and Caroline Jolly. 2020. Acquisition of handwriting in children with and without dysgraphia: A computational approach. PLOS ONE 15, 9 (Sept. 2020), e0237575. https://doi.org/10.1371/journal.pone.0237575 Publisher: Public Library of Science.

[9]

Iza Sazanita Isa, Wan Nurazwin Syazwani Rahimi, Siti Azura Ramlan, and Siti Noraini Sulaiman. 2019. Automated Detection of Dyslexia Symptom Based on Handwriting Image for Primary School Children. Procedia Computer Science 163 (Jan. 2019), 440–449. https://doi.org/10.1016/j.procs.2019.12.127

Digital Library

[10]

Ruchira Kariyawasam, Madhuka Nadeeshani, Tuan Hamid, Inisha Subasinghe, Pradeepa Samarasinghe, and Pasangi Ratnayake. 2019. Pubudu: Deep Learning Based Screening And Intervention of Dyslexia, Dysgraphia And Dyscalculia. In 2019 14th Conference on Industrial and Information Systems (ICIIS). 476–481. https://doi.org/10.1109/ICIIS47346.2019.9063301 ISSN: 2164-7011.

[11]

Shankar K. Parmar, Oias A. Ramwala, and Chirag N. Paunwala. 2021. Performance Evaluation of SVM with Non-Linear Kernels for EEG-based Dyslexia Detection. In 2021 IEEE 9th Region 10 Humanitarian Technology Conference (R10-HTC) (2021-09). 1–6. https://doi.org/10.1109/R10-HTC53172.2021.9641696 ISSN: 2572-7621.

[12]

Seth Polsley, Larry Powell, Hong-Hoe Kim, Xien Thomas, Jeffrey Liew, and Tracy Hammond. 2021. Detecting Children’s Fine Motor Skill Development using Machine Learning. International Journal of Artificial Intelligence in Education (Oct. 2021). https://doi.org/10.1007/s40593-021-00279-7

[13]

Maria Rauschenberger, Luz Rello, Ricardo Baeza-Yates, and Jeffrey P. Bigham. 2018. Towards Language Independent Detection of Dyslexia with a Web-based Game. In Proceedings of the 15th International Web for All Conference (New York, NY, USA, 2018-04-23) (W4A ’18). Association for Computing Machinery, 1–10. https://doi.org/10.1145/3192714.3192816

Digital Library

[14]

Luz Rello and Miguel Ballesteros. 2015. Detecting readers with dyslexia using machine learning with eye tracking measures. In Proceedings of the 12th International Web for All Conference (New York, NY, USA, 2015-05-18) (W4A ’15). Association for Computing Machinery, 1–8. https://doi.org/10.1145/2745555.2746644

Digital Library

[15]

Gilles Richard and Mathieu Serrurier. 2020. Dyslexia and Dysgraphia prediction: A new machine learning approach. https://doi.org/10.48550/arXiv.2005.06401 arXiv:2005.06401 [cs, stat].

[16]

Mohamed Syazwan Asyraf Bin Rosli, Iza Sazanita Isa, Siti Azura Ramlan, Siti Noraini Sulaiman, and Mohd Ikmal Fitri Maruzuki. 2021. Development of CNN Transfer Learning for Dyslexia Handwriting Recognition. In 2021 11th IEEE International Conference on Control System, Computing and Engineering (ICCSCE). 194–199. https://doi.org/10.1109/ICCSCE52189.2021.9530971

[17]

Katherine Spoon, David J. Crandall, and K Siek. 2019. Towards Detecting Dyslexia in Children’s Handwriting Using Neural Networks.

[18]

Xien Thomas, Larry Powell, Seth Polsley, Samantha Ray, and Tracy Hammond. 2022. Identifying Features that Characterize Children’s Free-Hand Sketches using Machine Learning. In Interaction Design and Children(IDC ’22). Association for Computing Machinery, New York, NY, USA, 529–535. https://doi.org/10.1145/3501712.3535281

Digital Library

[19]

Rana Yassin, David L. Share, and Yasmin Shalhoub-Awwad. 2020. Learning to Spell in Arabic: The Impact of Script-Specific Visual-Orthographic Features. Frontiers in Psychology 11 (2020). https://www.frontiersin.org/articles/10.3389/fpsyg.2020.02059

[20]

Pratheepan Yogarajah and Braj Bhushan. 2020. Deep Learning Approach to Automated Detection of Dyslexia-Dysgraphia: The 25th IEEE International Conference on Pattern Recognition. https://pure.ulster.ac.uk/ws/portalfiles/portal/88801667/GOOD_paperid_2_new.pdf

[21]

A. Z. A Zainuddin, Khuan Y. Lee, W. Mansor, and Z. Mahmoodin. 2018. Extreme Learning Machine for Distinction of EEG Signal Pattern of Dyslexic Children in Writing. In 2018 IEEE-EMBS Conference on Biomedical Engineering and Sciences (IECBES). 652–656. https://doi.org/10.1109/IECBES.2018.8626700

Cited By

Narvaez R(2024)Towards Automating the Process of Identifying and Monitoring Deficiencies in the Handwriting of Preschool ChildrenProceedings of the 23rd Annual ACM Interaction Design and Children Conference10.1145/3628516.3659857(984-986)Online publication date: 17-Jun-2024
https://dl.acm.org/doi/10.1145/3628516.3659857
Narvaez RPolsley SHammond T(2024)Children's Drawings Speak: Comparing Sketch Features amongst Development GroupsProceedings of the 23rd Annual ACM Interaction Design and Children Conference10.1145/3628516.3659373(676-679)Online publication date: 17-Jun-2024
https://dl.acm.org/doi/10.1145/3628516.3659373
Sukiman SAzura Husin NHamdan HAzmi Murad M(2024)Handwriting Image Classification for Automated Diagnosis of Learning Disabilities: A Review on Deep Learning Models and Future Directions2024 19th International Joint Symposium on Artificial Intelligence and Natural Language Processing (iSAI-NLP)10.1109/iSAI-NLP64410.2024.10799245(1-6)Online publication date: 11-Nov-2024
https://doi.org/10.1109/iSAI-NLP64410.2024.10799245
Show More Cited By

Index Terms

DYSIGN: Towards Computational Screening of Dyslexia and Dysgraphia Based on Handwriting Quality
1. Applied computing
  1. Education
2. Human-centered computing
  1. Accessibility

Recommendations

Which characteristics predict writing capabilities among adolescents with dysgraphia?
Highlights
- Adolescents with dysgraphia have inferior executive functions abilities.
- ...
Abstract
The aims of this study were to compare handwriting and writing capabilities as well as executive functions (EF) and developmental and functional characteristics of adolescents with and without dysgraphia and to find the predictors of ...
Exploring the effectiveness of a mobile writing application for supporting handwriting acquisition of students with dysgraphia
Abstract
Handwriting is one of the most important essential skills for both literacy and beyond. However, some students have difficulty in writing. Dysgraphia, a disorder of written expression, is a condition where a student’s writing skills are below the ...
Good fonts for dyslexia
ASSETS '13: Proceedings of the 15th International ACM SIGACCESS Conference on Computers and Accessibility

Around 10% of the people have dyslexia, a neurological disability that impairs a person's ability to read and write. There is evidence that the presentation of the text has a significant effect on a text's accessibility for people with dyslexia. However,...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

IDC '23: Proceedings of the 22nd Annual ACM Interaction Design and Children Conference

June 2023

824 pages

ISBN:9798400701313

DOI:10.1145/3585088

Copyright © 2023 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 19 June 2023

Check for updates

Author Tags

Qualifiers

Extended-abstract
Research
Refereed limited

Conference

IDC '23

Sponsor:

SIGCHI

IDC '23: Interaction Design and Children

June 19 - 23, 2023

IL, Chicago, USA

Acceptance Rates

Overall Acceptance Rate 172 of 578 submissions, 30%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
122
Total Downloads

Downloads (Last 12 months)68
Downloads (Last 6 weeks)9

Reflects downloads up to 22 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Narvaez R(2024)Towards Automating the Process of Identifying and Monitoring Deficiencies in the Handwriting of Preschool ChildrenProceedings of the 23rd Annual ACM Interaction Design and Children Conference10.1145/3628516.3659857(984-986)Online publication date: 17-Jun-2024
https://dl.acm.org/doi/10.1145/3628516.3659857
Narvaez RPolsley SHammond T(2024)Children's Drawings Speak: Comparing Sketch Features amongst Development GroupsProceedings of the 23rd Annual ACM Interaction Design and Children Conference10.1145/3628516.3659373(676-679)Online publication date: 17-Jun-2024
https://dl.acm.org/doi/10.1145/3628516.3659373
Sukiman SAzura Husin NHamdan HAzmi Murad M(2024)Handwriting Image Classification for Automated Diagnosis of Learning Disabilities: A Review on Deep Learning Models and Future Directions2024 19th International Joint Symposium on Artificial Intelligence and Natural Language Processing (iSAI-NLP)10.1109/iSAI-NLP64410.2024.10799245(1-6)Online publication date: 11-Nov-2024
https://doi.org/10.1109/iSAI-NLP64410.2024.10799245
P DSreekumar SA L(2024)Detection of Potential Specific Learning Disabilities in Children through Handwriting Analysis Using Machine Learning2024 IEEE Region 10 Symposium (TENSYMP)10.1109/TENSYMP61132.2024.10752261(1-6)Online publication date: 27-Sep-2024
https://doi.org/10.1109/TENSYMP61132.2024.10752261

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents