A novel multimedia educational speech therapy system for hearing impaired children
Authors: 
Azam Bastanfard, Nima Attaran Rezaei, Mahyar Mottaghizadeh, Maryam FazelAuthors Info & Claims
Azam Bastanfard, Nima Attaran Rezaei, Mahyar Mottaghizadeh, Maryam FazelAuthors Info & ClaimsPages 705 - 715
Abstract
Shortcomings in the current process of speech therapy motivated us to develop a software system for Persian children with articulation disorders. The main aim of the system is to facilitate the interaction and synchronization of language learning activities conducted both at home and in speech therapy centres during the therapy process. A creative, entertaining combination of multimedia material is incorporated into the system. The methodology is practical and cost-effective and can be extended to other relatively uncommon languages. We have tried to keep the work in harmony with the favourites of children and in line with speech therapists requirements. The preliminary test results show the successful integration of the designed system into the convenient method used by speech therapists in Iran.
References
[1]
Chun, D.M., Plass, J.L.: Effects of multimedia annotations on vocabulary acquisition. Modern Language Journal 80, 183-198 (1996)
[2]
Dr. Speech, http://www.drspeech.com/
[3]
Gap, http://www.speechtherapy.ir
[4]
Erber, N.P.: Auditory-visual perception of speech. Journal of Speech and Hearing Disorders XL, 481-492 (1975)
[5]
Grauwinkel, K., Dewitt, B., Fagel, S.: Visual information and redundancy conveyed by internal articulator dynamics in synthetic audiovisual speech. Presented at Interspeech 2007 - Eurospeech (2007)
[6]
Benoît, C., Mohamadi, T., Kandel, S.: Effects of phonetic context on audio-visual intelligibility of French. Journal of Speech and Hearing Research 37, 1195-1203 (1994)
[7]
Massaro, D.M.: A computer-animated tutor for spoken and written language learning. In: Proc. of the 5th International Conference on Multimodal Interfaces, Vancouver, British Columbia, Canada, pp. 172-175 (2003)
[8]
Massaro, D.W., Light, J.: Using visible speech to train perception and production of speech for individuals with hearing loss. Journal of Speech, Language, and Hearing Research 47, 304-320 (2004)
[9]
Hsiao, M., Li, P.T., Lin, P.Y., Tang, S., Lee, T., Young, S.: A computer based software for hearing impaired children's speech training and learning between teacher and parents in Taiwan. In: Proc. of the 23rd Annual International Conference of the IEEE Engineering in Medicine and Biology Society, October 25-28, vol. 2, pp. 1457-1459 (2001)
[10]
Bälter, O., Engwall, O., Öster, A., Kjellström, H.: Designing for individuals with hearing impairment: Wizard-of-Oz test of ARTUR: a computer-based speech training system with articulation correction. In: Proc. of the 7th International ACM SIGACCESS Conference on Computers and Accessibility Assets 2005, MD (2005)
[11]
Kirschning, I., Toledo, M.T., Valadez, L.E., Canizales, D.: Vowel & diphthong tutors for language therapy. In: Proc. of the Sixth Mexican International Conference on Computer Science (ENC 2005), pp. 26-30 (September 2005)
[12]
Badin, P., Bailly, G., Revéret, L., Baciu, M., Segebarth, C., Savariaux, C.: Threedimensional articulatory modeling of tongue, lips and face, based on MRI and video images. Journal of Phonetics 30, 533-553 (2002)
[13]
Liu, Y., Massaro, D.W., Chen, T.H., Chan, D., Perfetti, C.: Using Visual Speech for Training Chinese Pronunciation: An In-vivo Experiment
[14]
Soleymani, A.J.A., McCutcheon, M.J., Southwood, M.H.: Design of speech illumina mentor (SIM) for teaching speech to the hearing impaired. In: Proc. of the 1997 Sixteenth Southern, Biomedical Engineering Conference, April 4-6, pp. 425-428 (1997)
[15]
Tarabalka, Y., Badin, P., Elisei, F., Bailly, G.: Can you "read tongue movements?" Evaluation of the contribution of tongue display to speech understanding. In: ASSISTH 2007 - Toulouse, France, November 19-21 (2007)
[16]
Eriksson, E., Bälter, O., Engwall, O., Öster, A.-M., Sidenbladh-Kjellström, H.: Design Recommendations for a Computer-Based Speech Training System Based on End-User Interviews
[17]
Massaro, D.W., Light: Read My Tongue Movements: Bimodal Learning To Perceive And Produce Non-Native Speech /r/ and /l/. In: Proceedings of Eurospeech (Interspeech), 8th European Conference on Speech Communication and Technology, Geneva, Switzerland (2003)
[18]
User Interface Design: A Software Engineering Perspective, Soren Lauesen. Addison Wesley (2005)
[19]
Zare, P.: Collecting voices from children between two to six years old in order to design multimedia softwares (A thesis in Persian)
[20]
Caplan, T., Caplan, F.: The early childhood years: the 2 to 6 year old. Putnam, New York (1993)
[21]
Hanna, L., Risden, K., Alexander, K.: Guidelines for usability testing with children. Interactions 4(5), 9-14 (1997)
[22]
Ling, D.: Speech and the hearing-impaired child: theory and practice. Alexander Graham Bell Association for the Deaf, Washington (1976)
[23]
Norman, D.A.: The Design of Everyday Things. MIT Press, Cambridge (1988)
[24]
Wilson, K.S.: Palenque: An Interactive Multimedia Digital Video Interactive Prototype for Children. In: The Proceedings of Conference on Human Factors and Computing Systems (CHI 1988), Washington, USA, pp. 275-279. ACM Press, New York (1988)
[25]
Bastanfard, A., Fazel, M., Abdi Kelishami, A., Aghaahmadi, M.: A comprehensive audiovisual corpus for teaching sound Persian phoneme articulation. Accepted in IEEE International Conference on System, Man and Cybernetics, SMC (2009)
[26]
Bastanfard, A., Fazel, M., Kelishami, A.A., Aghaahmadi, M.: The Persian Linguistic Based Audio-Visual Data Corpus, AVA II, Considering Coarticulation. In: Boll, S., Tian, Q., Zhang, L., Zhang, Z., Chen, Y.-P.P. (eds.) MMM 2010. LNCS, vol. 5916, pp. 284- 294. Springer, Heidelberg (2010)
[27]
Bastanfard, A., Aghaahmadi, M.: Persian Viseme Classification for Developing Visual Speech Training Application. In: Muneesawang, P., Wu, F., Kumazawa, I., Roeksabutr, A., Liao, M., Tang, X. (eds.) PCM 2009. LNCS, vol. 5879, pp. 1080-1085. Springer, Heidelberg (2009)
[28]
Perdrix, F., Granollers, T., Lorés, J., Gonzales, M.: Studying the Usability of a website focused on children. In: Proceedings of HCI International 2003, Creta (2003)
Recommendations
Computer-based speech training for children
A computer-based speech training system has been developed for children. The system is able to perform diagnostics and training in Malay language at both syllable and word level. The system allows children with difficulty in articulating plosive sounds ...
Towards designing speech technology based assistive interfaces for children's speech therapy
ICMI '17: Proceedings of the 19th ACM International Conference on Multimodal InteractionIndependent studies by the UK government in 2016 observed that speech sound disorders are the most prevalent condition amongst children. Lack of opportunities for individual practice and increasing caseload on speech therapists affect therapy outcomes. ...
Play and Learn with an Intelligent Robot: Enhancing the Therapy of Hearing-Impaired Children
Human-Computer Interaction – INTERACT 2019AbstractThis study suggests an innovative way of using an intelligent robot to support speech therapy for hearing impaired children through play. Although medical technology (e.g., hearing aid, cochlear implant) for children with hearing impairment has ...
Comments
Information & Contributors
Information
Published In
September 2010
759 pages
ISBN:3642156959
Publisher
Springer-Verlag
Berlin, Heidelberg
Publication History
Published: 21 September 2010
Author Tags
Qualifiers
- Article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 0Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 18 Jan 2025