research-article

ToothFairy: Real-time Tooth-by-tooth Brushing Monitor Using Earphone Reversed Signals

Authors:

Zhongwen GuoAuthors Info & Claims

Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, Volume 7, Issue 4

Article No.: 185, Pages 1 - 19

https://doi.org/10.1145/3631412

Published: 12 January 2024 Publication History

Abstract

Tooth brushing monitors have the potential to enhance oral hygiene and encourage the development of healthy brushing habits. However, previous studies fall short of recognizing each tooth due to limitations in external sensors and variations among users. To address these challenges, we present ToothFairy, a real-time tooth-by-tooth brushing monitor that uses earphone reverse signals captured within the oral cavity to identify each tooth during brushing. The key component of ToothFairy is a novel bone-conducted acoustic attenuation model, which quantifies sound propagation within the oral cavity. This model eliminates the need for machine learning and can be calibrated with just one second of brushing data for each tooth by a new user. ToothFairy also addresses practical issues such as brushing detection and tooth region determination. Results from extensive experiments, involving 10 volunteers and 25 combinations of five commercial off-the-shelf toothbrush and earphone models each, show that ToothFairy achieves tooth recognition with an average accuracy of 90.5%.

Supplementary Material

wang-2 (wang-2.zip)

Supplemental movie, appendix, image and software files for, ToothFairy: Real-time Tooth-by-tooth Brushing Monitor Using Earphone Reversed Signals

Download
8.65 MB

References

[1]

2022. Philips HX9911 Handbook. https://www.documents.philips.com/assets/20220202/7560018f4da4493b9cc0ae300118e654.pdf.

[2]

J Ainamo, Q Xie, A Ainamo, and P Kallio. 1997. Assessment of the effect of an oscillating/rotating electric toothbrush on oral health. A 12-month longitudinal study. Journal of Clinical Periodontology 24, 1 (Jan. 1997), 28--33.

[3]

Sumio Akifusa, Ayaka Isobe, Kanako Kibata, Akinori Oyama, Hiroko Oyama, Wataru Ariyoshi, and Tatsuji Nishihara. 2020. Comparison of dental plaque reduction after use of electric toothbrushes with and without QLF-D-applied plaque visualization: a 1-week randomized controlled trial. BMC Oral Health 20, 1 (Feb. 2020), 4.

[4]

Toshiyuki Ando, Yuki Kubo, Buntarou Shizuki, and Shin Takahashi. 2017. CanalSense: Face-Related Movement Recognition System based on Sensing Air Pressure in Ear Canals. In user interface software and technology. ACM, 679--689.

[5]

American Dental Association et al. 2013. Tackling tooth decay. Journal of American Dental Association (2013).

[6]

Ana Caraban, Maria José Ferreira, Rúben Gouveia, and Evangelos Karapanos. 2015. Social Toothbrush: Fostering Family Nudging around Tooth Brushing Habits. In Adjunct Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2015 ACM International Symposium on Wearable Computers (Osaka, Japan) (UbiComp/ISWC'15 Adjunct). Association for Computing Machinery, New York, NY, USA, 649--653. https://doi.org/10.1145/2800835.2809438

Digital Library

[7]

Yu-Chen Chang, Jin-Ling Lo, Chao-Ju Huang, Nan-Yi Hsu, Hao-Hua Chu, Hsin-Yen Wang, Pei-Yu Chi, and Ya-Lin Hsieh. 2008. Playful toothbrush. In Proceeding of the twenty-sixth annual CHI conference on Human factors in computing systems - CHI '08. ACM Press, 363--372.

[8]

Ching-Han Chen, Chien-Chun Wang, and Yan-Zhen Chen. 2021. Intelligent Brushing Monitoring Using a Smart Toothbrush with Recurrent Probabilistic Neural Network. Sensors 21, 4 (Feb. 2021), 1238.

[9]

Audrey Choo, David M Delac, and Louise Brearley Messer. 2001. Oral hygiene measures and promotion: review and considerations. Australian Dental Journal 46, 3 (Sept. 2001), 166--173.

[10]

Stephen J Chu. 2007. Range and mean distribution frequency of individual tooth width of the maxillary anterior dentition. Practical procedures & aesthetic dentistry 19, 4 (May 2007), 209--215.

[11]

Stephen J Chu and Saori Okubo. 2008. Range and mean discordance of individual tooth width of the mandibular anterior dentition. Practical procedures & aesthetic dentistry 20, 5 (June 2008), 313--320.

[12]

Ilya Digel, Inna Kern, Eva Maria Geenen, and Nuraly Akimbekov. 2020. Dental Plaque Removal by Ultrasonic Toothbrushes. Dentistry journal 8, 1 (March 2020), 28.

[13]

F J Fry and J E Barger. 1978. Acoustical properties of the human skull. The Journal of the Acoustical Society of America 63, 5 (May 1978), 1576--1590.

[14]

Christian Graetz, Jule Bielfeldt, Lars Wolff, Claudia Springer, Karim M Fawzy El-Sayed, Sonja SÃlzer, Sabah Badri-HÃ¶her, and Christof E DÃ¶rfer. 2013. Toothbrushing Education via a Smart Software Visualization System. Journal of Periodontology 84, 2 (Feb. 2013), 186--195.

[15]

Hayder Abdullah Hashim and Sarah AL-Ghamdi. 2005. Tooth width and arch dimensions in normal and malocclusion samples: an odontometric study. The journal of contemporary dental practice 6, 2 (May 2005), 36--51.

[16]

Faiez N Hattab and Elham SJ Abu Alhaija. 1999. Radiographic evaluation of mandibular third molar eruption space. Oral Surgery Oral Medicine Oral Pathology Oral Radiology and Endodontology 88, 3 (Sept. 1999), 285--291.

[17]

Hua Huang and Shan Lin. 2017. Poster Abstract: Toothbrushing Recognition using Neural Networks. In the internet of things. IEEE, 309--310.

[18]

Yongzhi Huang, Shaotian Cai, Lu Wang, and Kaishun Wu. 2018. Oinput: A Bone-Conductive QWERTY Keyboard Recognition for Wearable Device. In 2018 IEEE 24th International Conference on Parallel and Distributed Systems (ICPADS). 946--953. https://doi.org/10.1109/PADSW.2018.8644590

[19]

Kyeong-Seop Kim, Tae-Ho Yoon, Jeong-Whan Lee, and Dong-Jun Kim. 2009. Interactive toothbrushing education by a smart toothbrush system via 3D visualization. Computer Methods and Programs in Biomedicine 96, 2 (Nov. 2009), 125--132.

Digital Library

[20]

Kazuki Kobayashi and Tomoaki Ohtsuki. 2015. User Identification Based on Toothbrushing Information Using Three-Axis Accelerometer. In Adjunct Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2015 ACM International Symposium on Wearable Computers (Osaka, Japan) (UbiComp/ISWC'15 Adjunct). Association for Computing Machinery, New York, NY, USA, 129--132. https://doi.org/10.1145/2800835.2800889

Digital Library

[21]

Joseph Korpela, Ryosuke Miyaji, Takuya Maekawa, Kazunori Nozaki, and Hiroo Tamagawa. 2015. Evaluating Tooth Brushing Performance with Smartphone Sound Data. In Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing (Osaka, Japan) (UbiComp '15). Association for Computing Machinery, New York, NY, USA, 109--120. https://doi.org/10.1145/2750858.2804259

Digital Library

[22]

Young-Jae Lee, Pil-Jae Lee, Kyeong-Seop Kim, Wonse Park, Kee-Deog Kim, Dosik Hwang, and Jeong-Whan Lee. 2012. Toothbrushing Region Detection Using Three-Axis Accelerometer and Magnetic Sensor. IEEE Transactions on Biomedical Engineering 59, 3 (March 2012), 872--881.

[23]

Shu-Li Lin, Sheng-Yang Lee, Long-Yi Lee, Wen-Ta Chiu, Che-Tong Lin, and Haw-Ming Huang. 2006. Vibrational analysis of mandible trauma: experimental and numerical approaches. Medical & Biological Engineering & Computing 44, 9 (Aug. 2006), 785--792.

[24]

Li Lu, Jiadi Yu, Yingying Chen, Yanmin Zhu, Xiangyu Xu, Guangtao Xue, and Minglu Li. 2019. KeyListener: Inferring Keystrokes on QWERTY Keyboard of Touch Screen through Acoustic Signals. In IEEE INFOCOM 2019 - IEEE Conference on Computer Communications. 775--783. https://doi.org/10.1109/INFOCOM.2019.8737591

Digital Library

[25]

Chengwen Luo, Xingyu Feng, Junliang Chen, Jianqiang Li, Weitao Xu, Wei Li, Li Zhang, Zahir Tari, and Albert Y Zomaya. 2019. Brush like a Dentist: Accurate Monitoring of Toothbrushing via Wrist-Worn Gesture Sensing. In IEEE INFOCOM 2019 - IEEE Conference on Computer Communications. IEEE, 1234--1242.

Digital Library

[26]

G I McCracken, J Janssen, M Swan, N Steen, M De Jager, and P A Heasman. 2003. Effect of brushing force and time on plaque removal using a powered toothbrush. Journal of Clinical Periodontology 30, 5 (May 2003), 409--413.

[27]

Zhenchao Ouyang, Jingfeng Hu, Jianwei Niu, and Zhiping Qi. 2017. An asymmetrical acoustic field detection system for daily tooth brushing monitoring. In GLOBECOM 2017-2017 IEEE Global Communications Conference. IEEE, 1--6.

Digital Library

[28]

Samuel Pichardo, Vivian W Sin, and Kullervo Hynynen. 2011. Multi-frequency characterization of the speed of sound and attenuation coefficient for longitudinal transmission of freshly excised human skulls. Physics in Medicine and Biology 56, 1 (Jan. 2011), 219--250.

[29]

Jay Prakash, Zhijian Yang, Yu-Lin Wei, Haitham Hassanieh, and Romit Roy Choudhury. 2020. EarSense: earphones as a teeth activity sensor. In acm/ieee international conference on mobile computing and networking. ACM.

[30]

Constanza Marin de los RIOS, Francisco EmÃ-lio PUSTIGLIONI, and Giuseppe Alexandre ROMITO. 2002. Biometric study of the width, length and depth of the root trunk groove of human lower second molars. Pesquisa OdontolÃ3gica Brasileira 16, 1 (March 2002), 26--30.

[31]

VR Singh, Sanjay Yadav, and VP Adya. 1989. Role of natural frequency of bone as a guide for detection of bone fracture healing. Journal of biomedical engineering 11, 6 (1989), 457--461.

[32]

Yuki Tosaka, Kuniko Nakakura-Ohshima, Nozomi Murakami, Rikako Ishii, Issei Saitoh, Yoko Iwase, Akihiro Yoshihara, Akitsugu Ohuchi, and Haruaki Hayasaki. 2014. Analysis of tooth brushing cycles. Clinical Oral Investigations 18, 8 (Nov. 2014), 2045--2053.

[33]

DN White, GR Curry, and RJ Stevenson. 1978. The acoustic characteristics of the skull. Ultrasound in medicine & biology 4, 3 (1978), 225--252.

Cited By

Sahu NGupta SLone H(2024)Wearable Technology Insights: Unveiling Physiological Responses During Three Different Socially Anxious ActivitiesACM Journal on Computing and Sustainable Societies10.1145/36636712:2(1-23)Online publication date: 20-Jun-2024
https://dl.acm.org/doi/10.1145/3663671
Suzuki SAmesaka TWatanabe HShizuki BSugiura Y(2024)EarHover: Mid-Air Gesture Recognition for Hearables Using Sound Leakage SignalsProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676367(1-13)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676367
Wang JFeng YKumbhar GWang GYan QJin QFerrier RXiong JLi TOkoshi TKo JLiKamWa R(2024)SoilCares: Towards Low-cost Soil Macronutrients and Moisture Monitoring Using RF-VNIR SensingProceedings of the 22nd Annual International Conference on Mobile Systems, Applications and Services10.1145/3643832.3661868(196-209)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3643832.3661868
Show More Cited By

Index Terms

ToothFairy: Real-time Tooth-by-tooth Brushing Monitor Using Earphone Reversed Signals
1. Human-centered computing
  1. Ubiquitous and mobile computing
    1. Ubiquitous and mobile computing systems and tools

Recommendations

Interactive toothbrushing education by a smart toothbrush system via 3D visualization

The very first step for keeping good dental hygiene is to employ the correct toothbrushing style. Due to the possible occurrence of periodontal disease at an early age, it is critical to begin correct toothbrushing patterns as early as possible. With ...
CheerBrush: A Novel Interactive Augmented Reality Coaching System for Toothbrushing Skills in Children with Autism Spectrum Disorder
Autism Spectrum Disorder (ASD) is a common neurodevelopmental disorder that impacts one in every 54 children in the United States. Some children with ASD have learning and fine motor skill challenges that contribute to difficulties completing daily living ...
User identification based on toothbrushing information using three-axis accelerometer
UbiComp/ISWC'15 Adjunct: Adjunct Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2015 ACM International Symposium on Wearable Computers

In recent years, some researches reveal that there are relationships between cognitive disease and dental health. We expect a potential that a symptom of cognitive disease patients affects the way to brush his teeth. However, the relationship between ...

Comments

Information & Contributors

Information

Published In

cover image Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies

Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies Volume 7, Issue 4

December 2023

1613 pages

EISSN:2474-9567

DOI:10.1145/3640795

Issue’s Table of Contents

Copyright © 2024 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 12 January 2024

Published in IMWUT Volume 7, Issue 4

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed

Funding Sources

National Natural Science Foundation of China

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

11
Total Citations
View Citations
248
Total Downloads

Downloads (Last 12 months)248
Downloads (Last 6 weeks)25

Reflects downloads up to 26 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Sahu NGupta SLone H(2024)Wearable Technology Insights: Unveiling Physiological Responses During Three Different Socially Anxious ActivitiesACM Journal on Computing and Sustainable Societies10.1145/36636712:2(1-23)Online publication date: 20-Jun-2024
https://dl.acm.org/doi/10.1145/3663671
Suzuki SAmesaka TWatanabe HShizuki BSugiura Y(2024)EarHover: Mid-Air Gesture Recognition for Hearables Using Sound Leakage SignalsProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676367(1-13)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676367
Wang JFeng YKumbhar GWang GYan QJin QFerrier RXiong JLi TOkoshi TKo JLiKamWa R(2024)SoilCares: Towards Low-cost Soil Macronutrients and Moisture Monitoring Using RF-VNIR SensingProceedings of the 22nd Annual International Conference on Mobile Systems, Applications and Services10.1145/3643832.3661868(196-209)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3643832.3661868
Chang ZZhang FXiong JChen WZhang DGanesan DLane NShi W(2024)MSense: Boosting Wireless Sensing Capability Under Motion InterferenceProceedings of the 30th Annual International Conference on Mobile Computing and Networking10.1145/3636534.3649350(108-123)Online publication date: 29-May-2024
https://dl.acm.org/doi/10.1145/3636534.3649350
Zhang XZhang DXie YWu DLi YZhang D(2024)WaffleProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36314587:4(1-29)Online publication date: 12-Jan-2024
https://dl.acm.org/doi/10.1145/3631458
Zhang DZhang XXie YZhang FWang XLi YZhang D(2024)LoCalProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36314367:4(1-27)Online publication date: 12-Jan-2024
https://dl.acm.org/doi/10.1145/3631436
Yang YRen LChen CHu BZhang ZLi XShen YZhu KJi JZhang YNi YWu JWang QWu JSun LTao YWang G(2024)SnapInflatables: Designing Inflatables with Snap-through Instability for Responsive InteractionProceedings of the CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642933(1-15)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642933
Mäder AMeegahapola LGatica-Perez D(2024)Learning About Social Context From Smartphone Data: Generalization Across Countries and Daily Life MomentsProceedings of the CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642444(1-18)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642444
Hohman FKery MRen DMoritz D(2024)Model Compression in Practice: Lessons Learned from Practitioners Creating On-device Machine Learning ExperiencesProceedings of the CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642109(1-18)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642109
Arun ASaruwatari SShah SBharadia DEskicioglu RHuang PPatwari N(2023)XRLoc: Accurate UWB Localization to Realize XR DeploymentsProceedings of the 21st ACM Conference on Embedded Networked Sensor Systems10.1145/3625687.3625810(459-473)Online publication date: 12-Nov-2023
https://dl.acm.org/doi/10.1145/3625687.3625810
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents