skip to main content
research-article

Visual Noise Cancellation: Exploring Visual Discomfort and Opportunities for Vision Augmentations

Published: 29 January 2024 Publication History

Abstract

Acoustic noise control or cancellation (ANC) is a commonplace component of modern audio headphones. ANC aims to actively mitigate disturbing environmental noise for a quieter and improved listening experience. ANC is digitally controlling frequency and amplitude characteristics of sound. Much less explored is visual noise and active visual noise control, which we address here. We first explore visual noise and scenarios in which visual noise arises based on findings from four workshops we conducted. We then introduce the concept of visual noise cancellation (VNC) and how it can be used to reduce identified effects of visual noise. In addition, we developed head-worn demonstration prototypes to practically explore the concept of active VNC with selected scenarios in a user study. Finally, we discuss the application of VNC, including vision augmentations that moderate the user’s view of the environment to address perceptual needs and to provide augmented reality content.

References

[1]
James Auger. 2013. Speculative design: Crafting the speculation. Digital Creativity 24, 1 (2013), 11–35.
[2]
Mathias Basner, Wolfgang Babisch, Adrian Davis, Mark Brink, Charlotte Clark, Sabine Janssen, and Stephen Stansfeld. 2014. Auditory and non-auditory effects of noise on health. The Lancet 383, 9925 (2014), 1325–1332.
[3]
Manfred E. Beutel, Elmar Brähler, Mareike Ernst, Eva Klein, Iris Reiner, Jörg Wiltink, Matthias Michal, Philipp S. Wild, Andreas Schulz, Thomas Münzel, Omar Hahad, Jochem König, Karl J. Lackner, Norbert Pfeiffer, and Ana N. Tibubos. 2020. Noise annoyance predicts symptoms of depression, anxiety and sleep disturbance 5 years later. Findings from the Gutenberg Health Study. European Journal of Public Health 30, 3 (2020), 487–492.
[4]
LouAnne Boyd, Vincent Berardi, Deanna Hughes, Franceli Cibrian, Jazette Johnson, Viseth Sean, Eliza DelPizzo-Cheng, Brandon Mackin, Ayra Tusneem, Riya Mody, Sara Jones, and Karen Lotich. 2022. Manipulating image luminance to improve eye gaze and verbal behavior in autistic children. Humanities and Social Sciences Communications 9, 1 (2022), 1–9.
[5]
LouAnne E. Boyd, Jazette Johnson, Franceli Cibrian, Deanna Hughes, Eliza Delpizzo-Cheng, Karen Lotich, Sara Jones, Hollis Pass, Viseth Sean, and Gillian Hayes. 2023. Global filter: Augmenting images to support seeing the “Big picture” for people with local interference. ACM Transactions on Computer-Human Interaction 30, 3 (2023), 1–28.
[6]
Nick Broner. 1978. The effects of low frequency noise on people—a review. Journal of Sound and Vibration 58, 4 (1978), 483–500.
[7]
Marisa Carrasco, Brian McElree, Kristina Denisova, and Anna Marie Giordano. 2003. Speed of visual processing increases with eccentricity. Nature Neuroscience 6, 7 (2003), 699–700.
[8]
Yi Fei Cheng, Hang Yin, Yukang Yan, Jan Gugenheimer, and David Lindlbauer. 2022. Towards understanding diminished reality. In Proceedings of the CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, 1–16.
[9]
Simran Chopra, Rachel E. Clarke, Adrian K. Clear, Sara Heitlinger, Ozge Dilaver, and Christina Vasiliou. 2022. Negotiating sustainable futures in communities through participatory speculative design and experiments in living. In Proceedings of the CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, 1–17.
[10]
Janice Chung. 2007. Noise-Induced Hearing Loss in Audio-Related Professionals. University of Southern California, Los Angeles.
[11]
Sonja Di Blasio, Louena Shtrepi, Giuseppina Emma Puglisi, and Arianna Astolfi. 2019. A cross-sectional survey on the impact of irrelevant speech noise on annoyance, mental health and well-being, performance and occupants’ behavior in shared and open-plan offices. International Journal of Environmental Research and Public Health 16, 2 (2019), 280.
[12]
E. Bruce Goldstein and Laura Cacciamani. 2021. Sensation and Perception. Cengage Learning, Washington, WA.
[13]
Kamakshi V. Gopal, Liana E. Mills, Bryce S. Phillips, and Rajesh Nandy. 2019. Risk assessment of recreational noise–induced hearing loss from exposure through a personal audio system—iPod touch. Journal of the American Academy of Audiology 30, 07 (2019), 619–633.
[14]
Graham F. A. Harding and Peter M. Jeavons. 1994. Photosensitive Epilepsy. Cambridge University Press, Chichester.
[15]
Yuichi Hiroi, Takumi Kaminokado, Atsushi Mori, and Yuta Itoh. 2020. Dehazeglasses: Optical dehazing with an occlusion capable see-through display. In Proceedings of the Augmented Humans International Conference. ACM, New York, NY, 1–11.
[16]
Xiaodan Hu, Yan Zhang, Naoya Isoyama, Nobuchika Sakata, and Kiyoshi Kiyokawa. 2021. Design and prototyping of computational sunglasses for autism spectrum disorders. In Proceedings of the 2021 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops. IEEE, 581–582. DOI:
[17]
Xiaodan Hu, Yan Zhang, Hideaki Uchiyama, Naoya Isoyama, Nobuchika Sakata, and Kiyoshi Kiyokawa. 2023. Smart dimming sunglasses for photophobia using spatial light modulator. Displays (2023), 102611.
[18]
Yuta Itoh, Tobias Langlotz, Daisuke Iwai, Kiyoshi Kiyokawa, and Toshiyuki Amano. 2019. Light attenuation display: Subtractive see-through near-eye display via spatial color filtering. IEEE Transactions on Visualization and Computer Graphics 25, 5 (2019), 1951–1960.
[19]
Yuta Itoh, Tobias Langlotz, Jonathan Sutton, and Alexander Plopski. 2021. Towards indistinguishable augmented reality: A survey on optical see-through head-mounted displays. ACM Computing Surveys 54, 6 (2021), 1–36.
[20]
Qiao Jin, Yu Liu, Svetlana Yarosh, Bo Han, and Feng Qian. 2022. How will VR enter university classrooms? Multi-stakeholders investigation of VR in higher education. In Proceedings of the CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, 1–17.
[21]
Igor Juricevic, Leah Land, Arnold Wilkins, and Michael A. Webster. 2010. Visual discomfort and natural image statistics. Perception 39, 7 (2010), 884–899.
[22]
Tuomas Kari, Markus Makkonen, and Lauri Frank. 2017. The effect of using noise cancellation earplugs in open-plan offices on the offices on the work well-being and work performance of software professionals. In Proceedings of the Mediterranean Conference on Information Systems. Association For Information Systems.
[23]
Maria Klatte, Kirstin Bergström, and Thomas Lachmann. 2013. Does noise affect learning? A short review on noise effects on cognitive performance in children. Frontiers in Psychology 4 (2013), 578.
[24]
Marion Koelle, Matthias Kranz, and Andreas Möller. 2015. Don’t look at me that way! Understanding user attitudes towards data glasses usage. In Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services. ACM, 362–372.
[25]
Masaki Koshi, Nobuchika Sakata, and Kiyoshi Kiyokawa. 2019. Augmented concentration: Concentration improvement by visual noise reduction with a video see-through HMD. In Proceedings of the 2019 IEEE Conference on Virtual Reality and 3D User Interfaces. IEEE, 1030–1031. DOI:
[26]
Richard A. Krueger. 2014. Focus Groups: A Practical Guide for Applied Research. Sage publications, London.
[27]
Karl D. Kryter. 2013. The Effects of Noise on Man. Elsevier, Amsterdam.
[28]
Timo Kunkel and Erik Reinhard. 2010. A reassessment of the simultaneous dynamic range of the human visual system. In Proceedings of the 7th Symposium on Applied Perception in Graphics and Visualization. ACM, New York, NY, 17–24.
[29]
Sen M. Kuo and Dennis R. Morgan. 1999. Active noise control: A tutorial review. Proceedings of the IEEE 87, 6 (1999), 943–973.
[30]
Xingyu Lan, Yanqiu Wu, Yang Shi, Qing Chen, and Nan Cao. 2022. Negative Emotions, Positive Outcomes? Exploring the Communication of Negativity in Serious Data Stories. In Proceedings of the CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, 1–14.
[31]
Tobias Langlotz, Jonathan Sutton, Stefanie Zollmann, Yuta Itoh, and Holger Regenbrecht. 2018. Chromaglasses: Computational glasses for compensating colour blindness. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, 1–12.
[32]
Kai-En Lin, Kuang-Tsu Shih, and Homer Chen. 2017. Enhancing the perception of a hazy visual world using a see-through head-mounted device. In Proceedings of the 2017 IEEE International Conference on Image Processing. IEEE, 4397–4401.
[33]
Weiquan Lu, Been-Lirn Henry Duh, and Steven Feiner. 2012. Subtle cueing for visual search in augmented reality. In Proceedings of the 2012 IEEE International Symposium on Mixed and Augmented Reality. IEEE, 161–166.
[34]
Norman H. Mackworth. 1965. Visual noise causes tunnel vision. Psychonomic Science 3, 1 (1965), 67–68.
[35]
Natalia D. Mankowska, Malgorzata Grzywinska, Pawel J. Winklewski, and Anna B. Marcinkowska. 2022. Neuropsychological and neurophysiological mechanisms behind flickering light stimulus processing. Biology 11, 12 (November2022), 1720. DOI:
[36]
Thomas Markussen and Eva Knutz. 2013. The poetics of design fiction. In Proceedings of the 6th International Conference on Designing Pleasurable Products and Interfaces. ACM, 231–240.
[37]
Nursabillilah Mohd Ali, Nahrul Khair Alang Md Rashid, and Yasir Mohd Mustafah. 2013. Performance comparison between RGB and HSV color segmentations for road signs detection. Applied Mechanics and Materials 393 (2013), 550–555.
[38]
Brett R. C. Molesworth, Marion Burgess, Belinda Gunnell, Diana Löffler, and Antje Venjakob. 2014. The effect on recognition memory of noise cancelling headphones in a noisy environment with native and nonnative speakers. Noise and Health 16, 71 (2014), 240.
[39]
Brett R. C. Molesworth, Marion Burgess, and Sandra Koh. 2017. The relationship between noise and mode of delivery on recognition memory and working memory. Applied Acoustics 116 (2017), 329–336.
[40]
Brett R. C. Molesworth, Marion Burgess, and Chloe Wilcock. 2018. Comparison of the effects on memory tasks of babble and broadband noise. Acoustics Australia 46, 2 (2018), 205–214.
[41]
David L. Morgan. 1996. Focus Groups as Qualitative Research. Vol. 16. Sage Publications, London.
[42]
Shohei Mori, Sei Ikeda, and Hideo Saito. 2017. A survey of diminished reality: Techniques for visually concealing, eliminating, and seeing through real objects. IPSJ Transactions on Computer Vision and Applications 9, 1 (2017), 1–14.
[43]
Benjamin Johannes Müller, Andreas Liebl, and Noemi Martin. 2019. Influence of Active-noise-cancelling Headphones on Cognitive Performance and Employee Satisfaction in Open Space Offices. Universitätsbibliothek der RWTH Aachen, Aachen.
[44]
Robert L. Myers. 2002. Display Interfaces:Fundamentals and Standards. John Wiley & Sons, Chichester.
[45]
Rodrigo Noseda, David Copenhagen, and Rami Burstein. 2019. Current understanding of photophobia, visual networks and headaches. Cephalalgia 39, 13 (2019), 1623–1634.
[46]
Bruce Nussbaum. 2004. The power of design. Business Week 17, 5 (2004), 2004.
[47]
Louise O’Hare and Paul B. Hibbard. 2013. Visual discomfort and blur. Journal of Vision 13, 5 (2013), 7–7.
[48]
Jonny D. Owen and Mark J. G. Dunn. 2019. Active noise cancelling headphones with white noise to aid sleep in non-ventilated, non-delirious critical care patients: A randomised crossover trial. British Journal of Anaesthesia 123, 4 (2019), e503.
[49]
Soomi Park, Patrick G. T. Healey, and Antonios Kaniadakis. 2021. Should robots blush?. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, Article 717, 14 pages. DOI:
[50]
J. A. Quirk, D. R. Fish, S. J. M. Smith, J. W. A. S. Sander, S. D. Shorvon, and P. J. Allen. 1995. Incidence of photosensitive epilepsy: A prospective national study. Electroencephalography and Clinical Neurophysiology 95, 4 (1995), 260–267.
[51]
H. Regenbrecht, S. Zwanenburg, and T. Langlotz. 2022. Pervasive augmented reality - Technology and ethics. IEEE Pervasive Computing 21, 3 (2022), 84–91. DOI:
[52]
Michael Rietzler, Katrin Plaumann, Taras Kränzle, Marcel Erath, Alexander Stahl, and Enrico Rukzio. 2017. VaiR: Simulating 3D Airflows in virtual reality. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, 5669–5677.
[53]
Manjul Singh Sachan and Roshan L. Peiris. 2022. Designing augmented reality based interventions to encourage physical activity during virtual classes. In Proceedings of the CHI Conference on Human Factors in Computing Systems Extended Abstracts. ACM, New York, NY, 1–6.
[54]
Nobuchika Sakata. 2022. Visual noise-canceling HMD: Toward reduced reality. Information Display 38, 5 (2022), 12–17.
[55]
Kristian T. Simsarian. 2003. Take it to the next stage: The roles of role playing in the design process. In Proceedings of the CHI’03 Extended Abstracts on Human Factors in Computing Systems. ACM, 1012–1013.
[56]
Stephen A. Stansfeld and Mark P. Matheson. 2003. Noise pollution: Non-auditory effects on health. British Medical Bulletin 68, 1 (2003), 243–257.
[57]
Jonathan Sutton, Tobias Langlotz, and Yuta Itoh. 2019. Computational glasses: Vision augmentations using computational near-eye optics and displays. In Proceedings of the 2019 IEEE International Symposium on Mixed and Augmented Reality Adjunct. IEEE, 438–442.
[58]
Jonathan Sutton, Tobias Langlotz, and Alexander Plopski. 2022. Seeing colours: Addressing colour vision deficiency with vision augmentations using computational glasses. ACM Transactions on Computer-Human Interaction 29, 3 (2022), 1–53.
[59]
Jonathan Sutton, Tobias Langlotz, Alexander Plopski, Stefanie Zollmann, Yuta Itoh, and Holger Regenbrecht. 2022. Look over there! Investigating saliency modulation for visual guidance with augmented reality glasses. In Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology. ACM, New York, NY.
[60]
Robert I. Sutton and Andrew Hargadon. 1996. Brainstorming groups in context: Effectiveness in a product design firm. Administrative Science Quarterly 41, 4 (1996), 685–718.
[61]
Nikki Theofanopoulou and Petr Slovak. 2022. Exploring technology-mediated parental socialisation of emotion: Leveraging an embodied, in-situ intervention for child emotion regulation. In Proceedings of the CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, 1–16.
[62]
Anne M. Treisman and Garry Gelade. 1980. A feature-integration theory of attention. Cognitive Psychology 12, 1 (1980), 97–136.
[63]
Wen-Jie Tseng, Elise Bonnail, Mark McGill, Mohamed Khamis, Eric Lecolinet, Samuel Huron, and Jan Gugenheimer. 2022. The dark side of perceptual manipulations in virtual reality. In Proceedings of the CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, 1–15.
[64]
Eduardo E. Veas, Erick Mendez, Steven K. Feiner, and Dieter Schmalstieg. 2011. Directing attention and influencing memory with visual saliency modulation. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 1471–1480.
[65]
Gordon Wetzstein, Wolfgang Heidrich, and David Luebke. 2010. Optical image processing using light modulation displays. In Computer Graphics Forum. Vol. 29. Wiley Online Library, Hoboken, New Jersey, 1934–1944.
[66]
Arnold J. Wilkins. 1995. Visual Stress. Vol. 24. OUP Oxford, Oxford.
[67]
Arnold J. Wilkins, Ian Nimmo-Smith, Anthony I. Slater, and Lou Bedocs. 1989. Fluorescent lighting, headaches and eyestrain. Lighting Research & Technology 21, 1 (1989), 11–18.
[68]
Michael D. Wolcott, Jacqueline E. McLaughlin, Devin K. Hubbard, Traci R. Rider, and Kelly Umstead. 2021. Twelve tips to stimulate creative problem-solving with design thinking. Medical Teacher 43, 5 (2021), 501–508.
[69]
Qing Zhang. 2022. Programmable peripheral vision: Augment/reshape human visual perception. In Proceedings of the Extended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, Article 63, 5 pages. DOI:
[70]
Yuhang Zhao, Sarit Szpiro, and Shiri Azenkot. 2015. Foresee: A customizable head-mounted vision enhancement system for people with low vision. In Proceedings of the 17th International ACM SIGACCESS Conference on Computers & Accessibility. ACM, 239–249.
[71]
Yuhang Zhao, Sarit Szpiro, Jonathan Knighten, and Shiri Azenkot. 2016. CueSee: Exploring visual cues for people with low vision to facilitate a visual search task. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing. ACM, 73–84.
[72]
Yuhang Zhao, Sarit Szpiro, Jonathan Knighten, and Shiri Azenkot. 2016. CueSee: Exploring visual cues for people with low vision to facilitate a visual search task. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing. ACM, New York, NY, 73–84. DOI:

Cited By

View all
  • (2024)Vision-Based Assistive Technologies for People with Cerebral Visual Impairment: A Review and Focus StudyProceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3663548.3675637(1-20)Online publication date: 27-Oct-2024
  • (2024)Exploring Visual Discomfort and Opportunities for Vision Augmentations: Visual Noise Cancellation and Head-worn LCD Light Actuators for Perception ModulationAdjunct Proceedings of the 26th International Conference on Mobile Human-Computer Interaction10.1145/3640471.3686642(1-3)Online publication date: 21-Sep-2024
  • (2024)Broadening Our View: Assistive Technology for Cerebral Visual ImpairmentExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3650740(1-9)Online publication date: 11-May-2024
  • Show More Cited By

Index Terms

  1. Visual Noise Cancellation: Exploring Visual Discomfort and Opportunities for Vision Augmentations

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Transactions on Computer-Human Interaction
      ACM Transactions on Computer-Human Interaction  Volume 31, Issue 2
      April 2024
      576 pages
      EISSN:1557-7325
      DOI:10.1145/3613620
      Issue’s Table of Contents

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 29 January 2024
      Online AM: 06 December 2023
      Accepted: 29 September 2023
      Revised: 09 August 2023
      Received: 27 March 2023
      Published in TOCHI Volume 31, Issue 2

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. Visual noise cancellation
      2. Augmented Human
      3. perception
      4. Augmented Reality
      5. vision augmentation
      6. XR
      7. visual discomfort

      Qualifiers

      • Research-article

      Funding Sources

      • Marsden Fund Council from Government
      • Royal Society of NZ

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)708
      • Downloads (Last 6 weeks)56
      Reflects downloads up to 23 Dec 2024

      Other Metrics

      Citations

      Cited By

      View all
      • (2024)Vision-Based Assistive Technologies for People with Cerebral Visual Impairment: A Review and Focus StudyProceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3663548.3675637(1-20)Online publication date: 27-Oct-2024
      • (2024)Exploring Visual Discomfort and Opportunities for Vision Augmentations: Visual Noise Cancellation and Head-worn LCD Light Actuators for Perception ModulationAdjunct Proceedings of the 26th International Conference on Mobile Human-Computer Interaction10.1145/3640471.3686642(1-3)Online publication date: 21-Sep-2024
      • (2024)Broadening Our View: Assistive Technology for Cerebral Visual ImpairmentExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3650740(1-9)Online publication date: 11-May-2024
      • (2024)A Design Space for Vision Augmentations and Augmented Human Perception using Digital EyewearProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642380(1-16)Online publication date: 11-May-2024
      • (2024)Flicker Augmentations: Rapid Brightness Modulation for Real-World Visual Guidance using Augmented RealityProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642085(1-19)Online publication date: 11-May-2024

      View Options

      Login options

      Full Access

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Full Text

      View this article in Full Text.

      Full Text

      Media

      Figures

      Other

      Tables

      Share

      Share

      Share this Publication link

      Share on social media