poster

Augmented Reality Magnification for Low Vision Users with the Microsoft Hololens and a Finger-Worn Camera

Authors:

Jon E. FroehlichAuthors Info & Claims

ASSETS '17: Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility

Pages 361 - 362

https://doi.org/10.1145/3132525.3134812

Published: 19 October 2017 Publication History

Get Access

Abstract

Recent technical advances have enabled new wearable augmented reality (AR) solutions that can aid people with visual impairments (VI) in their everyday lives. Here, we investigate an AR-based magnification solution that combines a small finger-worn camera with a transparent augmented reality display (the Microsoft Hololens). The image from the camera is processed and projected on the Hololens to magnify visible content below the user's finger such as text and images. Our approach offers: (i) a close-up camera view (similar to a CCTV system) with the portability and processing power of a smartphone magnifier app, (ii) access to content through direct touch, and (iii) flexible placement of the magnified image within the wearer's field of view. We present three proof-of-concept interfaces and plans for a user evaluation.

References

[1]

Apple. iOS Accessibility Features: https://www.apple.com/ accessibility/iphone/vision/.

Google Scholar

[2]

American Foundation for the Blind. CCTVs/Video Magnifiers: http://www.afb.org/prodBrowseCatResults.aspx?CatID=53.

Google Scholar

[3]

eSight Glasses: https://www.esighteyewear.com/technology. {4} Google Glass: https://www.google.com/glass/start/.

Google Scholar

[4]

Microsoft Hololens: https://www.microsoft.com/hololens.

Google Scholar

[5]

Shilkrot, R., Huber, J., Wong, M.E., Maes, P. and Nanayakkara, S. 2015. FingerReader: a wearable device to explore printed text on the go. Proc. CHI 2015, 2363-2372.

Digital Library

Google Scholar

[6]

Stearns, L., Du, R., Oh, U., Jou, C., Findlater, L., Ross, D.A. and Froehlich, J.E. 2016. Evaluating Haptic and Auditory Directional Guidance to Assist Blind People in Reading Printed Text Using Finger-Mounted Cameras. TACCESS. 9, 1 (Oct. 2016), 1-38.

Digital Library

Google Scholar

[7]

Zhao, Y., Szpiro, S. and Azenkot, S. 2015. ForeSee: A Customizable Head-Mounted Vision Enhancement System for People with Low Vision. Proc. ASSETS 2015, 239-249.

Digital Library

Google Scholar

Cited By

View all

Goddard PVerdezoto NMargrain TLai YEslambolchilar P(2024)Seeing Art Differently: Design Considerations to Improve Visual Art Engagement for People with Low VisionProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3660675(2820-2832)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3660675
Sipatchin AGarcía García MSauer YWahl S(2022)Application of Spatial Cues and Optical Distortions as Augmentations during Virtual Reality (VR) Gaming: The Multifaceted Effects of Assistance for Eccentric Viewing TrainingInternational Journal of Environmental Research and Public Health10.3390/ijerph1915957119:15(9571)Online publication date: 4-Aug-2022
https://doi.org/10.3390/ijerph19159571

Index Terms

Augmented Reality Magnification for Low Vision Users with the Microsoft Hololens and a Finger-Worn Camera
1. Human-centered computing
  1. Accessibility
    1. Accessibility technologies
  2. Human computer interaction (HCI)
    1. Interaction paradigms
      1. Mixed / augmented reality

Recommendations

Design of an Augmented Reality Magnification Aid for Low Vision Users
ASSETS '18: Proceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility

Augmented reality (AR) systems that enhance visual capabilities could make text and other fine details more accessible for low vision users, improving independence and quality of life. Prior work has begun to investigate the potential of assistive AR, ...
Simulator Sickness in Augmented Reality Training Using the Microsoft HoloLens
CHI '18: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems

Augmented Reality is on the rise with consumer-grade smart glasses becoming available in recent years. Those interested in deploying these head-mounted displays need to understand better the effect technology has on the end user. One key aspect ...
Augmented reality based virtual keyboards for assistive technology
i-CREATe '12: Proceedings of the 6th International Conference on Rehabilitation Engineering & Assistive Technology

This paper presents a novel virtual interface system based on augmented reality (AR) techniques. The ARVKs (augmented reality based virtual keyboards) that have been developed based on this virtual interface system can accomplish user inputs with slight ...

Comments

Information & Contributors

Information

Published In

ASSETS '17: Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility

October 2017

450 pages

ISBN:9781450349260

DOI:10.1145/3132525

General Chair:
Amy Hurst
University of Maryland, Baltimore County, USA
,
Program Chairs:
Leah Findlater
University of Washington, USA
,
Meredith Ringel Morris
Microsoft Research, USA

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 19 October 2017

Check for updates

Author Tags

Qualifiers

Poster

Funding Sources

Office of the Assistant Secretary of Defense for Health Affairs

Conference

ASSETS '17

Sponsor:

SIGACCESS

ASSETS '17: The 19th International ACM SIGACCESS Conference on Computers and Accessibility

October 20 - November 1, 2017

Maryland, Baltimore, USA

Acceptance Rates

ASSETS '17 Paper Acceptance Rate 28 of 126 submissions, 22%;

Overall Acceptance Rate 436 of 1,556 submissions, 28%

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
640
Total Downloads

Downloads (Last 12 months)49
Downloads (Last 6 weeks)5

Reflects downloads up to 14 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Goddard PVerdezoto NMargrain TLai YEslambolchilar P(2024)Seeing Art Differently: Design Considerations to Improve Visual Art Engagement for People with Low VisionProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3660675(2820-2832)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3660675
Sipatchin AGarcía García MSauer YWahl S(2022)Application of Spatial Cues and Optical Distortions as Augmentations during Virtual Reality (VR) Gaming: The Multifaceted Effects of Assistance for Eccentric Viewing TrainingInternational Journal of Environmental Research and Public Health10.3390/ijerph1915957119:15(9571)Online publication date: 4-Aug-2022
https://doi.org/10.3390/ijerph19159571

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Design of an Augmented Reality Magnification Aid for Low Vision Users

Simulator Sickness in Augmented Reality Training Using the Microsoft HoloLens

Augmented reality based virtual keyboards for assistive technology