poster

Automated Person Detection in Dynamic Scenes to Assist People with Vision Impairments: An Initial Investigation

Authors:

Anja ThiemeAuthors Info & Claims

ASSETS '18: Proceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility

Pages 391 - 394

https://doi.org/10.1145/3234695.3241017

Published: 08 October 2018 Publication History

Abstract

We propose a computer vision system that can automatically detect people in dynamic real-world scenes, enabling people with vision impairments to have more awareness of, and interactions with, other people in their surroundings. As an initial step, we investigate the feasibility of four camera systems that vary in their placement, field-of-view, and image distortion for: (i) capturing people generally; and (ii) detecting people via a specific person-pose estimator. Based on our findings, we discuss future opportunities and challenges for detecting people in dynamic scenes, and for communicating that information to visually impaired users.

References

[1]

Tousif Ahmed, Roberto Hoyle, Kay Connelly, David Crandall, and Apu Kapadia. 2015. Privacy Concerns and Behaviors of People with Visual Impairments. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, 3523--3532.

Digital Library

[2]

Jan Balata, Zdenek Mikovec, and Lukas Neoproud. 2015. BlindCamera: Central and Golden-ratio Composition for Blind Photographers. In Proceedings of the Mulitimedia, Interaction, Design and Innnovation (MIDI '15). ACM, Article 8, 8 pages.

Digital Library

[3]

Cynthia L. Bennett, Jane E, Martez E. Mott, Edward Cutrell, and Meredith Ringel Morris. 2018. How Teens with Visual Impairments Take, Edit, and Share Photos on Social Media. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, Paper 76, 12 pages.

Digital Library

[4]

Jeffrey P. Bigham, Chandrika Jayant, Hanjie Ji, Greg Little, Andrew Miller, Robert C. Miller, Robin Miller, Aubrey Tatarowicz, Brandyn White, Samual White, and Tom Yeh. 2010. VizWiz: nearly real-time answers to visual questions. In Proceedings of the 23nd annual ACM symposium on User interface software and technology (UIST '10). ACM, 333--342.

Digital Library

[5]

Stacy M. Branham and Shaun K. Kane. 2015. Collaborative Accessibility: How Blind and Sighted Companions Co-Create Accessible Home Spaces. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15), 2373--2382.

Digital Library

[6]

Stacy M. Branham and Shaun K. Kane. 2015. The Invisible Work of Accessibility: How Blind Employees Manage Accessibility in Mixed-Ability Workplaces. In Proceedings of the 17th International ACM SIGACCESS Conference on Computers & Accessibility (ASSETS '15), 163--171.

Digital Library

[7]

Stacy M. Branham, et al. 2017. "Is Someone There? Do They Have a Gun": How Visual Information about Others Can Improve Personal Safety Management for Blind Individuals. Proc. ASSETS 2017. ACM, 260--269.

Digital Library

[8]

J.M. Hans du Buf, João Barroso, João M.F. Rodrigues, Hugo Paredes, Miguel Farrajota, Hugo Fernandes, João José, Victor Teixeira, and Mário Saleiro. 2011. The SmartVision Navigation Prototype for Blind Users. International Journal of Digital Content Technology and its Applications 5(5), 351--361. http://hdl.handle.net/10400.1/893

[9]

Michele A. Burton, Erin Brady, Robin Brewer, Callie Neylan, Jeffrey P. Bigham, and Amy Hurst. 2012. Crowdsourcing subjective fashion advice using VizWiz: challenges and opportunities. In Proceedings of the 14th international ACM SIGACCESS conference on Computers and accessibility (ASSETS '12). ACM, 135--142.

Digital Library

[10]

Verena R. Cimarolli, Kathrin Boerner, Mark Brennan-Ing, Joann P. Reinhardt, and Amy Horowitz 2012. Challenges faced by older adults with vision loss: a qualitative study with implications for rehabilitation. Clinical rehabilitation, 26(8), pp.748--757.

[11]

Anind K. Dey. Context-Aware Computing. In Ubiquitous Computing Fundamentals 2016, Chapman and Hall/CRC, pp. 335--366.

[12]

Zhe Cao, Tomas Simon, Shih-En Wei, and Yaser Sheikh. 2016. Realtime multi-person 2d pose estimation using part affinity fields. arXiv preprint arXiv:1611.08050. https://arxiv.org/abs/1611.08050

[13]

Xiangrong Chen and Alan L. Yuille. 2004. Detecting and reading text in natural scenes. In IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004. vol. 2.

Digital Library

[14]

William Easley, Michele A. Williams, Ali Abdolrahmani, Caroline Galbraith, Stacy M. Branham, Amy Hurst, and Shaun K. Kane. 2016. Let's Get Lost: Exploring Social Norms in Predominately Blind Environments. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA '16). ACM, 2034--2040.

Digital Library

[15]

Andreas Ess, Bastian Leibe, Konrad Schindler, and Luc Van Gool. A mobile vision system for robust multi-person tracking. In IEEE Conference on Computer Vision and Pattern Recognition, 2008. CVPR 2008, IEEE, 1--8.

[16]

FITT360. The First 360° Neckband Wearable Camera. Unobtrusive and effortless way to capture and share your moments in 360° true First-Person-View. Last retrieved 15th of June 2018, from https://www.kickstarter.com/projects/467094941/fitt360-the-first-360-neckband-wearable-camera

[17]

Luis A. Guerrero, Francisco Vasquez, and Sergio F. Ochoa. 2012. An indoor navigation system for the visually impaired. Sensors 12, no. 6 (2012): 8236--8258.

[18]

Chandrika Jayant, Hanjie Ji, Samuel White, and Jeffrey P. Bigham. 2011. Supporting blind photography. In The proceedings of the 13th international ACM SIGACCESS conference on Computers and accessibility (ASSETS '11). ACM, 203--210.

Digital Library

[19]

Hernisa Kacorri, Kris M. Kitani, Jeffrey P. Bigham, and Chieko Asakawa. 2017. People with Visual Impairment Training Personal Object Recognizers: Feasibility and Challenges. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, 5839--5849.

Digital Library

[20]

David McGookin, Stephen Brewster, and WeiWei Jiang. 2008. Investigating touchscreen accessibility for people with visual impairments. Proc. NordiCHI 2008. ACM, 298--307.

Digital Library

[21]

Mikel Rodriguez, Josef Sivic, and Ivan Laptev. 2017. The Analysis of High Density Crowds in Videos. In Group and Crowd Behavior for Computer Vision, 2017, 89--113.

[22]

Seeing AI. Talking Camera for the Blind. Last retrieved 15th June 2018, from https://www.microsoft.com/en-us/seeing-ai/

[23]

Sarit Felicia Anais Szpiro, Shafeka Hashash, Yuhang Zhao, and Shiri Azenkot. 2016. How People with Low Vision Access Computing Devices: Understanding Challenges and Opportunities. In Proceedings of the 18th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '16), 171--180.

Digital Library

[24]

Anja Thieme, Cynthia L. Bennett, Cecily Morrison, Edward Cutrell, and Alex S. Taylor. 2018. "I can do everything but see!" -- How people with Vision Impairments Negotiate their Abilities in Social Contexts. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, Paper 203, 14 pages.

Digital Library

[25]

Marynel Vázquez and Aaron Steinfeld. 2012. Helping visually impaired users properly aim a camera. In Proceedings of the 14th international ACM SIGACCESS conference on Computers and accessibility (ASSETS '12). ACM, 95--102.

Digital Library

[26]

Michele A. Williams, Amy Hurst, and Shaun K. Kane. 2013. "Pray before you step out": describing personal and situational blind navigation behaviors. In Proceedings of the 15th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '13). ACM, Article 28, 8 pages.

Digital Library

[27]

Shaomei Wu, Jeffrey Wieland, Omid Farivar, and Julie Schiller. 2017. Automatic Alt-text: Computer-generated Image Descriptions for Blind Users on a Social Network Service. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing (CSCW '17). ACM, 1180--1192.

Digital Library

[28]

Yuhang Zhao, Shaomei Wu, Lindsay Reynolds, and Shiri Azenkot. 2018. A Face Recognition Application for People with Visual Impairments: Understanding Use Beyond the Lab. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, Paper 215, 14 pages.

Digital Library

[29]

Kristen Shinohara and Jacob O. Wobbrock. 2016. Self-Conscious or Self-Confident? A Diary Study Conceptualizing the Social Accessibility of Assistive Technology. ACM Trans. Access. Comput. 8, 2, Article 5, 31 pages.

Digital Library

[30]

Annuska Zolyomi, Anushree Shukla, and Jaime Snyder. 2016. Social Dimensions of Technology-Mediated Sight. In Proceedings of the 18th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '16). ACM, 299--300.

Digital Library

Cited By

Teng YCourtien CRios DTseng YGibson JAziz MReyna AVaish RSmith B(2024)Help Supporters: Exploring the Design Space of Assistive Technologies to Support Face-to-Face Help Between Blind and Sighted StrangersProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642816(1-24)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642816
Kameswaran VY VMarathe M(2023)Advocacy as Access Work: How People with Visual Impairments Gain Access to Digital Banking in IndiaProceedings of the ACM on Human-Computer Interaction10.1145/35795967:CSCW1(1-23)Online publication date: 16-Apr-2023
https://dl.acm.org/doi/10.1145/3579596
Akter TAhmed TKapadia ASwaminathan M(2022)Shared Privacy Concerns of the Visually Impaired and Sighted Bystanders with Camera-Based Assistive TechnologiesACM Transactions on Accessible Computing10.1145/350685715:2(1-33)Online publication date: 19-May-2022
https://dl.acm.org/doi/10.1145/3506857
Show More Cited By

Index Terms

Automated Person Detection in Dynamic Scenes to Assist People with Vision Impairments: An Initial Investigation
1. Human-centered computing
  1. Accessibility
    1. Accessibility technologies

Recommendations

"I can do everything but see!" -- How People with Vision Impairments Negotiate their Abilities in Social Contexts
CHI '18: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems

This research takes an orientation to visual impairment (VI) that does not regard it as fixed or determined alone in or through the body. Instead, we consider (dis)ability as produced through interactions with the environment and configured by the ...
Understanding Audio Production Practices of People with Vision Impairments
ASSETS '20: Proceedings of the 22nd International ACM SIGACCESS Conference on Computers and Accessibility

The advent of digital audio workstations and other digital audio tools has brought a critical shift in the audio industry by empowering amateur and professional audio content creators with the necessary means to produce high quality audio content. Yet, ...
Understanding and Designing for Accessibility in Audio Production among People with Vision Impairments
CHI EA '22: Extended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems

Specialized software tools have become essential to many forms of content creation, yet poor accessibility of these tools has led to unequitable opportunities for disabled content creators. My doctoral research contributes to our knowledge of ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

ASSETS '18: Proceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility

October 2018

508 pages

ISBN:9781450356503

DOI:10.1145/3234695

General Chair:
Faustina Hwang
University of Reading, UK
,
Program Chairs:
Joanna McGrenere
University of British Columbia, Canada
,
David Flatla
University of Guelph, Canada

Copyright © 2018 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

SIGACCESS: ACM Special Interest Group on Accessible Computing

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 08 October 2018

Check for updates

Author Tags

Qualifiers

Poster

Conference

ASSETS '18

Sponsor:

SIGACCESS

ASSETS '18: The 20th International ACM SIGACCESS Conference on Computers and Accessibility

October 22 - 24, 2018

Galway, Ireland

Acceptance Rates

ASSETS '18 Paper Acceptance Rate 28 of 108 submissions, 26%;

Overall Acceptance Rate 436 of 1,556 submissions, 28%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

13
Total Citations
View Citations
251
Total Downloads

Downloads (Last 12 months)8
Downloads (Last 6 weeks)1

Reflects downloads up to 15 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Teng YCourtien CRios DTseng YGibson JAziz MReyna AVaish RSmith B(2024)Help Supporters: Exploring the Design Space of Assistive Technologies to Support Face-to-Face Help Between Blind and Sighted StrangersProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642816(1-24)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642816
Kameswaran VY VMarathe M(2023)Advocacy as Access Work: How People with Visual Impairments Gain Access to Digital Banking in IndiaProceedings of the ACM on Human-Computer Interaction10.1145/35795967:CSCW1(1-23)Online publication date: 16-Apr-2023
https://dl.acm.org/doi/10.1145/3579596
Akter TAhmed TKapadia ASwaminathan M(2022)Shared Privacy Concerns of the Visually Impaired and Sighted Bystanders with Camera-Based Assistive TechnologiesACM Transactions on Accessible Computing10.1145/350685715:2(1-33)Online publication date: 19-May-2022
https://dl.acm.org/doi/10.1145/3506857
Lee KHong JJarjue EMensah EKacorri HAhmetovic DYaneva V(2022)From the lab to people's homeProceedings of the 19th International Web for All Conference10.1145/3493612.3520448(1-11)Online publication date: 25-Apr-2022
https://dl.acm.org/doi/10.1145/3493612.3520448
Valipoor Mde Antonio A(2022)Recent trends in computer vision-driven scene understanding for VI/blind users: a systematic mappingUniversal Access in the Information Society10.1007/s10209-022-00868-w22:3(983-1005)Online publication date: 6-Feb-2022
https://doi.org/10.1007/s10209-022-00868-w
Lee KSato DAsakawa SAsakawa CKacorri H(2021)Accessing Passersby Proxemic Signals through a Head-Worn Camera: Opportunities and Limitations for the BlindProceedings of the 23rd International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3441852.3471232(1-15)Online publication date: 17-Oct-2021
https://dl.acm.org/doi/10.1145/3441852.3471232
Bennett CGleason CScheuerman MBigham JGuo ATo AKitamura YQuigley AIsbister KIgarashi TBjørn PDrucker S(2021)“It’s Complicated”: Negotiating Accessibility and (Mis)Representation in Image Descriptions of Race, Gender, and DisabilityProceedings of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411764.3445498(1-19)Online publication date: 6-May-2021
https://dl.acm.org/doi/10.1145/3411764.3445498
Thieme ACutrell EMorrison CTaylor ASellen A(2020)Interpretability as a dynamic of human-AI interactionInteractions10.1145/341128627:5(40-45)Online publication date: 1-Sep-2020
https://dl.acm.org/doi/10.1145/3411286
Ahmed SBalasubramanian HStumpf SMorrison CSellen AGrayson MPaternò FOliver NConati CSpano LTintarev N(2020)Investigating the intelligibility of a computer vision system for blind usersProceedings of the 25th International Conference on Intelligent User Interfaces10.1145/3377325.3377508(419-429)Online publication date: 17-Mar-2020
https://dl.acm.org/doi/10.1145/3377325.3377508
Akter TAhmed TKapadia ASwaminathan S(2020)Privacy Considerations of the Visually Impaired with Camera Based Assistive Technologies: Misrepresentation, Impropriety, and FairnessProceedings of the 22nd International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3373625.3417003(1-14)Online publication date: 26-Oct-2020
https://dl.acm.org/doi/10.1145/3373625.3417003
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents