skip to main content
10.1145/3308561.3353782acmconferencesArticle/Chapter ViewAbstractPublication PagesassetsConference Proceedingsconference-collections
research-article
Public Access

shapeCAD: An Accessible 3D Modelling Workflow for the Blind and Visually-Impaired Via 2.5D Shape Displays

Published: 24 October 2019 Publication History

Abstract

Affordable rapid 3D printing technologies have become key enablers of the Maker Movement by giving individuals the ability to create physical finished products. However, existing computer-aided design (CAD) tools that allow authoring and editing of 3D models are mostly visually reliant and limit access to people with blindness and visual impairment (BVI). Through a series of co-design sessions with three blind users of mixed programming ability, we identify accessibility challenges in existing 3D modelling scripting tools and design interactions to support dynamic feedback of scripts using a 2.5D tactile shape display. With these insights, we implement shapeCAD. Interacting with shapeCAD, BVI users are able to leverage the low resolution output from a 2.5D shape display to complement programming of 3D models. shapeCAD allows users to haptically explore and modify existing models, and to author new models. We further validate usability and user experience through an evaluation with five BVI programmers. In a short period of time, novices were able to design a range of new objects. BVI users can bring a valuable perspective to design and it is imperative to increase accessibility in tools that enable this community to also participate as designers.

Supplementary Material

MP4 File (fp013vf.mp4)
Supplemental video

References

[1]
Peter Bennett, Mike Fraser, Duncan Boa, and Ben Hicks. 2017. InstructiBlocks: Designing with Ambiguous Physical-Digital Models. In Proceedings of the Eleventh International Conference on Tangible, Embedded, and Embodied Interaction. ACM, 551--558.
[2]
Jeffrey P Bigham, Ryan S Kaminsky, Richard E Ladner, Oscar M Danielsson, and Gordon L Hempton. 2006. WebInSight:: making web images accessible. In Proceedings of the 8th international ACM SIGACCESS conference on Computers and accessibility. ACM, 181--188.
[3]
Paulo Blikstein. 2013. Digital fabrication and 'making'in education: The democratization of invention. FabLabs: Of machines, makers and inventors 4 (2013), 1--21.
[4]
John Brooke and others. 1996. SUS-A quick and dirty usability scale. Usability evaluation in industry 189, 194 (1996), 4--7.
[5]
Craig Brown and Amy Hurst. 2012. VizTouch: automatically generated tactile visualizations of coordinate spaces. In Proceedings of the Sixth International Conference on Tangible, Embedded and Embodied Interaction. ACM, 131--138.
[6]
Erin Buehler, William Easley, Samantha McDonald, Niara Comrie, and Amy Hurst. 2015. Inclusion and Education: 3D Printing for Integrated Classrooms. Proceedings of the 17th International ACM SIGACCESS Conference on Computers & Accessibility -ASSETS '15 (2015).
[7]
JP Chin, VA Diehl, and KL Norman. 1988. Questionnaire for User Interaction Satisfaction (QUIS). Human-Computer Interaction Lab, University of Maryland at College Park (1988).
[8]
Jonathan Cohen, Jonathan Cohen, W. Monty Jones, Shaunna Smith, and Brendan Calandra. 2017. Makification: Towards a Framework for Leveraging the Maker Movement in Formal... Journal of Educational Multimedia and Hypermedia 26, 3 (2017), 217--229.
[9]
Damian Copeland and Janet Finlay. 2010. Identification of the optimum resolution specification for a haptic graphic display. Interacting with Computers 22, 2 (2010), 98--106.
[10]
Nils Dahlbäck, Arne Jönsson, and Lars Ahrenberg. 1993. Wizard of Oz studies why and how. Knowledge-based systems 6, 4 (1993), 258--266.
[11]
Julie Ducasse, Anke M Brock, and Christophe Jouffrais. 2018. Accessible interactive maps for visually impaired users. In Mobility of Visually Impaired People. Springer, 537--584.
[12]
K Anders Ericsson and Herbert A Simon. 1984. Protocol analysis: Verbal reports as data. the MIT Press.
[13]
Sean Follmer, Daniel Leithinger, Alex Olwal, Akimitsu Hogge, and Hiroshi Ishii. 2013. inFORM: dynamic physical affordances and constraints through shape and object actuation. UIST '13 Proceedings of the 26th annual ACM symposium on User interface software and technology 13 (2013), 417--426.
[14]
American Printing House for the Blind. 2018. Introducing Graphiti -A Revolution in Accessing Digital Tactile Graphics. (2018). https://www.aph.org/graphiti/
[15]
Denis Gillet, Anh Vu Nguyen Ngoc, and Yassin Rekik. 2005. Collaborative web-based experimentation in flexible engineering education. IEEE Transactions on Education 48, 4 (2005), 696--704.
[16]
T Götzelmann. 2018. Autonomous Selection and Printing of 3D Models for People Who Are Blind. ACM Transactions on Accessible Computing (TACCESS) 11, 3 (2018), 14.
[17]
Timo Götzelmann, Lisa Branz, Claudia Heidenreich, and Markus Otto. 2017. A Personal Computer-based Approach for 3D Printing Accessible to Blind People. In Proceedings of the 10th International Conference on PErvasive Technologies Related to Assistive Environments. ACM, 1--4.
[18]
Darren Guinness, Edward Cutrell, and Meredith Ringel Morris. 2018. Caption crawler: Enabling reusable alternative text descriptions using reverse image search. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, 518.
[19]
Erica Rosenfeld Halverson and Kimberly Sheridan. 2014. The Maker Movement in Education. Harvard Educational Review 84, 4 (Dec 2014), 495--504.
[20]
SG Hart and others. 1988. Development of NASA-TLX: Results of empirical and theoretical research I inP. A. Hancock and N. Meshkati (eds.), Human Mental Workload. (1988).
[21]
Leona Holloway, Kim Marriott, and Matthew Butler. 2018. Accessible Maps for the Blind: Comparing 3D Printed Models with Tactile Graphics. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, 198.
[22]
Amy Hurst and Shaun Kane. 2013. Making making accessible. In Proceedings of the 12th international conference on interaction design and children. ACM, 635--638.
[23]
Youssef Bou Issa, Mustapha Mojahid, Bernard Oriola, and Nadine Vigouroux. 2009. Accessibility for the blind: An automated audio/tactile description of pictures in digital documents. In 2009 International Conference on Advances in Computational Tools for Engineering Applications. IEEE, 591--594.
[24]
Shaun K Kane and Jeffrey P Bigham. 2014. Tracking@ stemxcomet: teaching programming to blind students via 3D printing, crisis management, and twitter. In Proceedings of the 45th ACM technical symposium on Computer science education. ACM, 247--252.
[25]
Jeeeun Kim, Abigale Stangl, and Tom Yeh. 2014. Using LEGO to model 3D tactile picture books by sighted children for blind children. In Proceedings of the 2nd ACM symposium on Spatial user interaction. ACM, 146--146.
[26]
Roberta L. Klatzky, Susan J. Lederman, and Victoria A. Metzger. 1985. Identifying objects by touch: An expert system. Perception & Psychophysics 37, 4 (01 Jul 1985), 299--302.
[27]
Richard E Ladner, Melody Y Ivory, Rajesh Rao, Sheryl Burgstahler, Dan Comden, Sangyun Hahn, Matthew Renzelmann, Satria Krisnandi, Mahalakshmi Ramasamy, Beverly Slabosky, and others. 2005. Automating tactile graphics translation. In Proceedings of the 7th international ACM SIGACCESS conference on Computers and accessibility. ACM, 150--157.
[28]
David H Laidlaw, W Benjamin Trumbore, and John F Hughes. 1986. Constructive solid geometry for polyhedral objects. In ACM SIGGRAPH computer graphics, Vol. 20. ACM, 161--170.
[29]
Rebecca Lawson and Sarah Bracken. 2011. Haptic Object Recognition: How Important are Depth Cues and Plane Orientation? Perception 40, 5 (2011), 576--597. 21882721.
[30]
Susan J Lederman and Roberta L Klatzky. 1987. Hand movements: A window into haptic object recognition. Cognitive Psychology 19, 3 (1987), 342 -- 368. //doi.org/10.1016/0010-0285(87)90008--9
[31]
Ben Leduc-Mills and Michael Eisenberg. 2011. The UCube: a child-friendly device for introductory three-dimensional design. In proceedings of the 10th international conference on interaction design and children. ACM, 72--80.
[32]
Fabrizio Leo, Elena Cocchi, and Luca Brayda. 2017. The effect of programmable tactile displays on spatial learning skills in children and adolescents of different visual disability. IEEE Transactions on Neural Systems and Rehabilitation Engineering 25, 7 (2017), 861--872.
[33]
Thomas H Massie, J Kenneth Salisbury, and others. 1994. The phantom haptic interface: A device for probing virtual objects. In Proceedings of the ASME winter annual meeting, symposium on haptic interfaces for virtual environment and teleoperator systems, Vol. 55. Citeseer, 295--300.
[34]
Joshua A Miele, Steven Landau, and Deborah Gilden. 2006. Talking TMAP: Automated generation of audio-tactile maps using Smith-Kettlewell's TMAP software. British Journal of Visual Impairment 24, 2 (2006), 93--100.
[35]
Kazunori Minatani. 2017. Finding 3D CAD Data Production Methods that Work for People with Visual Impairments. In HCI International 2017 -- Posters' Extended Abstracts, Constantine Stephanidis (Ed.). Springer International Publishing, Cham, 548--554.
[36]
Paolo Motto Ros, Vittorio Dante, Luca Mesin, Erminio Petetti, Paolo Del Giudice, and Eros Pasero. 2014. A new dynamic tactile display for reconfigurable braille: implementation and tests. Frontiers in neuroengineering 7 (2014), 6.
[37]
Stefanie Mueller, Anna Seufert, Huaishu Peng, Robert Kovacs, Kevin Reuss, François Guimbretière, and Patrick Baudisch. 2019. FormFab: Continuous Interactive Fabrication. In Proceedings of the Thirteenth International Conference on Tangible, Embedded, and Embodied Interaction. ACM, 315--323.
[38]
Yuenyong Nilsiam and Joshua M Pearce. 2017. Free and open source 3-D model customizer for websites to democratize design with OpenSCAD. Designs 1, 1 (2017), 5.
[39]
Braille Authority of North America. 2010. Guidelines and Standards for Tactile Graphics. (2010). http://www.brailleauthority.org/tg/
[40]
OpenSCAD. 2015. OpenSCAD -The Programmers Solid 3D CAD Modeller. https://www.openscad.org. (2015). Accessed: 2019-05-02.
[41]
Thomas Pietrzak, Andrew Crossan, Stephen A Brewster, Benoît Martin, and Isabelle Pecci. 2009. Exploring geometric shapes with touch. In IFIP Conference on Human-Computer Interaction. Springer, 145--148.
[42]
Denise Prescher. 2014. Redesigning input controls of a touch-sensitive pin-matrix device. In Proceedings of the international workshop on tactile/haptic user interfaces for tabletops and tablets. 19--24.
[43]
Denise Prescher and Gerhard Weber. 2017. Comparing Two Approaches of Tactile Zooming on a Large Pin-Matrix Device. In IFIP Conference on Human-Computer Interaction. Springer, 173--186.
[44]
Deepak Ramteke, Gayatri Kansal, and Benu Madhab. 2014. Accessible Engineering Drawings for Visually Impaired Machine Operators. Assistive Technology 26, 4 (2014), 196--201.
[45]
Ravi Rastogi, TV Dianne Pawluk, and Jessica Ketchum. 2013. Intuitive tactile zooming for graphics accessed by individuals who are blind and visually impaired. IEEE Transactions on Neural Systems and Rehabilitation Engineering 21, 4 (2013), 655--663.
[46]
Jeff Sauro and Joseph S Dumas. 2009. Comparison of three one-question, post-task usability questionnaires. In Proceedings of the SIGCHI conference on human factors in computing systems. ACM, 1599--1608.
[47]
Zachary Schmitt and Svetlana Yarosh. 2018. Participatory design of technologies to support recovery from substance use disorders. Proceedings of the ACM on Human-Computer Interaction 2, CSCW (2018), 156.
[48]
Yutaka Shimizu, Shinya Saida, and Hiroshi Shimura. 1993. Tactile pattern recognition by graphic display: Importance of 3-D information for haptic perception of familiar objects. Perception & Psychophysics 53, 1 (1993), 43--48.
[49]
Masami Shinohara, Yutaka Shimizu, and Akira Mochizuki. 1998. Three-dimensional tactile display for the blind. IEEE Transactions on Rehabilitation Engineering 6, 3 (1998), 249--256.
[50]
Alexa F Siu, Eric J Gonzalez, Shenli Yuan, Jason B Ginsberg, and Sean Follmer. 2018a. shapeShift: 2D Spatial Manipulation and Self-Actuation of Tabletop Shape Displays for Tangible and Haptic Interaction. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, 291.
[51]
Alexa F. Siu, Joshua Miele, and Sean Follmer. 2018b. An Accessible CAD Workflow Using Programming of 3D Models and Preview Rendering in A 2.5D Shape Display. In Proceedings of the 20th International ACM SIGACCESS Conference on Computers & Accessibility (ASSETS '18). ACM, New York, NY, USA, 343--345.
[52]
Nancy Staggers and David Kobus. 2000. Comparing Response Time, Errors, and Satisfaction Between Text-based and Graphical User Interfaces During Nursing Order Tasks. Journal of the American Medical Informatics Association 7, 2 (2000), 164--176.
[53]
Katherine Steele, Brianna Blaser, and Maya Cakmak. 2018. Accessible Making: Designing Makerspaces for Accessibility. International Journal of Designs for Learning 9, 1 (2018), 114--121.
[54]
Saiganesh Swaminathan, Thijs Roumen, Robert Kovacs, David Stangl, Stefanie Mueller, and Patrick Baudisch. 2016. Linespace: A Sensemaking Platform for the Blind. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 2175--2185.
[55]
Faisal Taher, John Hardy, Abhijit Karnik, Christian Weichel, Yvonne Jansen, Kasper Hornbæk, and Jason Alexander. 2015. Exploring interactions with physically dynamic bar charts. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. ACM, 3237--3246.
[56]
Ruhan Ozkardes Tandogan and Akinoglu Orhan. 2007. The Effects of Problem-Based Active Learning in Science Education on Students' Academic Achievement, Attitude and Concept Learning. Online Submission 3, 1 (2007), 71--81.
[57]
Barker Temple. 1990. The benefits of the graphical user interface: A report on new primary research. The benefits of the graphical user interface: A report on new primary research. The benefits of the graphical user interface: A report on new primary research. (1990).
[58]
TinkerCAD. 2019. Direct Starters. https://www.tinkercad.com/learn/project-gallery; collectionId=OPC41AJJKIKDWDV. (2019). Accessed: 2019-05-02.
[59]
Thomas P Way and Kenneth E Barner. 1997. Automatic visual to tactile translation. II. Evaluation of the TACTile image creation system. IEEE Transactions on Rehabilitation Engineering 5, 1 (1997), 95--105.
[60]
Maryjane Wraga, Monique Swaby, and Catherine M Flynn. 2008. Passive tactile feedback facilitates mental rotation of handheld objects. Memory & cognition 36, 2 (2008), 271--281.
[61]
Tom Yeh and Jeeeun Kim. 2018. CraftML: 3D Modeling is Web Programming. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, 527.
[62]
Kai Zhang and Sean Follmer. 2018. Electrostatic Adhesive Brakes for High Spatial Resolution Refreshable 2.5 D Tactile Shape Displays. In Haptics Symposium (HAPTICS), 2018 IEEE. IEEE, 319--326.

Cited By

View all

Index Terms

  1. shapeCAD: An Accessible 3D Modelling Workflow for the Blind and Visually-Impaired Via 2.5D Shape Displays

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Conferences
      ASSETS '19: Proceedings of the 21st International ACM SIGACCESS Conference on Computers and Accessibility
      October 2019
      730 pages
      ISBN:9781450366762
      DOI:10.1145/3308561
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

      Sponsors

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 24 October 2019

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. 2.5d shape displays
      2. accessible 3d printing
      3. accessible authoring tools
      4. haptics
      5. tactile displays
      6. tactile graphics

      Qualifiers

      • Research-article

      Funding Sources

      Conference

      ASSETS '19
      Sponsor:

      Acceptance Rates

      ASSETS '19 Paper Acceptance Rate 41 of 158 submissions, 26%;
      Overall Acceptance Rate 436 of 1,556 submissions, 28%

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)433
      • Downloads (Last 6 weeks)46
      Reflects downloads up to 24 Dec 2024

      Other Metrics

      Citations

      Cited By

      View all

      View Options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Login options

      Media

      Figures

      Other

      Tables

      Share

      Share

      Share this Publication link

      Share on social media