skip to main content
10.1145/3491101.3519715acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
poster
Open access

Evaluating Soft Organ-Shaped Tangibles for Medical Virtual Reality

Published: 28 April 2022 Publication History

Abstract

Connecting digital information with the physical is one of the essential ideas of tangible user interfaces. The design of the physical representation is important especially for specialised domains like surgery planning, because surgeons rely heavily on their tactile senses. Therefore, this research work investigates the effect of a soft and a hard 3D model as an interaction device for virtual reality surgical planning. A user study with 13 surgeons reveals a clear preference for the softer, more realistic material and a significantly higher haptic user experience for the soft model compared to the hard one. These results advocate for stressing material aspects along with the interaction design in domains with an inherently high focus on tactile aspects.

Supplementary Material

MP4 File (3491101.3519715-video-figure.mp4)
Video Figure
MP4 File (3491101.3519715-talk-video.mp4)
Talk Video

References

[1]
Lonni Besançon, Anders Ynnerman, Daniel F. Keefe, Lingyun Yu, and Tobias Isenberg. 2021. The State of the Art of Spatial Interfaces for 3D Visualization. Computer Graphics Forum n/a, n/a (2021). https://doi.org/10.1111/cgf.14189 arXiv:https://onlinelibrary.wiley.com/doi/pdf/10.1111/cgf.14189
[2]
Christian Boedecker, Florentine Huettl, Patrick Saalfeld, Markus Paschold, Werner Kneist, Janine Baumgart, Bernhard Preim, Christian Hansen, Hauke Lang, and Tobias Huber. 2021. Using virtual 3D-models in surgical planning: workflow of an immersive virtual reality application in liver surgery. Langenbeck’s Archives of Surgery 406, 3 (2021), 911–915.
[3]
Alberto Boem, Yuuki Enzaki, Hiroaki Yano, and Hiroo Iwata. 2019. Human Perception of a Haptic Shape-changing Interface with Variable Rigidity and Size. In 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). Institute of Electrical and Electronics Engineers (IEEE), New York, NY, USA, 858–859. https://doi.org/10.1109/VR.2019.8798214
[4]
A. Bornik, R. Beichel, E. Kruijff, B. Reitinger, and D. Schmalstieg. 2006. A Hybrid User Interface for Manipulation of Volumetric Medical Data. In 3D User Interfaces (3DUI’06). Institute of Electrical and Electronics Engineers (IEEE), New York, NY, USA, 29–36.
[5]
Elodie Bouzbib, Gilles Bailly, Sinan Haliyo, and Pascal Frey. 2021. ”Can I Touch This?”: Survey of Virtual Reality Interactions via Haptic Solutions. CoRR abs/2101.11278(2021), 16 pages. arxiv:2101.11278https://arxiv.org/abs/2101.11278
[6]
John Brooke. 1996. SUS - A Quick and Dirty Usability Scale. In Usability Evaluation in Industry. Taylor & Francis, London, England.
[7]
Vuthea Chheang, Patrick Saalfeld, Tobias Huber, Florentine Huettl, Werner Kneist, Bernhard Preim, and Christian Hansen. 2019. Collaborative Virtual Reality for Laparoscopic Liver Surgery Training. In 2019 IEEE International Conference on Artificial Intelligence and Virtual Reality (AIVR). Institute of Electrical and Electronics Engineers (IEEE), New York, NY, USA, 1–17.
[8]
Vuthea Chheang, Patrick Saalfeld, Fabian Joeres, Christian Boedecker, Tobias Huber, Florentine Huettl, Hauke Lang, Bernhard Preim, and Christian Hansen. 2021. A collaborative virtual reality environment for liver surgery planning. Computers & Graphics 99(2021), 234–246.
[9]
Tanja Döring. 2016. The Interaction Material Profile: Understanding and Inspiring How Physical Materials Shape Interaction. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems (San Jose, California, USA) (CHI EA ’16). Association for Computing Machinery, New York, NY, USA, 2446–2453. https://doi.org/10.1145/2851581.2892516
[10]
Tanja Döring. 2016. A Materials Perspective on Human-Computer Interaction : Case Studies on Tangible, Gestural, and Ephemeral User Interfaces. Ph.D. Dissertation. University of Bremen, Dissertation, 2016, Bremen. https://suche.suub.uni-bremen.de/peid=B101120109 XIII, 328 Seiten : Illustrationen.
[11]
Paul Dourish. 2004. Where the action is the foundations of embodied interaction. MIT press, Cambridge, MA, USA.
[12]
Ferran Fillat-Gomà, Francesc Antoni Marcano-Fernández, Sergi Coderch-Navarro, Laia Martínez-Carreres, and Alex Berenguer. 2021. 3D printing innovation: New insights into upper extremity surgery planning. Injury 52(2021), S117–S124. https://doi.org/10.1016/j.injury.2021.01.048 Spanish Orthopaedic Trauma.
[13]
Danilo Gasques, Janet G. Johnson, Tommy Sharkey, Yuanyuan Feng, Ru Wang, Zhuoqun Robin Xu, Enrique Zavala, Yifei Zhang, Wanze Xie, Xinming Zhang, Konrad Davis, Michael Yip, and Nadir Weibel. 2021. ARTEMIS: A Collaborative Mixed-Reality System for Immersive Surgical Telementoring. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA. https://doi.org/10.1145/3411764.3445576
[14]
Sandra G Hart and Lowell E Staveland. 1988. Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research. Advances in psychology 52 (1988), 139–183.
[15]
Ken Hinckley, Randy Pausch, John C. Goble, and Neal F. Kassell. 1994. Passive Real-world Interface Props for Neurosurgical Visualization. In Conference Companion on Human Factors in Computing Systems (Boston, Massachusetts, USA) (CHI ’94). ACM, New York, NY, USA, 232–. https://doi.org/10.1145/259963.260443
[16]
Edwin L Hutchins, James D Hollan, and Donald A Norman. 1985. Direct manipulation interfaces. Human–computer interaction 1, 4 (1985), 311–338.
[17]
Hiroshi Ishii and Brygg Ullmer. 1997. Tangible Bits: Towards Seamless Interfaces Between People, Bits and Atoms. In Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems (Atlanta, Georgia, USA) (CHI ’97). ACM, New York, NY, USA, 234–241. https://doi.org/10.1145/258549.258715
[18]
Robert J.K. Jacob, Audrey Girouard, Leanne M. Hirshfield, Michael S. Horn, Orit Shaer, Erin Treacy Solovey, and Jamie Zigelbaum. 2008. Reality-based Interaction: A Framework for post-WIMP Interfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Florence, Italy) (CHI ’08). ACM, New York, NY, USA, 201–210. https://doi.org/10.1145/1357054.1357089
[19]
Heekyoung Jung and Erik Stolterman. 2010. Material Probe: Exploring Materiality of Digital Artifacts. In Proceedings of the Fifth International Conference on Tangible, Embedded, and Embodied Interaction(Funchal, Portugal) (TEI ’11). Association for Computing Machinery, New York, NY, USA, 153–156. https://doi.org/10.1145/1935701.1935731
[20]
Konstantina Kilteni, Raphaela Groten, and Mel Slater. 2012. The Sense of Embodiment in Virtual Reality. Presence: Teleoper. Virtual Environ. 21, 4 (Dec. 2012), 373–387.
[21]
Franklin King, Jagadeesan Jayender, Sharath K Bhagavatula, Paul B Shyn, Steve Pieper, Tina Kapur, Andras Lasso, and Gabor Fichtinger. 2016. An immersive virtual reality environment for diagnostic imaging. Journal of Medical Robotics Research 1, 01 (2016), 1640003.
[22]
Scott R Klemmer, Björn Hartmann, and Leila Takayama. 2006. How bodies matter: five themes for interaction design. In Proceedings of the 6th conference on Designing Interactive systems. Association for Computing Machinery, New York, NY, USA, 140–149. https://doi.org/10.1145/1142405.1142429
[23]
Chi-Jung Lee, Hsin-Ruey Tsai, and Bing-Yu Chen. 2021. HairTouch: Providing Stiffness, Roughness and Surface Height Differences Using Reconfigurable Brush Hairs on a VR Controller. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI ’21). Association for Computing Machinery, New York, NY, USA, Article 133, 13 pages. https://doi.org/10.1145/3411764.3445285
[24]
James R. Lewis, Brian S. Utesch, and Deborah E. Maher. 2013. UMUX-LITE: When There’s No Time for the SUS. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Paris, France) (CHI ’13). Association for Computing Machinery, New York, NY, USA, 2099–2102. https://doi.org/10.1145/2470654.2481287
[25]
James R. Lewis, Brian S. Utesch, and Deborah E. Maher. 2015. Investigating the Correspondence Between UMUX-LITE and SUS Scores. In Design, User Experience, and Usability: Design Discourse, Aaron Marcus (Ed.). Springer International Publishing, Cham, 204–211.
[26]
James R Lewis, Brian S Utesch, and Deborah E Maher. 2015. Investigating the correspondence between umux-lite and sus scores. In Design, User Experience, and Usability: Design Discourse, Aaron Marcus (Ed.). Springer, Cham, 204–211.
[27]
Alessandro Marro, Taha Bandukwala, and Walter Mak. 2016. Three-dimensional printing and medical imaging: a review of the methods and applications. Current problems in diagnostic radiology 45, 1 (2016), 2–9.
[28]
Nicolas Martelli, Carole Serrano, Hèlène van den Brink, Judith Pineau, Patrice Prognon, Isabelle Borget, and Salma El Batti. 2016. Advantages and disadvantages of 3-dimensional printing in surgery: Asystematic review. Surgery 159, 6 (2016), 1485 – 1500.
[29]
John P McIntire, Paul R Havig, and Eric E Geiselman. 2012. What is 3D good for? A review of human performance on stereoscopic 3D displays. In Head-and Helmet-Mounted Displays XVII; and Display Technologies and Applications for Defense, Security, and Avionics VI, Vol. 8383. International Society for Optics and Photonics, SPIE, Baltimore, MD, USA, 83830X.
[30]
Thomas Muender, Anke V. Reinschluessel, Sean Drewes, Dirk Wenig, Tanja Döring, and Rainer Malaka. 2019. Does It Feel Real?: Using Tangibles with Different Fidelities to Build and Explore Scenes in Virtual Reality. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). ACM, New York, NY, USA, Article 673, 12 pages. https://doi.org/10.1145/3290605.3300903
[31]
Asier Muguruza Blanco, Lucas Krauel, and F Fenollosa. 2018. Development of a patients-specific 3D-printed preoperative planning and training tool, with functionalized internal surfaces, for complex oncologic cases. Rapid Prototyping Journal 25 (10 2018).
[32]
Benjamin C. Mac Murray, Bryan N. Peele, Patricia Xu, Josef Spjut, Omer Shapira, David Luebke, and Robert F. Shepherd. 2018. A variable shape and variable stiffness controller for haptic virtual interactions. In 2018 IEEE International Conference on Soft Robotics (RoboSoft). Institute of Electrical and Electronics Engineers (IEEE), New York, NY, USA, 264–269. https://doi.org/10.1109/ROBOSOFT.2018.8404930
[33]
Daniela Petrelli, Alessandro Soranzo, Luigina Ciolfi, and John Reidy. 2016. Exploring the Aesthetics of Tangible Interaction: Experiments on the Perception of Hybrid Objects. In Proceedings of the TEI ’16: Tenth International Conference on Tangible, Embedded, and Embodied Interaction (Eindhoven, Netherlands) (TEI ’16). Association for Computing Machinery, New York, NY, USA, 100–108. https://doi.org/10.1145/2839462.2839478
[34]
R Core Team. 2017. R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing, Vienna, Austria. https://www.R-project.org/
[35]
A. Reinschluessel, R. Fischer, C. Schumann, V. Uslar, T. Muender, U. Katzky, H. Kißner, V. Kraft, M. Lampe, T. Lück, K. Bock-Müller, H. Nopper, S. Pelzl, D. Wenig, A. Schenk, D. Weyhe, G. Zachmann, and R. Malaka. 2019. Introducing Virtual & 3D-Printed Models for Improved Collaboration in Surgery. In Proceedings of the 18. Annual Meeting of the German Society of Computer- and Robot-Assisted Surgery, Oliver Burgert (Ed.). Vol. 18. Deutsche Gesellschaft für die Computer-und Roboterassistierte Chirurgie e.V., Stuttgart, Germany, 253–258.
[36]
Anke V. Reinschluessel, Thomas Muender, Tanja Döring, Verena Uslar, Thomas Lück, Dirk Weyhe, Andrea Schenk, and Rainer Malaka. 2021. A Study on the Size of Tangible Organ-Shaped Controllers for Exploring Medical Data in VR. In CHI Conference on Human Factors in Computing Systems Extended Abstracts (CHI ’21 Extended Abstracts). ACM, ACM, New York, NY, USA, 7.
[37]
Anke V. Reinschluessel, Thomas Muender, Verena Uslar, Dirk Weyhe, Andrea Schenk, and Rainer Malaka. 2019. Tangible Organs: Introducing 3D Printed Organ Models with VR to Interact with Medical 3D Models. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI EA ’19). ACM, New York, NY, USA, Article LBW1816, 6 pages. https://doi.org/10.1145/3290607.3313029
[38]
Anke Verena Reinschluessel, Joern Teuber, Marc Herrlich, Jeffrey Bissel, Melanie van Eikeren, Johannes Ganser, Felicia Koeller, Fenja Kollasch, Thomas Mildner, Luca Raimondo, 2017. Virtual reality for user-centered design and evaluation of touch-free interaction techniques for navigating medical images in the operating room. In Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems. ACM, ACM, New York, NY, USA, 2001–2009.
[39]
B. Reitinger, A. Bornik, R. Beichel, and D. Schmalstieg. 2006. Liver Surgery Planning Using Virtual Reality. IEEE Computer Graphics and Applications 26, 6 (11 2006), 36–47.
[40]
A. Schenk, S. Zidowitz, H. Bourquain, M. Hindennach, C. Hansen, H.K. Hahn, and H.-O. Peitgen. 2008. Clinical relevance of model based computer-assisted diagnosis and therapy, In Medical Imaging 2008: Computer-Aided Diagnosis. Progress in Biomedical Optics and Imaging - Proceedings of SPIE 6915, 691502–1–691502–19. https://doi.org/10.1117/12.780270
[41]
Martin Schrepp, Andreas Hinderks, and Jörg Thomaschewski. 2017. Construction of a Benchmark for the User Experience Questionnaire (UEQ). Int. J. Interact. Multim. Artif. Intell. 4, 4 (2017), 40–44.
[42]
Martin Schrepp and Jörg Thomaschewski. 2019. Design and Validation of a Framework for the Creation of User Experience Questionnaires. International Journal of Interactive Multimedia & Artificial Intelligence 5, 7 (2019).
[43]
Maurício Sousa, Daniel Mendes, Soraia Paulo, Nuno Matela, Joaquim Jorge, and Daniel Simões Lopes. 2017. VRRRRoom: Virtual Reality for Radiologists in the Reading Room. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI ’17). ACM, New York, NY, USA, 4057–4062.
[44]
Jessica Tsimeris, Duncan Stevenson, Tom Gedeon, and Matt Adcock. 2013. Using ForceForm, a Dynamically Deformable Interactive Surface, for Palpation Simulation in Medical Scenarios. In Proceedings of the Second International Workshop on Smart Material Interfaces: Another Step to a Material Future (Sydney, Australia) (SMI ’13). Association for Computing Machinery, New York, NY, USA, 19–22. https://doi.org/10.1145/2534688.2534693
[45]
C Lee Ventola. 2014. Medical applications for 3D printing: current and projected uses. Pharmacy and Therapeutics 39, 10 (2014), 704.
[46]
Nadir Weibel, Danilo Gasques, Janet Johnson, Thomas Sharkey, Zhuoqun Robin Xu, Xinming Zhang, Enrique Zavala, Michael Yip, and Konrad Davis. 2020. ARTEMIS: Mixed-Reality Environment for Immersive Surgical Telementoring. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems(CHI EA ’20). Association for Computing Machinery, New York, NY, USA, 1–4.
[47]
Mikael Wiberg. 2018. The Materiality of Interaction: Notes on the Materials of Interaction Design. The MIT Press, Cambridge, MA, USA.
[48]
Nizar N. Zein, Ibrahim A. Hanouneh, Paul D. Bishop, Maggie Samaan, Bijan Eghtesad, Cristiano Quintini, Charles Miller, Lisa Yerian, and Ryan Klatte. 2013. Three-dimensional print of a liver for preoperative planning in living donor liver transplantation. Liver Transplantation 19, 12 (2013), 1304–1310.

Cited By

View all
  • (2025)Augmented und Virtual Reality in der Chirurgie: Einsatzgebiete und explorative Studien am Beispiel von VIVATOPAugmented and virtual reality in surgery: fields of application and exploratory studies exemplified by VIVATOPDie Chirurgie10.1007/s00104-024-02218-3Online publication date: 3-Jan-2025
  • (2024)Free-Hand Input and Interaction in Virtual Reality Using a Custom Force-Based Digital ThimbleApplied Sciences10.3390/app14231101814:23(11018)Online publication date: 27-Nov-2024
  • (2024)Stiffness Simulation with Haptic Feedback Using Robotic Gripper and Paper Origami as End-Effector2024 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)10.1109/VRW62533.2024.00015(48-53)Online publication date: 16-Mar-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
CHI EA '22: Extended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems
April 2022
3066 pages
ISBN:9781450391566
DOI:10.1145/3491101
This work is licensed under a Creative Commons Attribution-NonCommercial International 4.0 License.

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 28 April 2022

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. 3D prints
  2. liver
  3. material
  4. model
  5. natural interaction
  6. surgery
  7. surgical planning
  8. virtual reality

Qualifiers

  • Poster
  • Research
  • Refereed limited

Funding Sources

  • German Federal Ministry of Education and Research (BMBF)

Conference

CHI '22
Sponsor:
CHI '22: CHI Conference on Human Factors in Computing Systems
April 29 - May 5, 2022
LA, New Orleans, USA

Acceptance Rates

Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

Upcoming Conference

CHI 2025
ACM CHI Conference on Human Factors in Computing Systems
April 26 - May 1, 2025
Yokohama , Japan

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)247
  • Downloads (Last 6 weeks)20
Reflects downloads up to 03 Jan 2025

Other Metrics

Citations

Cited By

View all

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Login options

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media