research-article

The potentials for hands-free interaction in micro-neurosurgery

Authors:

Hoorieh Afkari,

Shahram Eivazi,

Roman Bednarik,

Susanne MäkeläAuthors Info & Claims

NordiCHI '14: Proceedings of the 8th Nordic Conference on Human-Computer Interaction: Fun, Fast, Foundational

Pages 401 - 410

https://doi.org/10.1145/2639189.2639213

Published: 26 October 2014 Publication History

Abstract

Micro-neurosurgery has been revolutionized by advances in the surgical microscope such as high magnification that have increased a surgeon's ability to have a clear view of the surgical field. High magnification necessitates frequent interaction with the microscope during an operation, and the current interaction technique for positioning and adjusting the microscope introduces risk factors that force a surgeon to remove hands from the operating field. The purpose of this study is to investigate the potential for hands-free interaction in micro-neurosurgery. We present findings from a contextual study of how neurosurgeons interact with the microscope and the surgical team, and discuss the implications of the findings for designing hands-free, especially gaze-based interaction techniques for micro-neurosurgery.

References

[1]

Aanestad, M. The camera as an actor design-in-use of telemedicine infrastructure in surgery. Computer Supported Cooperative Work (CSCW) 12, 1 (2003), 1--20.

Digital Library

[2]

Bednarik, R., Vrzakova, H., and Hradis, M. What do you want to do next: a novel approach for intent prediction in gaze-based interaction. In Proc. of the symposium on eye tracking research and applications, ACM (2012), 83--90.

Digital Library

[3]

Bourne, S. K., Walcott, B. P., Sheth, S. A., and Coumans, J.-V. C. Neurological surgery: The influence of physical and mental demands on humans performing complex operations. Journal of Clinical Neuroscience 20, 3 (2013), 342--348.

[4]

Charlier, J., Sourdille, P., Behague, M., and Buquet, C. Eye-controlled microscope for surgical applications. Developments in ophthalmology 22 (1991), 154--158.

[5]

Duchowski, A. T. A breadth-first survey of eye-tracking applications. Behavior Research Methods, Instruments, & Computers 34, 4 (2002), 455--470.

[6]

Eivazi, S., Bednarik, R., Tukiainen, M., von und zu Fraunberg, M., Leinonen, V., and Jääskeläinen, J. E. Gaze behaviour of expert and novice microneurosurgeons differs during observations of tumor removal recordings. In Proc. of the Symposium on Eye Tracking Research and Applications, ACM (2012), 377--380.

Digital Library

[7]

Fitzpatrick, G., and Ellingsen, G. A review of 25 years of cscw research in healthcare: contributions, challenges and future agendas. Computer Supported Cooperative Work 22, 4--6 (2013), 609--665.

Digital Library

[8]

Hansen, D. W., and Ji, Q. In the eye of the beholder: A survey of models for eyes and gaze. Pattern Analysis and Machine Intelligence, IEEE Transactions on 32, 3 (2010), 478--500.

Digital Library

[9]

Heath, C., Sanchez Svensson, M., Hindmarsh, J., Luff, P., and vom Lehn, D. Configuring awareness. Computer Supported Cooperative Work 11, 3--4 (2002), 317--347.

Digital Library

[10]

Hernesniemi, J., Niemelä, M., Karatas, A., Kivipelto, L., Ishii, K., Rinne, J., Ronkainen, A., Koivisto, T., Kivisaari, R., Shen, H., et al. Some collected principles of microneurosurgery: simple and fast, while preserving normal anatomy: a review. Surgical Neurology 64, 3 (2005), 195--200.

[11]

Hillaire, S., Lécuyer, A., Cozot, R., and Casiez, G. Using an eye-tracking system to improve camera motions and depth-of-field blur effects in virtual environments. In Virtual Reality Conference, IEEE (2008), 47--50.

[12]

Hinckley, K., Pausch, R., Goble, J. C., and Kassell, N. F. Passive real-world interface props for neurosurgical visualization. In Proc. of the SIGCHI conference on Human factors in computing systems, ACM (1994), 452--458.

Digital Library

[13]

Hindmarsh, J., and Pilnick, A. Knowing bodies at work: embodiment and ephemeral teamwork in anaesthesia. Organization Studies 28, 9 (2007), 1395--1416.

[14]

Hor, F., Desgeorges, M., Traina, M., and Cordoliani, Y. Neuronavigation: A cas system for neurosurgery. In Minimally Invasive Techniques for Neurosurgery. Springer, 1998, 175--178.

[15]

Jacob, R. J. The use of eye movements in human-computer interaction techniques: what you look at is what you get. ACM Transactions on Information Systems (TOIS) 9, 2 (1991), 152--169.

Digital Library

[16]

Jacob, R. J., and Karn, K. S. Eye tracking in human-computer interaction and usability research: Ready to deliver the promises. The Mind's eye: Cognitive and Applied Aspects of Eye Movement Research (2003), 573--603.

[17]

Johnson, R., O'Hara, K., Sellen, A., Cousins, C., and Criminisi, A. Exploring the potential for touchless interaction in image-guided interventional radiology. In Proc. of the SIGCHI Conference on Human Factors in Computing Systems, ACM (2011), 3323--3332.

Digital Library

[18]

Kantelhardt, S. R., Finke, M., Schweikard, A., and Giese, A. Evaluation of a completely robotized neurosurgical operating microscope. Neurosurgery 72 (2013), A19--A26.

[19]

Koivukangas, J., Louhisalmi, Y., Alakuijala, J., and Oikarinen, J. Ultrasound-controlled neuronavigator-guided brain surgery. Journal of neurosurgery 79, 1 (1993), 36--42.

[20]

Kriss, T. C., and Kriss, V. M. History of the operating microscope: from magnifying glass to microneurosurgery. Neurosurgery 42, 4 (1998), 899--907.

[21]

Kusunoki, D. S., Sarcevic, A., Zhang, Z., and Burd, R. S. Understanding visual attention of teams in dynamic medical settings through vital signs monitor use. In Proc. of the 2013 conference on Computer supported cooperative work, ACM (2013), 527--540.

Digital Library

[22]

Lehecka, M., Laakso, A., Hernesniemi, J., and Çelik, Ö. Helsinki Microneurosurgery Basics and Tricks. M. Lehecka, A. Laakso and J. Hernesniemi, 2011.

[23]

McLaughlin, N., Carrau, R. L., Kelly, D. F., Prevedello, D. M., and Kassam, A. B. Teamwork in skull base surgery: An avenue for improvement in patient care. Surgical neurology international 4 (2013).

[24]

Mentis, H. M., O'Hara, K., Sellen, A., and Trivedi, R. Interaction proxemics and image use in neurosurgery. In Proc. of the 2012 ACM annual conference on Human Factors in Computing Systems, ACM (2012), 927--936.

Digital Library

[25]

Misra, B. K., and Chaudhuri, P. The operating microscope. Textbooks of Operative Neurosurgery (2 Vol.) (2005), 29.

[26]

Mitsuishi, M., Morita, A., Sugita, N., Sora, S., Mochizuki, R., Tanimoto, K., Baek, Y. M., Takahashi, H., and Harada, K. Master--slave robotic platform and its feasibility study for micro-neurosurgery. The Int. Journal of Medical Robotics and Computer Assisted Surgery 9, 2 (2013), 180--189.

[27]

Mylonas, G. P., Kwok, K.-W., Darzi, A., and Yang, G.-Z. Gaze-contingent motor channelling and haptic constraints for minimally invasive robotic surgery. In Medical Image Computing and Computer-Assisted Intervention--MICCAI. Springer, 2008, 676--683.

Digital Library

[28]

Nardi, B. A., Schwarz, H., Kuchinsky, A., Leichner, R., Whittaker, S., and Sclabassi, R. Turning away from talking heads: The use of video-as-data in neurosurgery. In Proc. of the INTERACT'93 and CHI'93 Conference on Human Factors in Computing Systems, ACM (1993), 327--334.

Digital Library

[29]

Noonan, D. P., Mylonas, G. P., Shang, J., Payne, C. J., Darzi, A., and Yang, G.-Z. Gaze contingent control for an articulated mechatronic laparoscope. In Biomedical Robotics and Biomechatronics (BioRob), IEEE (2010), 759--764.

[30]

Pomplun, M., Ivanovic, N., Reingold, E. M., and Shen, J. Empirical evaluation of a novel gaze-controlled zooming interface. In Proc. of HCI International (2001).

[31]

Sanchez Svensson, M., Heath, C., and Luff, P. Instrumental action: the timely exchange of implements during surgical operations. In Proceedings of the 10th European Conference on Computer Supported Cooperative Work (2007), 41--60.

[32]

Shimizu, S., Tanaka, O., Kondo, K., Yamazaki, T., Nakayama, K., Yamamoto, I., and Fujii, K. Inclined foot switches for surgical microscopes: A comfortable design for seated surgeons. Neurologia medico-chirurgica 51, 3 (2011), 260--262.

[33]

Staub, C., Can, S., Jensen, B., Knoll, A., and Kohlbecher, S. Human-computer interfaces for interaction with surgical tools in robotic surgery. In Biomedical Robotics and Biomechatronics(BioRob), IEEE (2012), 81--86.

[34]

Troutman, R. C. The operating microscope in ophthalmic surgery. Transactions of the American Ophthalmological Society 63 (1965), 335.

[35]

Uluç, K., Kujoth, G. C., and Baskaya, M. K. Operating microscopes: past, present, and future. Neurosurgical focus 27, 3 (2009), E4.

[36]

Van Veelen, M., Snijders, C., Van Leeuwen, E., Goossens, R., and Kazemier, G. Improvement of foot pedals used during surgery based on new ergonomic guidelines. Surgical Endoscopy And Other Interventional Techniques 17, 7 (2003), 1086--1091.

[37]

Wapler, M., Bräucker, M., Dürr, M., Hiller, A., Stallkamp, J., and Urban, V. A voice-controlled robotic assistant for neuroendoscopy. Studies in health technology and informatics (1999), 384--387.

[38]

Ware, C., and Mikaelian, H. H. An evaluation of an eye tracker as a device for computer input. In ACM SIGCHI Bulletin, vol. 17, ACM (1987), 183--188.

Digital Library

[39]

Yasargil, M. G. Microneurosurgery, Volume I. 1984.

[40]

Yasargil, M. G. Microsurgery: applied to neurosurgery. 2006.

[41]

Ying, X., Koivukangas, J., Alakuijala, J., Oikarinen, J., and Louhisalmi, Y. Design of high robust voice interface for speech activated neurosurgical workstation. In Computer Assisted Radiology/Computergestützte Radiologie. Springer, 1993, 429--434.

Cited By

Gomaa AMahdy BKleer NKrüger A(2024)Towards a Surgeon-in-the-Loop Ophthalmic Robotic Apprentice using Reinforcement and Imitation Learning2024 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)10.1109/IROS58592.2024.10802574(6939-6946)Online publication date: 14-Oct-2024
https://doi.org/10.1109/IROS58592.2024.10802574
Higa JNkatha SRamirez Herrera RMarcus HYoo SBlandford AOpie J(2024)Augmented reality for endoscopic transsphenoidal surgery: evaluating design factors with neurosurgeonsInternational Journal of Computer Assisted Radiology and Surgery10.1007/s11548-024-03225-920:1(131-136)Online publication date: 26-Jul-2024
https://doi.org/10.1007/s11548-024-03225-9
Afkari HBednarik R(2022)Seize the moment: the role of scrub nurses’ proactivity in microsurgical operating-room collaborationsBehaviour & Information Technology10.1080/0144929X.2022.209379142:10(1640-1657)Online publication date: 26-Jul-2022
https://doi.org/10.1080/0144929X.2022.2093791
Show More Cited By

Index Terms

The potentials for hands-free interaction in micro-neurosurgery
1. Human-centered computing

Recommendations

VR Simulation of Novel Hands-Free Interaction Concepts for Surgical Robotic Visualization Systems
Medical Image Computing and Computer Assisted Intervention – MICCAI 2020
Abstract
In microsurgery, visualization systems such as the traditional surgical microscope are essential, as surgeons rely on the highly magnified stereoscopic view for performing their operative tasks. For well-aligned visual perspectives onto the ...
Hands-free augmented reality for vascular interventions
SIGGRAPH '18: ACM SIGGRAPH 2018 Emerging Technologies

During a vascular intervention (a type of minimally invasive surgical procedure), physicians maneuver catheters and wires through a patient's blood vessels to reach a desired location in the body. Since the relevant anatomy is typically not directly ...
A master-slave haptic system for neurosurgery
Surgical Robotics

In recent years, new surgical tools have been designed to improve treatment results and lower patient trauma. Nevertheless, the dexterity and accuracy required for the positioning of new tools are often unreachable, if surgeons are not assisted by ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

NordiCHI '14: Proceedings of the 8th Nordic Conference on Human-Computer Interaction: Fun, Fast, Foundational

October 2014

361 pages

ISBN:9781450325424

DOI:10.1145/2639189

General Chairs:
Virpi Roto,
Jonna Häkkilä,
Program Chairs:
Kaisa Väänänen-Vainio-Mattila,
Oskar Juhlin,
Publications Chairs:
Thomas Olsson,
Ebba Hvannberg

Copyright © 2014 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

In-Cooperation

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 October 2014

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

NordiCHI '14

NordiCHI '14: The 8th Nordic Conference on Human-Computer Interaction

October 26 - 30, 2014

Helsinki, Finland

Acceptance Rates

NordiCHI '14 Paper Acceptance Rate 89 of 361 submissions, 25%;

Overall Acceptance Rate 379 of 1,572 submissions, 24%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

16
Total Citations
View Citations
193
Total Downloads

Downloads (Last 12 months)5
Downloads (Last 6 weeks)0

Reflects downloads up to 26 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Gomaa AMahdy BKleer NKrüger A(2024)Towards a Surgeon-in-the-Loop Ophthalmic Robotic Apprentice using Reinforcement and Imitation Learning2024 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)10.1109/IROS58592.2024.10802574(6939-6946)Online publication date: 14-Oct-2024
https://doi.org/10.1109/IROS58592.2024.10802574
Higa JNkatha SRamirez Herrera RMarcus HYoo SBlandford AOpie J(2024)Augmented reality for endoscopic transsphenoidal surgery: evaluating design factors with neurosurgeonsInternational Journal of Computer Assisted Radiology and Surgery10.1007/s11548-024-03225-920:1(131-136)Online publication date: 26-Jul-2024
https://doi.org/10.1007/s11548-024-03225-9
Afkari HBednarik R(2022)Seize the moment: the role of scrub nurses’ proactivity in microsurgical operating-room collaborationsBehaviour & Information Technology10.1080/0144929X.2022.209379142:10(1640-1657)Online publication date: 26-Jul-2022
https://doi.org/10.1080/0144929X.2022.2093791
Lee ABednarik R(2021)3D Exoscopes in Microsurgery: How 3D Exoscopes Reconfigure the Workflow of Assistant Surgeons and Nurses in the Operating RoomCompanion Publication of the 2021 Conference on Computer Supported Cooperative Work and Social Computing10.1145/3462204.3481760(112-116)Online publication date: 23-Oct-2021
https://dl.acm.org/doi/10.1145/3462204.3481760
Joto AFuchi TNoborio HOnishi KNonaka MJozen T(2021)Construction of a Knowledge Base for Empirical Knowledge in NeurosurgeryHuman-Computer Interaction. Interaction Techniques and Novel Applications10.1007/978-3-030-78465-2_38(521-537)Online publication date: 24-Jul-2021
https://dl.acm.org/doi/10.1007/978-3-030-78465-2_38
Kocur MDechant MLankes MWolff CMandryk R(2020)Eye Caramba: Gaze-based Assistance for Virtual Reality Aiming and Throwing Tasks in GamesACM Symposium on Eye Tracking Research and Applications10.1145/3379156.3391841(1-6)Online publication date: 2-Jun-2020
https://dl.acm.org/doi/10.1145/3379156.3391841
You FKhakhar RPicht TDobbelstein D(2020)VR Simulation of Novel Hands-Free Interaction Concepts for Surgical Robotic Visualization SystemsMedical Image Computing and Computer Assisted Intervention – MICCAI 202010.1007/978-3-030-59716-0_42(440-450)Online publication date: 4-Oct-2020
https://dl.acm.org/doi/10.1007/978-3-030-59716-0_42
Eivazi SMaurer MSharif BKrejtz K(2018)EyemicProceedings of the 2018 ACM Symposium on Eye Tracking Research & Applications10.1145/3204493.3208342(1-2)Online publication date: 14-Jun-2018
https://dl.acm.org/doi/10.1145/3204493.3208342
Afkari Hde Gómez Pérez DBednarik R(2018)Command Selection in Gaze-based See-through Virtual Image-Guided EnvironmentsProceedings of the 9th Augmented Human International Conference10.1145/3174910.3174940(1-8)Online publication date: 6-Feb-2018
https://dl.acm.org/doi/10.1145/3174910.3174940
Eivazi SFuhl WKasneci EPapadopoulos GKuflik TChen FDuarte CFu W(2017)Towards Intelligent Surgical MicroscopeCompanion Proceedings of the 22nd International Conference on Intelligent User Interfaces10.1145/3030024.3038269(69-72)Online publication date: 7-Mar-2017
https://dl.acm.org/doi/10.1145/3030024.3038269
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten