skip to main content
10.1145/3229434.3229459acmconferencesArticle/Chapter ViewAbstractPublication PagesmobilehciConference Proceedingsconference-collections
research-article

Workaholistic: on balancing typing- and handover-performance in automated driving

Published: 03 September 2018 Publication History

Abstract

Automated driving eliminates the permanent need for vehicle control and allows to engage in non-driving related tasks. As literature identifies office work as one potential activity, we estimate that advanced input devices will shortly appear in automated vehicles. To address this matter, we mounted a keyboard on the steering wheel, aiming to provide an exemplary safe and productive working environment. In a driving simulator study (n=20), we evaluated two feedback mechanisms (heads-up augmentation on a windshield, conventional heads-down display) and assessed both typing effort and driving performance in handover situations. Results indicate that the windshield alternative positively influences handovers, while heads-down feedback results in better typing performance. Text difficulty (two levels) showed no significant impact on handover time. We conclude that for a widespread acceptance of specialized interfaces for automated vehicles, a balance between safety aspects and productivity must be found in order to attract customers while retaining driving safety.

References

[1]
J Charles Alderson. 2007. The CEFR and the need for more research. The Modern Language Journal 91, 4 (2007), 659--663.
[2]
Ahmed Sabbir Arif and Wolfgang Stuerzlinger. 2009. Analysis of text entry performance metrics. In 2009 IEEE Toronto International Conference Science and Technology for Humanity (TIC-STH). IEEE, 100--105.
[3]
LN Boyle, JD Lee, Y Peng, M Ghazizadeh, Y Wu, E Miller, and J Jenness. 2013a. Text reading and text input assessment in support of the NHTSA visual-manual driver distraction guidelines. Technical Report.
[4]
L N Boyle, J D Lee, Y Peng, M Ghazizadeh, Y Wu, E Miller, and J Jenness. 2013b. Text Reading and Text Input Assessment in Support of the NHTSA Visual-Manual Driver Distraction Guidelines. Technical Report. https://trid.trb.org/view.aspx?id=1261507
[5]
Gary Bradski. 2000. The OpenCV Library. Dr. Dobb's Journal: Software Tools for the Professional Programmer 25, 11 (2000), 120--123.
[6]
Barry Brown and Eric Laurier. 2017. The Trouble with Autopilots. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems - CHI '17. ACM Press, New York, New York, USA, 416--429.
[7]
Heiner Bubb, Klaus Bengler, Rainer E. Grünen, and Mark Vollrath. 2015. Automobilergonomie. Springer International Publishing. 663--684 pages.
[8]
SAE On-Road Automated Vehicle Standards Committee. 2014. Taxonomy and definitions for terms related to on-road motor vehicle automated driving systems. (2014).
[9]
Joseph M Crandall and Alex Chaparro. 2012a. Driver distraction: Effects of text entry methods on driving performance. In Proceedings of the human factors and ergonomics society annual meeting, Vol. 56. Sage Publications Sage CA: Los Angeles, CA, 1693--1697.
[10]
Joseph M. Crandall and Alex Chaparro. 2012b. Driver Distraction: Effects of Text Entry Methods on Driving Performance. Proceedings of the Human Factors and Ergonomics Society Annual Meeting 56, 1 (sep 2012), 1693--1697.
[11]
Fred Davidson and Glenn Fulcher. 2007. The Common European Framework of Reference (CEFR) and the design of language tests: A matter of effect. Language Teaching 40, 3 (2007), 231--241.
[12]
Fred D Davis. 1985. A technology acceptance model for empirically testing new end-user information systems: Theory and results. Ph.D. Dissertation. Massachusetts Institute of Technology.
[13]
Nicola Dell, Vidya Vaidyanathan, Indrani Medhi, Edward Cutrell, and William Thies. 2012. "Yours is better!": Participant response bias in HCI. Proceedings of the 2012 ACM annual conference on Human Factors in Computing Systems - CHI '12 (2012), 1321--1330.
[14]
Charlotte Eost and Margaret Galer Flyte. 1998. An investigation into the use of the car as a mobile office. Applied Ergonomics 29, 5 (1998), 383--388.
[15]
Sergio Garrido-Jurado, Rafael Muñoz-Salinas, Francisco José Madrid-Cuevas, and Manuel Jesús Marín-Jiménez. 2014. Automatic generation and detection of highly reliable fiducial markers under occlusion. Pattern Recognition 47, 6 (2014), 2280--2292.
[16]
Christian Gold, Daniel Damböck, Lutz Lorenz, and Klaus Bengler. 2013. "Take over!" How long does it take to get the driver back into the loop?. In Proceedings of the Human Factors and Ergonomics Society Annual Meeting, Vol. 57. SAGE Publications Sage CA: Los Angeles, CA, 1938--1942.
[17]
Christian Gold, Frederik Naujoks, Jonas Radlmayr, Hanna Bellem, and Oliver Jarosch. 2017. Testing Scenarios for Human Factors Research in Level 3 Automated Vehicles. In International Conference on Applied Human Factors and Ergonomics. Springer, 551--559.
[18]
Sandra G. Hart and Lowell E. Staveland. 1988. Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research. 139--183.
[19]
Renate Häuslschmid, Sven Osterwald, Marcus Lang, and Andreas Butz. 2015. Augmenting the Driver's View with Peripheral Information on a Windshield Display. In Proceedings of the 20th International Conference on Intelligent User Interfaces. ACM, 311--321.
[20]
Jani Heikkinen, Erno Mäkinen, Jani Lylykangas, Toni Pakkanen, Kaisa Väänänen-Vainio-Mattila, and Roope Raisamo. 2013. Mobile devices as infotainment user interfaces in the car. In Proceedings of the 15th international conference on Human-computer interaction with mobile devices and services - MobileHCI '13. ACM Press, New York, New York, USA, 137.
[21]
Jan H Hulstijn. 2007. The shaky ground beneath the CEFR: Quantitative and qualitative dimensions of language proficiency. The Modern Language Journal 91, 4 (2007), 663--667.
[22]
SAE International. 2015. Surface Vehicle Recommended Practice - Operational Definitions of Driving Performance Measures and Statistics. SAE International J2944, 2015--06 (2015). http://standards.sae.org/j2944
[23]
ISO. 2012. ISO 9241-410 Ergonomics of human-system interaction - Part 410: Design criteria for physical input devices. (2012).
[24]
ISO/TC 159/SC 4. 2007. ISO 9241-3: Ergonomics of human-system interaction - Part 400: Principles and requirements for physical input devices. Technical Report. ISO. https://www.iso.org/obp/ui/
[25]
Neil Jones and Nick Saville. 2009. EUROPEAN LANGUAGE POLICY: ASSESSMENT, LEARNING, AND THE CEFR. Annual Review of Applied Linguistics 29 (2009), 51--63.
[26]
I Karl, G Berg, F Ruger, and B Farber. 2013. Driving Behavior and Simulator Sickness While Driving the Vehicle in the Loop: Validation of Longitudinal Driving Behavior. IEEE Intelligent Transportation Systems Magazine 5, 1 (2013), 42--57.
[27]
Robert S Kennedy, Norman E Lane, Kevin S Berbaum, and Michael G Lilienthal. 1993. Simulator sickness questionnaire: An enhanced method for quantifying simulator sickness. The international journal of aviation psychology 3, 3 (1993), 203--220.
[28]
Dagmar Kern, Albrecht Schmidt, Jonas Arnsmann, Thorsten Appelmann, Nillakshi Pararasasegaran, and Benjamin Piepiera. 2009a. Writing to your car: handwritten text input while driving. In CHI'09 Extended Abstracts on Human Factors in Computing Systems. ACM, 4705--4710.
[29]
Dagmar Kern, Albrecht Schmidt, Jonas Arnsmann, Thorsten Appelmann, Nillakshi Pararasasegaran, and Benjamin Piepiera. 2009b. Writing to your car: handwritten text input while driving. Proceedings of the 27th international conference extended abstracts on Human factors in computing systems - CHI EA '09 (2009), 4705.
[30]
Gwendolin Knappe, Andreas Keinath, Klaus Bengler, Cristina Meinecke, and Friedrich Alexander. 2007. Driving simulators as an evaluation tool - assessment of the influence of field of view and secondary tasks on lane keeping and steering performance. Proceedings of the International Technical Conference on the Enhanced Safety of Vehicles (2007), 1--11.
[31]
Kraftfahrt Bundesamt. 2017. Jahresbilanz der Neuzulassungen 2016. (2017). https://www.kba.de/DE/Statistik/Fahrzeuge/Neuzulassungen/neuzulassungen_node.html.
[32]
Andrew L. Kun, Jerry Wachtel, W. Thomas Miller, Patrick Son, and Martin Lavallière. 2015. User Interfaces for First Responder Vehicles: Views from Practitioners, Industry, and Academia. In Proceedings of the 7th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI '15). ACM, New York, NY, USA, 163--170.
[33]
Yung-Ching Liu. 2003. Effects of using head-up display in automobile context on attention demand and driving performance. Displays 24, 4 (2003), 157--165.
[34]
Lutz Lorenz, Philipp Kerschbaum, and Josef Schumann. 2014. Designing take over scenarios for automated driving. Proceedings of the Human Factors and Ergonomics Society Annual Meeting 58, 1 (2014), 1681--1685.
[35]
G Marrkula and J Engström. 2006. A steering wheel reversal rate metric for assessing effects of visual and cognitive secondary task load. In PROCEEDINGS OF THE 13th ITS WORLD CONGRESS, LONDON, 8--12 OCTOBER 2006.
[36]
Andrii Matviienko, Andreas Löcken, Abdallah El Ali, Wilko Heuten, and Susanne Boll. 2016. NaviLight : investigating ambient light displays for turn-by-turn navigation in cars. In Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services - MobileHCI '16. ACM Press, New York, New York, USA, 283--294.
[37]
Anne T McCartt, David G Kidd, and Eric R Teoh. 2014. Driver cellphone and texting bans in the United States: evidence of effectiveness. Annals of Advances in Automotive Medicine 58 (2014), 99.
[38]
Zeljko Medenica, Andrew L Kun, Tim Paek, and Oskar Palinko. 2011. Augmented reality vs. street views: a driving simulator study comparing two emerging navigation aids. In Proceedings of the 13th International Conference on Human Computer Interaction with Mobile Devices and Services. ACM, 265--274.
[39]
Vivien Melcher, Stefan Rauh, Frederik Diederichs, Harald Widlroither, and Wilhelm Bauer. 2015. Take-Over Requests for Automated Driving. Procedia Manufacturing 3 (2015).
[40]
Smith Missie, Joseph L Gabbard, and Christian Conley. 2016. Head - Up vs . Head - Down Displays : Examining Traditional Methods of Display Assessment While Driving. Automotive User Interfaces and Interactive Vehicular Applications (AutoUI) (2016), 185--192. http://www.auto-ui.org/16/wp-content/uploads/2016/10/00-proceedings-final-v03-reduced.pdf
[41]
Ronald R Mourant and Thara R Thattacherry. 2000. Simulator sickness in a virtual environments driving simulator. In Proceedings of the human factors and ergonomics society annual meeting, Vol. 44. SAGE Publications Sage CA: Los Angeles, CA, 534--537.
[42]
Martin Murer, David Wilfinger, Alexander Meschtscherjakov, Sebastian Osswald, and Manfred Tscheligi. 2012a. Exploring the back of the steering wheel. In Proceedings of the 4th International Conference on Automotive User Interfaces and Interactive Vehicular Applications - AutomotiveUI '12. ACM Press, New York, New York, USA, 117.
[43]
Martin Murer, David Wilfinger, Alexander Meschtscherjakov, Sebastian Osswald, and Manfred Tscheligi. 2012b. Exploring the back of the steering wheel: Text input with hands on the wheel and eyes on the road. In Proceedings of the 4th International Conference on Automotive User Interfaces and Interactive Vehicular Applications. ACM, 117--120.
[44]
Nicole Perterer, Christiane Moser, Alexander Meschtscherjakov, Alina Krischkowsky, and Manfred Tscheligi. 2016. Activities and Technology Usage while Driving: A Field Study with Private Short-Distance Car Commuters. In Proceedings of the 9th Nordic Conference on Human-Computer Interaction. ACM, 41.
[45]
Sebastiaan Petermeijer, Pavlo Bazilinskyy, Klaus Bengler, and Joost De Winter. 2017. Take-over again: Investigating multimodal and directional TORs to get the driver back into the loop. Applied Ergonomics 62, July 2017 (2017), 204--215.
[46]
Bastian Pfleging, Andrew L. Kun, and Nora Broy. 2017. The car as an environment for mobile devices. In Proceedings of the 19th International Conference on Human-Computer Interaction with Mobile Devices and Services - MobileHCI '17. ACM Press, New York, New York, USA, 1--5.
[47]
Bastian Pfleging, Maurice Rang, and Nora Broy. 2016. Investigating user needs for non-driving-related activities during automated driving. In Proceedings of the 15th International Conference on Mobile and Ubiquitous Multimedia. ACM, 91--99.
[48]
Jonas Radlmayr, Christian Gold, Lutz Lorenz, Mehdi Farid, and Klaus Bengler. 2014. How traffic situations and non-driving related tasks affect the take-over quality in highly automated driving. In Proceedings of the Human Factors and Ergonomics Society Annual Meeting, Vol. 58. Sage Publications Sage CA: Los Angeles, CA, 2063--2067.
[49]
Andreas Riener and Alois Ferscha. 2013. Enhancing Future Mass ICT with Social Capabilities. In Co-evolution of Intelligent Socio-technical Systems. Number April. Springer, Berlin, Heidelberg, 141--184.
[50]
Kyle Saginus, Richard Wyatt, and Jeremy Wilzbacher. 2011b. Roadside Office Ergonomics: Laptop Use in Vehicles. (2011). http://www.consulting.aon.com/attachments/risk-services/Roadside_Office_Ergonomics.pdf
[51]
Kyle A Saginus, Richard W Marklin, Patricia Seeley, Guy G Simoneau, and Stephen Freier. 2011a. Biomechanical effects of mobile computer location in a vehicle cab. Human factors 53, 5 (2011), 474--488.
[52]
Missie Smith, Joseph L Gabbard, and Christian Conley. 2016. Head-Up vs. Head-Down Displays: Examining Traditional Methods of Display Assessment While Driving. In Proceedings of the 8th International Conference on Automotive User Interfaces and Interactive Vehicular Applications. ACM, 185--192.
[53]
Gabriela Villalobos-zúñiga, Tuomo Kujala, and Antti Oulasvirta. 2016. T9 + HUD : Physical Keypad and HUD can Improve Driving Performance while Typing and Driving. Automotive User Interfaces and Interactive Vehicular Applications (AutoUI) (2016), 177--184. http://www.auto-ui.org/16/wp-content/uploads/2016/10/00-proceedings-final-v03-reduced.pdf
[54]
Gabriela Villalobos-Zúñiga, Tuomo Kujala, and Antti Oulasvirta. 2016. T9+ HUD: Physical Keypad and HUD can Improve Driving Performance while Typing and Driving. In Proceedings of the 8th International Conference on Automotive User Interfaces and Interactive Vehicular Applications. ACM, 177--184.
[55]
Marcel Walch, Kristin Mühl, and Martin Baumann. 2017. Autonomous Driving: Investigating the Feasibility of Bimodal {Take-Over} Requests. International Journal of Mobile Human Computer Interaction 9, 2 (2017), 58--74.
[56]
Garrett Weinberg, Bret Harsham, and Zeljko Medenica. 2011. Evaluating the usability of a head-up display for selection from choice lists in cars. In Proceedings of the 3rd International Conference on Automotive User Interfaces and Interactive Vehicular Applications. ACM, 39--46.
[57]
Philipp Wintersberger, Paul Green, and Andreas Riener. 2016. Am I Driving or Are You are Or We Both? A Taxonomy For Handover and Handback in Automated Driving. Power (2016), 1--7.
[58]
Mark S Young, Neville A Stanton, and Don Harris. 2007. Driving automation: learning from aviation about design philosophies. International Journal of Vehicle Design 45, 3 (2007), 323--338.
[59]
Kathrin Zeeb, Axel Buchner, and Michael Schrauf. 2015. What determines the take-over time? An integrated model approach of driver take-over after automated driving. Accident Analysis & Prevention 78 (2015), 212--221.

Cited By

View all
  • (2023)2nd Workshop on Automotive Mixed Reality Applications: Transitional Interfaces, Immersive Driving Experiences, and Helmet-Mounted AR for Future MobilityAdjunct Proceedings of the 15th International Conference on Automotive User Interfaces and Interactive Vehicular Applications10.1145/3581961.3609832(219-222)Online publication date: 18-Sep-2023
  • (2022)Towards Personalized 3D Augmented Reality Windshield Displays in the Context of Automated DrivingFrontiers in Future Transportation10.3389/ffutr.2022.8106983Online publication date: 3-Feb-2022
  • (2022)Workshop on Automotive Mixed Reality Applications: Transitional Interfaces, Multi-User VR, and Helmet-Mounted AR for CyclistsAdjunct Proceedings of the 14th International Conference on Automotive User Interfaces and Interactive Vehicular Applications10.1145/3544999.3550158(172-175)Online publication date: 17-Sep-2022
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
MobileHCI '18: Proceedings of the 20th International Conference on Human-Computer Interaction with Mobile Devices and Services
September 2018
552 pages
ISBN:9781450358989
DOI:10.1145/3229434
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 03 September 2018

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. augmented reality
  2. automated driving
  3. handover/take-over requests
  4. non-driving related tasks
  5. typing
  6. windshield displays

Qualifiers

  • Research-article

Funding Sources

  • German Federal Ministry of Education and Research (BMBF)

Conference

MobileHCI '18
Sponsor:

Acceptance Rates

Overall Acceptance Rate 202 of 906 submissions, 22%

Upcoming Conference

MobileHCI '24
26th International Conference on Mobile Human-Computer Interaction
September 30 - October 3, 2024
Melbourne , VIC , Australia

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)30
  • Downloads (Last 6 weeks)0
Reflects downloads up to 15 Sep 2024

Other Metrics

Citations

Cited By

View all
  • (2023)2nd Workshop on Automotive Mixed Reality Applications: Transitional Interfaces, Immersive Driving Experiences, and Helmet-Mounted AR for Future MobilityAdjunct Proceedings of the 15th International Conference on Automotive User Interfaces and Interactive Vehicular Applications10.1145/3581961.3609832(219-222)Online publication date: 18-Sep-2023
  • (2022)Towards Personalized 3D Augmented Reality Windshield Displays in the Context of Automated DrivingFrontiers in Future Transportation10.3389/ffutr.2022.8106983Online publication date: 3-Feb-2022
  • (2022)Workshop on Automotive Mixed Reality Applications: Transitional Interfaces, Multi-User VR, and Helmet-Mounted AR for CyclistsAdjunct Proceedings of the 14th International Conference on Automotive User Interfaces and Interactive Vehicular Applications10.1145/3544999.3550158(172-175)Online publication date: 17-Sep-2022
  • (2022)Gesture and Voice Commands to Interact With AR Windshield Display in Automated Vehicle: A Remote Elicitation StudyProceedings of the 14th International Conference on Automotive User Interfaces and Interactive Vehicular Applications10.1145/3543174.3545257(171-182)Online publication date: 17-Sep-2022
  • (2022)A Lab-Based Investigation of Reaction Time and Reading Performance using Different In-Vehicle Reading Interfaces during Self-DrivingProceedings of the 14th International Conference on Automotive User Interfaces and Interactive Vehicular Applications10.1145/3543174.3545254(96-107)Online publication date: 17-Sep-2022
  • (2022)Multimodal Error Correction for Speech-to-Text in a Mobile Office Automated Vehicle: Results From a Remote StudyProceedings of the 27th International Conference on Intelligent User Interfaces10.1145/3490099.3511131(496-505)Online publication date: 22-Mar-2022
  • (2022)Content Presentation on 3D Augmented Reality Windshield Displays in the Context of Automated Driving2022 IEEE Conference on Virtual Reality and 3D User Interfaces (VR)10.1109/VR51125.2022.00074(543-552)Online publication date: Mar-2022
  • (2022)Incorporating Situation Awareness Cues in Virtual Reality for Users in Dynamic in-Vehicle EnvironmentsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2022.320308628:11(3865-3873)Online publication date: Nov-2022
  • (2022)How drowsiness and distraction can interfere with take-over performance: A systematic and meta-analysis reviewAccident Analysis & Prevention10.1016/j.aap.2021.106536170(106536)Online publication date: Jun-2022
  • (2022)When terminology hinders research: the colloquialisms of transitions of control in automated drivingCognition, Technology & Work10.1007/s10111-022-00705-324:3(509-520)Online publication date: 6-Jun-2022
  • Show More Cited By

View Options

Get Access

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media