research-article

Evaluating Effects of Cognitive Load, Takeover Request Lead Time, and Traffic Density on Drivers’ Takeover Performance in Conditionally Automated Driving

Authors:

Elizabeth Pulver,

Dawn M. Tilbury,

Lionel P. Robert,

Anuj K. Pradhan,

X. Jessie YangAuthors Info & Claims

AutomotiveUI '20: 12th International Conference on Automotive User Interfaces and Interactive Vehicular Applications

Pages 66 - 73

https://doi.org/10.1145/3409120.3410666

Published: 20 September 2020 Publication History

Abstract

In conditionally automated driving, drivers engaged in non-driving related tasks (NDRTs) have difficulty taking over control of the vehicle when requested. This study aimed to examine the relationships between takeover performance and drivers’ cognitive load, takeover request (TOR) lead time, and traffic density. We conducted a driving simulation experiment with 80 participants, where they experienced 8 takeover events. For each takeover event, drivers’ subjective ratings of takeover readiness, objective measures of takeover timing and quality, and NDRT performance were collected. Results showed that drivers had lower takeover readiness and worse performance when they were in high cognitive load, short TOR lead time, and heavy oncoming traffic density conditions. Interestingly, if drivers had low cognitive load, they paid more attention to driving environments and responded more quickly to takeover requests in high oncoming traffic conditions. The results have implications for the design of in-vehicle alert systems to help improve takeover performance.

References

[1]

Jackie Ayoub, Feng Zhou, Shan Bao, and X Jessie Yang. 2019. From Manual Driving to Automated Driving: A Review of 10 Years of AutoUI. In Proceedings of the 11th International Conference on Automotive User Interfaces and Interactive Vehicular Applications. 70–90.

Digital Library

[2]

Su Jin Baek, Hanna Yun, and Ji Hyun Yang. 2019. How do humans respond when automated vehicles request an immediate vehicle control take-over?. In Proceedings of the 11th International Conference on Automotive User Interfaces and Interactive Vehicular Applications: Adjunct Proceedings. 341–345.

Digital Library

[3]

Omar Bagdadi and András Várhelyi. 2011. Jerky driving—an indicator of accident proneness?Accident Analysis & Prevention 43, 4 (2011), 1359–1363.

[4]

Omar Bagdadi and András Várhelyi. 2013. Development of a method for detecting jerks in safety critical events. Accident Analysis & Prevention 50 (2013), 83–91.

[5]

Richard Bishop. 2019. Is 2020 The Year For Eyes-Off Automated Driving?Forbes (2019). https://www.forbes.com/sites/richardbishop1/2019/10/01/is-2020-the-year-for-eyes-off-automated-driving

[6]

M Bueno, E Dogan, F Hadj Selem, E Monacelli, S Boverie, and A Guillaume. 2016. How different mental workload levels affect the take-over control after automated driving. In 2016 IEEE 19th International Conference on Intelligent Transportation Systems (ITSC). IEEE, 2040–2045.

Digital Library

[7]

Na Du, Feng Zhou, Elizabeth Pulver, Dawn M Tilbury, Lionel P Robert, Anuj K Pradhan, and X Jessie Yang. 2020. Examining the Effects of Emotional Valence and Arousal on Takeover Performance in Conditionally Automated Driving. Transportation research part C: emerging technologies 112 (2020), 78–87.

[8]

Alexander Eriksson, Sebastiaan M Petermeijer, Markus Zimmermann, Joost CF De Winter, Klaus J Bengler, and Neville A Stanton. 2018. Rolling out the red (and green) carpet: supporting driver decision making in automation-to-manual transitions. IEEE Transactions on Human-Machine Systems 49, 1 (2018), 20–31.

[9]

Fred Feng, Shan Bao, James R Sayer, Carol Flannagan, Michael Manser, and Robert Wunderlich. 2017. Can vehicle longitudinal jerk be used to identify aggressive drivers? An examination using naturalistic driving data. Accident Analysis & Prevention 104 (2017), 125–136.

[10]

Christian Gold, Daniel Damböck, Lutz Lorenz, and Klaus Bengler. 2013. “Take over!” How long does it take to get the driver back into the loop?. In Proceedings of the Human Factors and Ergonomics Society Annual Meeting, Vol. 57. SAGE Publications Sage CA: Los Angeles, CA, 1938–1942.

[11]

Christian Gold, Riender Happee, and Klaus Bengler. 2018. Modeling take-over performance in level 3 conditionally automated vehicles. Accident Analysis and Prevention 116 (nov 2018), 3–13. https://doi.org/10.1016/j.aap.2017.11.009

[12]

Christian Gold, Moritz Körber, David Lechner, and Klaus Bengler. 2016. Taking over control from highly automated vehicles in complex traffic situations: the role of traffic density. Human factors 58, 4 (2016), 642–652.

[13]

John C Hayward. 1972. Near miss determination through use of a scale of danger. (1972).

[14]

Quanan Huang and Huiyi Wang. 2004. Fundamental study of jerk: evaluation of shift quality and ride comfort. Technical Report. SAE Technical Paper.

[15]

IORS. 2012. Road vehicles-Ergonomic aspects of transport information and control systems-Calibration tasks for methods which assess driver demand due to the use of in-vehicle systems. ISO/TS 14198:2012. (2012).

[16]

Susanne M Jaeggi, Martin Buschkuehl, John Jonides, and Walter J Perrig. 2008. Improving fluid intelligence with training on working memory. Proceedings of the National Academy of Sciences 105, 19(2008), 6829–6833.

[17]

Jeamin Koo, Dongjun Shin, Martin Steinert, and Larry Leifer. 2016. Understanding driver responses to voice alerts of autonomous car operations. International journal of vehicle design 70, 4 (2016), 377–392.

[18]

Moritz Körber, Christian Gold, David Lechner, and Klaus Bengler. 2016. The influence of age on the take-over of vehicle control in highly automated driving. Transportation research part F: traffic psychology and behaviour 39 (2016), 19–32.

[19]

T Louw, G Kountouriotis, O Carsten, and N Merat. 2015. Driver Inattention During Vehicle Automation: How Does Driver Engagement Affect Resumption Of Control?(2015).

[20]

Anthony D McDonald, Hananeh Alambeigi, Johan Engström, Gustav Markkula, Tobias Vogelpohl, Jarrett Dunne, and Norbert Yuma. 2019. Toward computational simulations of behavior during automated driving takeovers: A review of the empirical and modeling literatures. Human factors 61, 4 (2019), 642–688.

[21]

David Miller, Mishel Johns, Brian Mok, Nikhil Gowda, David Sirkin, Key Lee, and Wendy Ju. 2016. Behavioral measurement of trust in automation: the trust fall. In Proceedings of the Human Factors and Ergonomics Society Annual Meeting, Vol. 60. SAGE Publications Sage CA: Los Angeles, CA, 1849–1853.

[22]

Brian Mok, Mishel Johns, Key Jung Lee, David Miller, David Sirkin, Page Ive, and Wendy Ju. 2015. Emergency, automation off: Unstructured transition timing for distracted drivers of automated vehicles. In 2015 IEEE 18th International Conference on Intelligent Transportation Systems. IEEE, 2458–2464.

Digital Library

[23]

Lisa J Molnar, Lindsay H Ryan, Anuj K Pradhan, David W Eby, Renée M St Louis, and Jennifer S Zakrajsek. 2018. Understanding trust and acceptance of automated vehicles: An exploratory simulator study of transfer of control between automated and manual driving. Transportation research part F: traffic psychology and behaviour 58 (2018), 319–328.

[24]

Luke Petersen, Lionel Robert, Jessie Yang, and Dawn Tilbury. 2019. Situational awareness, driver’s trust in automated driving systems and secondary task performance. SAE International Journal of Connected and Autonomous Vehicles, 2(2).

[25]

Ioannis Politis, Stephen Brewster, and Frank Pollick. 2013. Evaluating multimodal driver displays of varying urgency. In Proceedings of the 5th International Conference on Automotive User Interfaces and Interactive Vehicular Applications. 92–99.

Digital Library

[26]

Jonas Radlmayr, Christian Gold, Lutz Lorenz, Mehdi Farid, and Klaus Bengler. 2014. How traffic situations and non-driving related tasks affect the take-over quality in highly automated driving. In Proceedings of the human factors and ergonomics society annual meeting, Vol. 58. Sage Publications Sage CA: Los Angeles, CA, 2063–2067.

[27]

Tara Rezvani, Katherine Driggs-Campbell, Dorsa Sadigh, S Shankar Sastry, Sanjit A Seshia, and Ruzena Bajcsy. 2016. Towards trustworthy automation: User interfaces that convey internal and external awareness. In 2016 IEEE 19th International Conference on Intelligent Transportation Systems (ITSC). IEEE, 682–688.

[28]

Society of Automotive Engineers. 2018. Taxonomy and Definitions for Terms Related to On-Road Motor Vehicle Automated Driving Systems.

[29]

Arie P van den Beukel and Mascha C van der Voort. 2013. The influence of time-criticality on situation awareness when retrieving human control after automated driving. In 16th International IEEE Conference on Intelligent Transportation Systems (ITSC 2013). IEEE, 2000–2005.

[30]

Marcel Walch, Kristin Lange, Martin Baumann, and Michael Weber. 2015. Autonomous driving: investigating the feasibility of car-driver handover assistance. In Proceedings of the 7th international conference on automotive user interfaces and interactive vehicular applications. 11–18.

Digital Library

[31]

Jingyan Wan and Changxu Wu. 2018. The Effects of Lead Time of Take-Over Request and Nondriving Tasks on Taking-Over Control of Automated Vehicles. IEEE Transactions on Human-Machine Systems99 (2018), 1–10.

[32]

Bernhard Wandtner, Nadja Schömig, and Gerald Schmidt. 2018. Effects of non-driving related task modalities on takeover performance in highly automated driving. Human factors 60, 6 (2018), 870–881.

[33]

Kathrin Zeeb, Axel Buchner, and Michael Schrauf. 2016. Is take-over time all that matters? The impact of visual-cognitive load on driver take-over quality after conditionally automated driving. Accident analysis & prevention 92 (2016), 230–239.

[34]

Kathrin Zeeb, Manuela Härtel, Axel Buchner, and Michael Schrauf. 2017. Why is steering not the same as braking? The impact of non-driving related tasks on lateral and longitudinal driver interventions during conditionally automated driving. Transportation research part F: traffic psychology and behaviour 50 (2017), 65–79.

[35]

Feng Zhou, X Jessie Yang, and Xin Zhang. 2019. Takeover Transition in Autonomous Vehicles: A YouTube Study. International Journal of Human–Computer Interaction 0, 0(2019), 1–12. https://doi.org/10.1080/10447318.2019.1634317

Cited By

Wang CXu CShao YZheng NPeng CTong HXu Z(2025)Identifying factors affecting driver takeover time and crash risk during the automated driving takeover processJournal of Transportation Safety & Security10.1080/19439962.2025.2450695(1-26)Online publication date: 10-Jan-2025
https://doi.org/10.1080/19439962.2025.2450695
Guo HQiu HZhou YDeng Y(2024)Analysis of Influencing Factors of Level 3 Automated Vehicle Takeover: A Literature ReviewSustainability10.3390/su1619834516:19(8345)Online publication date: 25-Sep-2024
https://doi.org/10.3390/su16198345
Baş Kaman FOlmuş H(2024)Statistical Approaches Used in Studies Evaluating the Reliability of Autonomous Vehicles Based on Disengagements and Reaction TimesInternational Journal of Automotive Science And Technology10.30939/ijastech..14800568:3(279-287)Online publication date: 30-Sep-2024
https://doi.org/10.30939/ijastech..1480056
Show More Cited By

Recommendations

Predicting Takeover Performance in Conditionally Automated Driving
CHI EA '20: Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems

In conditionally automated driving, drivers decoupled from operational control of the vehicle have difficulty taking over control when requested. To address this challenge, we conducted a human-in-the-loop experiment wherein the drivers needed to take ...
Designing Alert Systems in Takeover Transitions: The Effects of Display Information and Modality
AutomotiveUI '21: 13th International Conference on Automotive User Interfaces and Interactive Vehicular Applications

In conditionally automated driving, in-vehicle alert systems can provide drivers with information to assist their takeovers from automated driving. This study investigated how display modality and information influenced drivers’ acceptance of the in-...
Manual takeover after highly automated driving: Influence of budget time and Lane Change Assist on takeover performance
ECCE '21: Proceedings of the 32nd European Conference on Cognitive Ergonomics

The current study aimed at investigating the effectiveness of additional assistance system to support driver performance during a takeover request in a conditionally automated vehicle, that is, Level 3 of SAE taxonomy. Seventy drivers participated in ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

AutomotiveUI '20: 12th International Conference on Automotive User Interfaces and Interactive Vehicular Applications

September 2020

300 pages

ISBN:9781450380652

DOI:10.1145/3409120

Copyright © 2020 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 20 September 2020

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

AutomotiveUI '20

Sponsor:

SIGCHI

AutomotiveUI '20: 12th International Conference on Automotive User Interfaces and Interactive Vehicular Applications

September 21 - 22, 2020

DC, Virtual Event, USA

Acceptance Rates

Overall Acceptance Rate 248 of 566 submissions, 44%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

38
Total Citations
View Citations
1,158
Total Downloads

Downloads (Last 12 months)241
Downloads (Last 6 weeks)15

Reflects downloads up to 13 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Wang CXu CShao YZheng NPeng CTong HXu Z(2025)Identifying factors affecting driver takeover time and crash risk during the automated driving takeover processJournal of Transportation Safety & Security10.1080/19439962.2025.2450695(1-26)Online publication date: 10-Jan-2025
https://doi.org/10.1080/19439962.2025.2450695
Guo HQiu HZhou YDeng Y(2024)Analysis of Influencing Factors of Level 3 Automated Vehicle Takeover: A Literature ReviewSustainability10.3390/su1619834516:19(8345)Online publication date: 25-Sep-2024
https://doi.org/10.3390/su16198345
Baş Kaman FOlmuş H(2024)Statistical Approaches Used in Studies Evaluating the Reliability of Autonomous Vehicles Based on Disengagements and Reaction TimesInternational Journal of Automotive Science And Technology10.30939/ijastech..14800568:3(279-287)Online publication date: 30-Sep-2024
https://doi.org/10.30939/ijastech..1480056
Stampf ASasalovici MMeinhardt LColley MGiss MRukzio E(2024)Move, Connect, Interact: Introducing a Design Space for Cross-Traffic InteractionProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36785808:3(1-40)Online publication date: 9-Sep-2024
https://dl.acm.org/doi/10.1145/3678580
Ding YJia LDu N(2024)One Size Does Not Fit All: Designing and Evaluating Criticality-Adaptive Displays in Highly Automated VehiclesProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642648(1-15)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642648
Gu YWeng YWang YWang MZhuang GHuang JPeng XLuo LRen F(2024)EmoTake: Exploring Drivers’ Emotion for Takeover Behavior PredictionIEEE Transactions on Affective Computing10.1109/TAFFC.2024.339932815:4(2112-2127)Online publication date: Oct-2024
https://doi.org/10.1109/TAFFC.2024.3399328
Li YYao MFang ZZhang QWang JYin G(2024)Analysis of the Impact of Traffic Hazard Scenarios on the Driver's Take-over Behavior of Autonomous Vehicle2024 8th CAA International Conference on Vehicular Control and Intelligence (CVCI)10.1109/CVCI63518.2024.10830166(1-6)Online publication date: 25-Oct-2024
https://doi.org/10.1109/CVCI63518.2024.10830166
Lin ZChen F(2024)How various urgencies and visibilities influence drivers’ takeover performance in critical car-following conditions? A driving simulation studyTransportation Research Part F: Traffic Psychology and Behaviour10.1016/j.trf.2024.06.007104(303-317)Online publication date: Jul-2024
https://doi.org/10.1016/j.trf.2024.06.007
Chen HZhao XLi HGong JFu Q(2024)Predicting driver’s takeover time based on individual characteristics, external environment, and situation awarenessAccident Analysis & Prevention10.1016/j.aap.2024.107601203(107601)Online publication date: Aug-2024
https://doi.org/10.1016/j.aap.2024.107601
Chen FMa S(2024)Analyzing Takeover Performance in Conditional Driving Automation: Focusing on Takeover Conditions in Which Vehicle Control Can Be Transferred Directly to DriversSmart Transportation and Green Mobility Safety10.1007/978-981-97-3052-0_22(295-307)Online publication date: 29-Sep-2024
https://doi.org/10.1007/978-981-97-3052-0_22
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents