Cited By
View all- Martínez Beltrán EQuiles Pérez MLópez Bernal SMartínez Pérez GHuertas Celdrán A(2022)SAFECARExpert Systems with Applications: An International Journal10.1016/j.eswa.2022.117402203:COnline publication date: 1-Oct-2022
Comparing pupil dilation, head movement, and EEG for distraction detection of drivers
Article No.: 69, Pages 1 - 5
Abstract
This paper investigates the use of pupil dilation, head movement and EEG for detecting distraction and cognitive load of drivers while performing secondary tasks in an automotive environment. We tracked pupil dilation from Tobii Pro Glasses 2, head movement from Kinect and EEG from Emotive Insight system. We have analyzed data using Fast Fourier Transform, Continuous Wavelet Transform, and Discrete Wavelet Transform for the full-length signal as well as in windows of 1 second for real-time implementation. We investigated detection of distraction and cognitive load from three different conditions - free driving, driving with lane change, driving with lane change and operating secondary task for each participant in a driving simulator. Our results show that the pupil dilation, head yaw, and EEG can detect the increase in cognitive load due to operation of secondary task within a time buffer of 1 second which can be adapted for real-time implementation. We have also found that FFT of Pupil dilation shows significant categorization of normal and distracted states than the categorization by DWT which contrasts with state of the art methods. Finally, we have proposed an expert system to alert drivers utilizing the signal processing analysis.
References
[1]
Afzal, S., & Robinson, P. (2009, September). Natural affect data---Collection & annotation in a learning context. In Affective Computing and Intelligent Interaction and Workshops, 2009. ACII 2009. 3rd International Conference on (pp. 1--7). IEEE.
[2]
Basir, O., Bhavnani, J. P., Karray, F., & Desrochers, K. (2004). Drowsiness detection system, US 6822573 B2.
[3]
Biswas, P., & Prabhakar, G. (2018). Detecting drivers' cognitive load from saccadic intrusion. Transportation research part F: traffic psychology and behaviour, 54, 63--78.
[4]
Boril, H., Sadjadi, S. O., & Hansen, J. H. L. (2011). UTDrive: Emotion and cognitive load classification in-vehicle scenarios. In Proceeding of the 5th biennial workshop on DSP for in-vehicle systems.
[5]
Duchowski, A. T., Krejtz, K., Krejtz, I., Biele, C., Niedzielska, A., Kiefer, P., & Giannopoulos, I. (2018, April). The Index of Pupillary Activity: Measuring Cognitive Load vis-à-vis Task Difficulty with Pupil Oscillation. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (p. 282). ACM.
[6]
Gavas, R., Chatterjee, D., and Sinha, A. (2017), "Estimation of cognitive load based on the pupil size dilation," 2017 IEEE International Conference on Systems, Man, and Cybernetics (SMC), Banff, AB, 2017, pp. 1499--1504.
[7]
Healey, J. A., & Picard, R. W. (2011). Detecting stress during real-world driving tasks using physiological sensors. IEEE Transactions on Intelligent Transportation Systems, 6(2), 156--166.
[8]
Hess, E. H. (1975). The tell-tale eye. Van Nostrand Reinhold Company.
[9]
Lee, Y. C., Lee, J. D., & Ng Boyle, L. (2007). Visual attention in driving: the effects of cognitive load and visual disruption. Human Factors, 49(4), 721--733.
[10]
Liang, Y., & Lee, J. D. (2014). A hybrid bayesian network approach to detect driver cognitive ditraction. Transportation Research Part C, 38, 146--155.
[11]
Marshall, S. (2002). The index of cognitive activity: Measuring cognitive workload. In Proc. 7th conference on human factors and power plants (pp. 7--5).
[12]
Marshall, S. (2007). Identifying cognitive state from eye metrics. Aviation, Space, and Environmental Medicine, 78(Suppl. 1), B165--B175.
[13]
Palinko, O., Kun, A. L., Shyrokov, A., Heeman, P., (2010). Estimating cognitive load using remote eye tracking in a driving simulator. In Proceedings of the 2010 symposium on eye-tracking research & applications (pp. 141--144).
[14]
Prabhakar, G., & Biswas, P. (2018). Eye Gaze Controlled Projected Display in Automotive and Military Aviation Environments. Multimodal Technologies and Interaction, 2(1), 1.
[15]
Ranney, T. A., Baldwin, G. H., Smith, L. A., Martin, J., & Mazzae, E. N. (2013). Driver behavior during visual-manual secondary task performance: occlusion method versus simulated driving (No. DOT HS 811 726).
[16]
Redlich, E. (1908). Ueber ein eigenartiges Pupillenphänomen; zugleich ein Beitrag zur Frage der hysterischen Pupillenstarre. Deutsche medizinischeWochenschrift, 34, 313--315.
[17]
Sezgin, T. M., & Robinson, P. (2007, September). Affective video data collection using an automobile simulator. In International Conference on Affective Computing and Intelligent Interaction (pp. 770--771). Springer, Berlin, Heidelberg.
[18]
Tokuda, S., Obinata, G., Palmer, E., & Chaparo, A. (2011). Estimation of mental workload using saccadic eye movements in a free-viewing task. In 23rd international conference of the IEEE EMBS (pp. 4523--4529).
[19]
Westphal, A. (1907). Ueber ein im katatonischen stupor beobachtetes Pupillenphänomen sowie Bemerkungen über die Pupillenstarre bei Hysterie. Deutsche medizinische Wochenschrift, 33, 1080--1084.
[20]
Yoshida, Y., Ohwada, H., Mizoguchi, F., & Iwasaki, H. (2014). Classifying cognitive load and driving situation with machine learning. International Journal of Machine Learning and Computing, 4(3), 210.
[21]
Z. Zeng, M. Pantic, G.I. Roisman, T.S. Huang (2009), "A Survey of Affect Recognition Methods: Audio Visual & Spontaneous Expressions", IEEE Trans. PAMI, vol. 31, no. 1, pp. 39--58.
Recommendations
Combining eye tracking, pupil dilation and EEG analysis for predicting web users click intention
Merging data originated in Pupil dilation and EEG and web user behaviour.Exploring the behaviour of web users from a physiological perspective.Combining web log and physiological originated data for analysing the web user behavior. In this paper a novel ...
Temporal Impact on Cognitive Distraction Detection for Car Drivers using EEG
OzCHI '20: Proceedings of the 32nd Australian Conference on Human-Computer InteractionElectroencephalography (EEG) has the potential to measure a person’s cognitive state, however, we still only have limited knowledge about how well-suited EEG is for recognising cognitive distraction while driving. In this paper, we present DeCiDED, a ...
Advanced EEG Processing for the Detection of Drowsiness in Drivers
BIOSTEC 2014: Proceedings of the International Joint Conference on Biomedical Engineering Systems and Technologies - Volume 4Drowsiness is a serious problem for drivers which causes many accidents every day. It is estimated that drowsiness
is the cause of four deaths and 100 injuries per day in the United States. In this paper two methods have
been developed to detect ...
Comments
Information & Contributors
Information
Published In
July 2018
1509 pages
Publisher
BCS Learning & Development Ltd.
Swindon, United Kingdom
Publication History
Published: 04 July 2018
Author Tags
Qualifiers
- Research-article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- View Citations1Total Citations
- 0Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 16 Jan 2025
Other Metrics
Citations
Cited By
View all- Martínez Beltrán EQuiles Pérez MLópez Bernal SMartínez Pérez GHuertas Celdrán A(2022)SAFECARExpert Systems with Applications: An International Journal10.1016/j.eswa.2022.117402203:COnline publication date: 1-Oct-2022