research-article

Confidence Prediction from EEG Recordings in a Multisensory Environment

Authors:

Jacobo Fernandez-Vargas,

Davide Valeriani,

Caterina Cinel,

Parima Ahmadipour,

Maryam M. Shanechi,

Riccardo PoliAuthors Info & Claims

ICBET '20: Proceedings of the 2020 10th International Conference on Biomedical Engineering and Technology

Pages 269 - 275

https://doi.org/10.1145/3397391.3397426

Published: 15 September 2020 Publication History

Abstract

This paper investigates the possibility of decoding decision confidence from electroencephalographic (EEG) brain activity of human subjects during a multisensory decision-making task. In recent research we have shown that decision confidence correlates could be extracted from EEG recordings during visual or auditory tasks. Here we extend these initial findings by (a) predicting the confidence in the decision from EEG recordings alone, and (b) investigating the impact of multisensory cues on decision-making behavioral data. Our results obtained from 12 participants recorded at two different sites show that the decision confidence could be predicted from EEG recordings on a single-trial basis with a mean absolute error of 0.226. Moreover, the presence of a multisensory cue did not improve the performance of the participants, but rather distracted them from the main task. Overall, these results may inform the development of cognitive systems that could monitor and alert users when they are not confident about their decisions.

References

[1]

P. Grimaldi, H. Lau, and M. A. Basso, "There are things that we know that we know, and there are things that we do not know we do not know: Confidence in decision-making," Neuroscience and Biobehavioral Reviews, vol. 55. Elsevier Ltd, pp. 88--97, 01-Aug-2015.

[2]

L. Aitchison, D. Bang, B. Bahrami, and P. E. Latham, "Doubly Bayesian Analysis of Confidence in Perceptual Decision-Making," PLoS Comput. Biol., vol. 11, no. 10, 2015.

[3]

N. Yeung and C. Summerfield, "Metacognition in human decision-making: confidence and error monitoring," Philos. Trans. R. Soc. B Biol. Sci., vol. 367, no. 1594, pp. 1310--1321, May 2012.

[4]

D. Valeriani, C. Cinel, and R. Poli, "Group Augmentation in Realistic Visual-Search Decisions via a Hybrid Brain-Computer Interface," Sci. Rep., vol. 7, no. 1, p. 7772, Dec. 2017.

[5]

S. Gherman and M. G. Philiastides, "Neural representations of confidence emerge from the process of decision formation during perceptual choices," Neuroimage, vol. 106, pp. 134--143, Feb. 2015.

[6]

M. Graziano, L. C. Parra, and M. Sigman, "Neural correlates of perceived confidence in a partial report paradigm," J. Cogn. Neurosci., vol. 27, no. 6, pp. 1090--1103, Jun. 2015.

Digital Library

[7]

M. A. Pisauro, E. Fouragnan, C. Retzler, and M. G. Philiastides, "Neural correlates of evidence accumulation during value-based decisions revealed via simultaneous EEG-fMRI," Nat. Commun., vol. 8, p. 15808, Jun. 2017.

[8]

D. R. Begault, "Head-up auditory displays for traffic collision avoidance system advisories: A preliminary investigation," Hum. Factors, vol. 35, no. 4, pp. 707--717, 1993.

[9]

J. J. McDonald, W. A. Teder-Sälejärvi, and S. A. Hillyard, "Involuntary orienting to sound improves visual perception.," Nature, vol. 407, no. 6806, pp. 906--8, Oct. 2000.

[10]

C. Spence and J. Driver, Crossmodal Space and Crossmodal Attention. Oxford University Press, 2012.

[11]

B. W. Jervis, E. C. Ifeachor, and E. M. Allen, "The removal of ocular artefacts from the electroencephalogram: a review," Med. Biol. Eng. Comput, vol. 26, no. 1, pp. 2--12, Jan. 1988.

[12]

R. D. (Robert D. Luce, Response times: their role in inferring elementary mental organization. Oxford University Press, 1986.

[13]

R. Ratcliff and J. J. Starns, "Modeling confidence judgments, response times, and multiple choices in decision making: Recognition memory and motion discrimination.," Psychol. Rev., vol. 120, no. 3, pp. 697--719, 2013.

[14]

J. V. Baranski and W. M. Petrusic, "The calibration and resolution of confidence in perceptual judgments," Percept. Psychophys., vol. 55, no. 4, pp. 412--428, Jul. 1994.

[15]

R. Kiani, L. Corthell, and M. N. Shadlen, "Choice Certainty Is Informed by Both Evidence and Decision Time," Neuron, vol. 84, no. 6, pp. 1329--1342, Dec. 2014.

[16]

R. Kiani and M. N. Shadlen, "Representation of confidence associated with a decision by neurons in the parietal cortex.," Science, vol. 324, no. 5928, pp. 759--64, May 2009.

[17]

D. Dotan, F. Meyniel, and S. Dehaene, "On-line confidence monitoring during decision making," Cognition, vol. 171, pp. 112--121, Feb. 2018.

Cited By

Sadras NSani OAhmadipour PShanechi M(2023)Post-stimulus encoding of decision confidence in EEG: toward a brain–computer interface for decision makingJournal of Neural Engineering10.1088/1741-2552/acec1420:5(056012)Online publication date: 19-Sep-2023
https://doi.org/10.1088/1741-2552/acec14
Malviya LKhandelwal SMal S(2022)Mental Stress Detection Using EEG Extracted Frequency BandsSoft Computing: Theories and Applications10.1007/978-981-19-0707-4_27(283-293)Online publication date: 2-Jun-2022
https://doi.org/10.1007/978-981-19-0707-4_27

Index Terms

Confidence Prediction from EEG Recordings in a Multisensory Environment
1. Applied computing
  1. Life and medical sciences
    1. Bioinformatics

Recommendations

Improvements of Adaptive Filtering by Optimal Projection to filter different artifact types on long duration EEG recordings

Adaptive Filtering by Optimal Projection (AFOP) is an automatic method for reducing ocular and muscular artifacts on electro-encephalographic (EEG) recordings. This paper presents two additions to this method: an improvement of the stability of ocular ...
Detection and Removal of Muscle Artifacts from Scalp EEG Recordings in Patients with Epilepsy
BIBE '14: Proceedings of the 2014 IEEE International Conference on Bioinformatics and Bioengineering

The Electroencephalogram (EEG) is often contaminated by muscle artifacts. EEG is a widely used recording technique for the study of many brain related diseases such as epilepsy. The detection and removal of muscle artifacts from the EEG signal poses a ...
Resolving the dynamics of EEG generators by multichannel recordings

The voltage recorded over the cortex (ECoG) or over the scalp (EEG) is generated by currents derived from many sources called “generators”. Different patterns and amplitudes are observed in aroused, sleepy, epileptic or other brain states. Differences ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

ICBET '20: Proceedings of the 2020 10th International Conference on Biomedical Engineering and Technology

September 2020

350 pages

ISBN:9781450377249

DOI:10.1145/3397391

Copyright © 2020 Owner/Author.

This work is licensed under a Creative Commons Attribution International 4.0 License.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 15 September 2020

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Funding Sources

Engineering and Physical Sciences Research Council

Conference

ICBET 2020

ICBET 2020: 2020 10th International Conference on Biomedical Engineering and Technology

September 15 - 18, 2020

Tokyo, Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
135
Total Downloads

Downloads (Last 12 months)31
Downloads (Last 6 weeks)13

Reflects downloads up to 24 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Sadras NSani OAhmadipour PShanechi M(2023)Post-stimulus encoding of decision confidence in EEG: toward a brain–computer interface for decision makingJournal of Neural Engineering10.1088/1741-2552/acec1420:5(056012)Online publication date: 19-Sep-2023
https://doi.org/10.1088/1741-2552/acec14
Malviya LKhandelwal SMal S(2022)Mental Stress Detection Using EEG Extracted Frequency BandsSoft Computing: Theories and Applications10.1007/978-981-19-0707-4_27(283-293)Online publication date: 2-Jun-2022
https://doi.org/10.1007/978-981-19-0707-4_27

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents