research-article

Using Advisory 3D Sound Cues to Improve Drivers' Performance and Situation Awareness

Authors:

Sus Lundgren Lyckvi,

Palle Dahlstedt,

Fang ChenAuthors Info & Claims

CHI '17: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems

Pages 2814 - 2825

https://doi.org/10.1145/3025453.3025634

Published: 02 May 2017 Publication History

Abstract

Within vehicle Human Machine Interface design, visual displays are predominant, taking up more and more of the visual channel for each new system added to the car, e.g. navigation systems, blind spot information and forward collision warnings. Sounds however, are mainly used to alert or warn drivers together with visual information. In this study we investigated the design of auditory displays for advisory information, by designing a 3D auditory advisory traffic information system (3DAATIS) which was evaluated in a drive simulator study with 30 participants. Our findings indicate that overall, drivers' performance and situation awareness improved when using this system. But, more importantly, the results also point towards the advantages and limitations of the use of advisory 3D-sounds in cars, e.g. attention capture vs. limited auditory resolution. These findings are discussed and expressed as design implications.

Supplementary Material

MP4 File (p2814-wang.mp4)

Download
206.01 MB

References

[1]

Tan, A. K. and Lerner, Neil D. 1996. Acoustic localization of in-vehicle crash avoidance warnings as a cue to hazard direction. U.S. Dept. of Transportation National Highway Traffic Safety Administration. Retrieved from http://trid.trb.org/view.aspx?id=474030

[2]

David Beattie, Lynne Baillie, Martin Halvey, and Rod Mccall. 2014. What's around the corner? Enhancing Driver Awareness in Autonomous Vehicles via InVehicle Spatial Auditory Displays. Proceedings of the 8th Nordic Conference on Human-Computer Interaction Fun, Fast, Foundational - NordiCHI '14: 189--198. http://doi.org/10.1145/2639189.2641206

Digital Library

[3]

Durand R. Begault. 1993. Head-up auditory displays for traffic collision avoidance system advisories: A preliminary investigation. Human Factors: The Journal of the Human Factors and Ergonomics Society 35, 4: 707--717. http://doi.org/10.1177/001872089303500409

[4]

Durand R. Begault. 1999. Auditory and non-auditory factors that potentially influence virtual acoustic imagery. Audio Engineering Society Conference: 16th International Conference: Spatial Sound Reproduction. Retrieved from http://www.aes.org/elib/browse.cfm?elib=8052

[5]

Meera M. Blattner, Denise A. Sumikawa, Robert M. Greenberg, et al. 1989. Earcons and icons: Their structure and common design principles. Human-Computer Interaction 4, 1: 11--44.

Digital Library

[6]

Sara Bly. 1982. Presenting information in sound. Proceedings of the 1st Conference on Human Factors in Computing Systems (CHI '82), 371--375. http://doi.org/10.1145/800049.801814

Digital Library

[7]

Warren Brodsky. 2015. Driving with music: cognitive-behavioural implications. Ashgate Publishing, Ltd.

[8]

Inger Ekman, Laura Ermi, Jussi Lahti, Jani Nummela, Petri Lankoski, and Frans Mäyrä. 2005. Designing sound for a pervasive mobile game. Proceedings of the 2005 ACM SIGCHI International Conference on Advances in computer entertainment technology, 110-- 116.

Digital Library

[9]

Mica R. Endsley. 1988. Design and evaluation for situation awareness enhancement. Proceedings of the Human Factors and Ergonomics Society Annual Meeting 32, 2: 97--101. http://doi.org/10.1177/154193128803200221

[10]

Mica R. Endsley. 1988. Situation awareness global assessment technique (SAGAT). Aerospace and Electronics Conference, 1988. NAECON 1988., Proceedings of the IEEE 1988 National, 789--795. Retrieved November 6, 2014 from http://scholar.google.com/scholar?hl=en&btnG=Search&q=intitle:A+methodology+for+the+objective+measurement+of+pilot+situation+awareness#0

[11]

Mark A. Ericson and Richard L. McKinley. 2001. The intelligibility of multiple talkers spatially separated in noise(No. AFRL-HE-WP-SR-2001-0009).

[12]

Johan Fagerlonn and Alm Håkan. 2010. Auditory signs to support traffic awareness. IET Intelligent Transport Systems 4, 4: 262--269. http://doi.org/10.1049/ietits.2009.0144

[13]

Rob Gray. 2011. Looming auditory collision warnings for driving. Human Factors: The Journal of the Human Factors and Ergonomics Society 53, 1: 63--74. http://doi.org/10.1177/0018720810397833

[14]

Philip Kortum. 2008. HCI beyond the GUI: Design for haptic, speech, olfactory, and other nontraditional interfaces. Morgan Kaufmann.

[15]

Jason Kurczak, T. C. Nicholas Graham, Claire Joly, and Regan L. Mandryk. 2011. Hearing is believing: evaluating ambient audio for location-based games. Proceedings of the 8th International Conference on Advances in Computer Entertainment Technology, 32. http://doi.org/10.1145/2071423.2071463

Digital Library

[16]

Van Der Laan, Jinke D., Adriaan Heino, and Dick De Waard. 1997. A simple procedure for the assessment of acceptance of advanced transport telematics. Transportation Research Part C: Emerging Technologies 5, 1: 1--10.

[17]

John D. Lee, Joshua D. Hoffman, and Elizabeth Hayes. 2004. Collision warning design to mitigate driver distraction. Proceedings of the SIGCHI Conference on Human factors in Computing Systems, 65--72. Retrieved March 24, 2012 from http://dl.acm.org/citation.cfm?id=985701

Digital Library

[18]

Fabrizio Leo, Vincenzo Romei, Elliot Freeman, Elisabetta Ladavas, and Jon Driver. 2011. Looming sounds enhance orientation sensitivity for visual stimuli on the same side as such sounds. Experimental brain research 213, 2-3: 193--201. http://doi.org/10.1007/s00221-011-2742-8

[19]

Yung-Ching Liu and Jing-Wun Jhuang. 2011. Effects of in-vehicle warning information displays with or without spatial compatibility on driving behaviors and response performance. Applied ergonomics: 1--8. http://doi.org/10.1016/j.apergo.2011.10.005

[20]

Tara Matthews, Tye Rattenbury, and Scott Carter. 2007. Defining, designing, and evaluating peripheral displays: An analysis using activity theory. Human-Computer Interaction 22, 1--2: 221--261. http://doi.org/10.1080/07370020701307997

[21]

David K McGookin and Stephen A Brewster. 2004. Understanding concurrent earcons: applying auditory scene analysis principles to concurrent earcon recognition. ACM Transactions on Applied Perception (TAP) 1, 2: 130--155. http://doi.org/10.1145/1024083.1024087

Digital Library

[22]

Natasa Paterson, Katsiaryna Naliuka, Soren Kristian Jensen, Tara Carrigy, Mads Haahr, and Fionnuala Conway. 2010. Design, implementation and evaluation of audio for a location aware augmented reality game. Proceedings of the 3rd International Conference on Fun and Games - Fun and Games '10, 149--156. http://doi.org/10.1145/1823818.1823835

Digital Library

[23]

Miguel a. Recarte and Luis M. Nunes. 2003. Mental workload while driving: Effects on visual search, discrimination, and decision making. Journal of Experimental Psychology: Applied 9, 2: 119--137. http://doi.org/10.1037/1076-898X.9.2.119

[24]

Nash Stanton, Roger Lew, Nolan Boyle, et al. 2011. An Implementation of a Graded Deceleration Display in Brake Light Warning Systems. Proceedings of the Human Factors and Ergonomics Society Annual Meeting 55, 1: 1573--1577. http://doi.org/10.1177/1071181311551328

[25]

Heikki Summala. 2007. Towards understanding motivational and emotional factors in driver behaviour: Comfort through satisficing. In Modelling driver behaviour in automotive environments. Springer London, 189--207. Retrieved November 17, 2014 from http://link.springer.com/chapter/10.1007/978-1-84628618-6_11

[26]

MinJuan Wang, Yi Ci Li, and Fang Chen. 2012. How can we design 3D auditory interfaces which enhance traffic safety for Chinese drivers? Proceedings of the 4th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, ACM Press, 77--83. http://doi.org/10.1145/2390256.2390268

Digital Library

[27]

Minjuan Wang, Sus Lundgren Lyckvi, and Fang Chen. 2016. Same, Same but Different: How Design Requirements for an Auditory Advisory Traffic Information System Differ Between Sweden and China. 8th International Conference on Automotive User Interfaces and Interactive Vehicular Applications.

Digital Library

[28]

Minjuan Wang, Sus Lundgren Lyckvi, and Fang Chen. 2016. Why and How Traffic Safety Cultures Matter when Designing Advisory Traffic Information Systems. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. http://doi.org/10.1145/2858036.2858467

Digital Library

[29]

Marcus O. Watson and Penelope M. Sanderson. 2007. Designing for attention with sound: challenges and extensions to ecological interface design. Human Factors: The Journal of the Human Factors and Ergonomics Society 49, 2: 331--346.

[30]

Deborah Withington. 2000. The Use of Directional Sound to Improve the Safety of Auditory Warnings. Proceedings of the Human Factors and Ergonomics Society Annual Meeting 44, 22: 726--729. http://doi.org/10.1177/154193120004402260

Cited By

Cao YLi LYuan JJeon M(2024)Head-up Displays Improve Drivers’ Performance and Subjective Perceptions with the In-Vehicle Gesture Interaction SystemInternational Journal of Human–Computer Interaction10.1080/10447318.2024.2387397(1-15)Online publication date: 9-Aug-2024
https://doi.org/10.1080/10447318.2024.2387397
Kim Svan Egmond RHappee R(2024)How manoeuvre information via auditory (spatial and beep) and visual UI can enhance trust and acceptance in automated drivingTransportation Research Part F: Traffic Psychology and Behaviour10.1016/j.trf.2023.11.007100(22-36)Online publication date: Jan-2024
https://doi.org/10.1016/j.trf.2023.11.007
Fu XZou YTan H(2024)Exploring the Impact of Interpretable Information Types on Driver's Situational Awareness and Performance During Driving Take-OverCross-Cultural Design10.1007/978-3-031-60913-8_8(99-114)Online publication date: 1-Jun-2024
https://doi.org/10.1007/978-3-031-60913-8_8
Show More Cited By

Index Terms

Using Advisory 3D Sound Cues to Improve Drivers' Performance and Situation Awareness
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

An auditory display that assist commercial drivers in lane changing situations
AM '13: Proceedings of the 8th Audio Mostly Conference

This paper presents a simulator study that evaluates four auditory displays to assist commercial drivers in lane changing situations. More specifically, the displays warned the drivers about vehicles in the adjacent lane. Three displays utilized ...
Lyricon Lyrics + Earcons Improves Identification of Auditory Cues
Proceedings, Part II, of the 4th International Conference on Design, User Experience, and Usability: Users and Interactions - Volume 9187

Auditory researchers have developed various non-speech cues in designing auditory user interfaces. A preliminary study of "lyricons" lyricsï ź+ï źearcons [1] has provided a novel approach to devising auditory cues in electronic products, by combining ...
Advanced Vehicle Sonification Applications
AutomotiveUI '14: Adjunct Proceedings of the 6th International Conference on Automotive User Interfaces and Interactive Vehicular Applications

Visual displays are still mainly used in the in-vehicle context, but they may be problematic for providing timely, appropriate feedback to drivers. To compensate for the drawbacks of visual displays, multimodal displays have been developed, but applied ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '17: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems

May 2017

7138 pages

ISBN:9781450346559

DOI:10.1145/3025453

General Chairs:
Gloria Mark
University of California Irvine
,
Susan Fussell
Cornell University
,
Program Chairs:
Cliff Lampe
University of Michigan
,
m.c. schraefel
University of Southampton
,
Juan Pablo Hourcade
University of Iowa
,
Caroline Appert
Université Paris-Sud
,
Daniel Wigdor
University of Toronto

Copyright © 2017 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 02 May 2017

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Swedish FFI

Conference

CHI '17

Sponsor:

SIGCHI

CHI '17: CHI Conference on Human Factors in Computing Systems

May 6 - 11, 2017

Colorado, Denver, USA

Acceptance Rates

CHI '17 Paper Acceptance Rate 600 of 2,400 submissions, 25%;

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI '25

Sponsor:
sigchi

CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

35
Total Citations
View Citations
757
Total Downloads

Downloads (Last 12 months)92
Downloads (Last 6 weeks)5

Reflects downloads up to 07 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Cao YLi LYuan JJeon M(2024)Head-up Displays Improve Drivers’ Performance and Subjective Perceptions with the In-Vehicle Gesture Interaction SystemInternational Journal of Human–Computer Interaction10.1080/10447318.2024.2387397(1-15)Online publication date: 9-Aug-2024
https://doi.org/10.1080/10447318.2024.2387397
Kim Svan Egmond RHappee R(2024)How manoeuvre information via auditory (spatial and beep) and visual UI can enhance trust and acceptance in automated drivingTransportation Research Part F: Traffic Psychology and Behaviour10.1016/j.trf.2023.11.007100(22-36)Online publication date: Jan-2024
https://doi.org/10.1016/j.trf.2023.11.007
Fu XZou YTan H(2024)Exploring the Impact of Interpretable Information Types on Driver's Situational Awareness and Performance During Driving Take-OverCross-Cultural Design10.1007/978-3-031-60913-8_8(99-114)Online publication date: 1-Jun-2024
https://doi.org/10.1007/978-3-031-60913-8_8
Xue HPreviati GGobbi MMastinu G(2023)Research and Development on Noise, Vibration, and Harshness of Road Vehicles Using Driving Simulators—A ReviewSAE International Journal of Vehicle Dynamics, Stability, and NVH10.4271/10-07-04-00357:4Online publication date: 15-Nov-2023
https://doi.org/10.4271/10-07-04-0035
Anwar RAnwar FHaider MEfrat ARaza MBoukerche ADe Rango FSun Z(2023)Redefining the Driver's Attention Gauge in Semi-Autonomous VehiclesProceedings of the Int'l ACM Conference on Modeling Analysis and Simulation of Wireless and Mobile Systems10.1145/3616388.3617544(307-311)Online publication date: 30-Oct-2023
https://dl.acm.org/doi/10.1145/3616388.3617544
Lylykangas JFarooq AVenesvirta HRaisamo RSurakka V(2023)Ears Outside the Car: Evaluation of Binaural Vehicular Sounds and Visual Animations as Driver's Blind Spot IndicatorsAdjunct Proceedings of the 15th International Conference on Automotive User Interfaces and Interactive Vehicular Applications10.1145/3581961.3609900(60-65)Online publication date: 18-Sep-2023
https://dl.acm.org/doi/10.1145/3581961.3609900
Couzon GPichard AZimmermann ERaimbaud PLugrin BLatoschik Mvon Mammen SKopp SPécune FPelachaud C(2023)Toward a human-like sound perception for reactive virtual agentsProceedings of the 23rd ACM International Conference on Intelligent Virtual Agents10.1145/3570945.3607346(1-4)Online publication date: 19-Sep-2023
https://dl.acm.org/doi/10.1145/3570945.3607346
Capallera MAngelini LMeteier QKhaled OMugellini E(2023)Human-Vehicle Interaction to Support Driver's Situation Awareness in Automated Vehicles: A Systematic ReviewIEEE Transactions on Intelligent Vehicles10.1109/TIV.2022.32008268:3(2551-2567)Online publication date: Mar-2023
https://doi.org/10.1109/TIV.2022.3200826
Lu JPeng ZYang SMa YWang RPang ZFeng XChen YCao Y(2023)A review of sensory interactions between autonomous vehicles and driversJournal of Systems Architecture10.1016/j.sysarc.2023.102932141(102932)Online publication date: Aug-2023
https://doi.org/10.1016/j.sysarc.2023.102932
Lee CJeon SHassan WKang H(2023)VR unseen gaze: inducing feeling of being stared at in virtual realityVirtual Reality10.1007/s10055-023-00751-w27:2(1529-1548)Online publication date: 23-Jan-2023
https://doi.org/10.1007/s10055-023-00751-w
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents