research-article

AC3R: automatically reconstructing car crashes from police reports

Authors:

Gordon FraserAuthors Info & Claims

ICSE '19: Proceedings of the 41st International Conference on Software Engineering: Companion Proceedings

Pages 31 - 34

https://doi.org/10.1109/ICSE-Companion.2019.00031

Published: 25 May 2019 Publication History

Abstract

Autonomous driving carries the promise to drastically reduce car accidents, but recently reported fatal crashes involving self-driving cars suggest that the self-driving car software should be tested more thoroughly. For addressing this need, we introduce AC3R (Automatic Crash Constructor from Crash Report) which elaborates police reports to automatically recreate car crashes in a simulated environment that can be used for testing self-driving car software in critical situations. AC3R enables developers to quickly generate relevant test cases from the massive historical dataset of recorded car crashes. We demonstrate how AC3R can generate simulations of different car crashes and report the findings of a large user study which concluded that AC3R simulations are accurate. A video illustrating AC3R in action is available at: https://youtu.be/V708fDG_ux8

References

[1]

M. Bertoncello and D. Wee, "Ten ways autonomous driving could redefine the automotive world," McKinsey & Company, Automotive & Assembly, June 2015.

[2]

Department of Motor Vehicles, "Report of traffic accident involving an autonomous vehicle." http://www.dmv.ca.gov/portal/dmv/detail/vr/autonomous/autonomousveh\_ol316\%2B, 2006.

[3]

F. Lambert, "Understanding the fatal tesla accident on autopilot and the nhtsa probe," Electrek, 2016.

[4]

ArsTechnica, "NTSB: Uber's sensors worked; its software utterly failed in fatal crash." https://arstechnica.com/cars/2018/05/emergency-brakes-were-disabled-by-ubers-self-driving-software-ntsb-says/, May 2018.

[5]

N. Kalra and S. M. Paddock, "Driving to safety: How many miles of driving would it take to demonstrate autonomous vehicle reliability?," Transportation Research Part A: Policy and Practice, vol. 94, pp. 182--193, Dec. 2016.

[6]

C. Zhang, Y. Liu, D. Zhao, and Y. Su, "RoadView: A traffic scene simulator for autonomous vehicle simulation testing," in Proceedings of the International IEEE Conference on Intelligent Transportation Systems, ITSC 2014, pp. 1160--1165, Oct. 2014.

[7]

D. Zhao and H. Peng, "From the Lab to the Street: Solving the Challenge of Accelerating Automated Vehicle Testing," arXiv preprint arXiv:1707.04792, 2017.

[8]

R. Ben Abdessalem, S. Nejati, L. C. Briand, and T. Stifter, "Testing advanced driver assistance systems using multi-objective search and neural networks," in Proceedings of the IEEE/ACM International Conference on Automated Software Engineering, ASE 2016, pp. 63--74, 2016.

Digital Library

[9]

A. Kendall, J. Hawke, D. Janz, P. Mazur, D. Reda, J.-M. Allen, V.-D. Lam, A. Bewley, and A. Shah, "Learning to drive in a day," arXiv preprint arXiv:1807.00412, 2018.

[10]

R. B. Abdessalem, S. Nejati, L. C. Briand, and T. Stifter, "Testing vision-based control systems using learnable evolutionary algorithms," in Proceedings of the International Conference on Software Engineering, ICSE 2018, pp. 1016--1026, 2018.

Digital Library

[11]

T. Dreossi, A. Donzé, and S. A. Seshia, "Compositional falsification of cyber-physical systems with machine learning components," in NASA Formal Methods Symposium, pp. 357--372, Springer, 2017.

[12]

C. E. Tuncali, G. Fainekos, H. Ito, and J. Kapinski, "Sim-ATAV: Simulation-based adversarial testing framework for autonomous vehicles," in Proceedings of the International Conference on Hybrid Systems: Computation and Control, HSCC 2018, pp. 283--284, 2018.

Digital Library

[13]

N. H. T. S. A. N. et al., "Mmucc guideline model minimum uniform crash criteria 5th edition," 2017. https://crashstats.nhtsa.dot.gov/Api/Public/ViewPublication/812433.

[14]

National Highway Traffic Safety Administration (NHTSA), "National motor vehicle crash causation survey." https://crashviewer.nhtsa.dot.gov/LegacyNMVCCS/Search.

[15]

C. D. Manning, M. Surdeanu, J. Bauer, J. Finkel, S. J. Bethard, and D. McClosky, "The Stanford CoreNLP natural language processing toolkit," in Association for Computational Linguistics (ACL) System Demonstrations, pp. 55--60, 2014.

[16]

M. A. Musen, "The protÉgÉ project: A look back and a look forward," AI Matters, vol. 1, pp. 4--12, June 2015. https://protege.stanford.edu/.

Digital Library

[17]

BeamNG GmbH, "BeamNG.research - BeamNG."

[18]

R. Likert, "A technique for the measurement of attitudes.," Archives of psychology, 1932.

Cited By

Chen YHuai YLi SHong CGarcia J(2024)Misconfiguration Software Testing for Failure Emergence in Autonomous Driving SystemsProceedings of the ACM on Software Engineering10.1145/36607921:FSE(1913-1936)Online publication date: 12-Jul-2024
https://dl.acm.org/doi/10.1145/3660792
Dai JGao BLuo MHuang ZLi ZZhang YYang MRoychoudhury APaiva AAbreu RStorey M(2024)SCTrans: Constructing a Large Public Scenario Dataset for Simulation Testing of Autonomous Driving SystemsProceedings of the IEEE/ACM 46th International Conference on Software Engineering10.1145/3597503.3623350(1-13)Online publication date: 20-May-2024
https://dl.acm.org/doi/10.1145/3597503.3623350
Huang YWang JLiu ZWang YWang SChen CHu YWang QRoychoudhury APaiva AAbreu RStorey M(2024)CrashTranslator: Automatically Reproducing Mobile Application Crashes Directly from Stack TraceProceedings of the IEEE/ACM 46th International Conference on Software Engineering10.1145/3597503.3623298(1-13)Online publication date: 20-May-2024
https://dl.acm.org/doi/10.1145/3597503.3623298
Show More Cited By

Recommendations

Generating effective test cases for self-driving cars from police reports
ESEC/FSE 2019: Proceedings of the 2019 27th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering

Autonomous driving carries the promise to drastically reduce the number of car accidents; however, recently reported fatal crashes involving self-driving cars show that such an important goal is not yet achieved. This calls for better testing of the ...
Automatically testing self-driving cars with search-based procedural content generation
ISSTA 2019: Proceedings of the 28th ACM SIGSOFT International Symposium on Software Testing and Analysis

Self-driving cars rely on software which needs to be thoroughly tested. Testing self-driving car software in real traffic is not only expensive but also dangerous, and has already caused fatalities. Virtual tests, in which self-driving car software is ...
Automatically reconstructing car crashes from police reports for testing self-driving cars
ICSE '19: Proceedings of the 41st International Conference on Software Engineering: Companion Proceedings

Autonomous driving carries the promise to drastically reduce the number of car accidents; however, recently reported fatal crashes involving self-driving cars show this important goal is not yet achieved, and call for better testing of the software ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

ICSE '19: Proceedings of the 41st International Conference on Software Engineering: Companion Proceedings

May 2019

369 pages

Conference Chair:
Gunter Mussbacher
McGill University, Canada
,
General Chair:
Joanne M. Atlee
University of Waterloo, Canada
,
Program Chair:
Tevfik Bultan
University of California, Santa Barbara

Sponsors

SIGSOFT: ACM Special Interest Group on Software Engineering
IEEE-CS: Computer Society

Publisher

IEEE Press

Publication History

Published: 25 May 2019

Check for updates

Author Tags

Qualifiers

Research-article

Conference

ICSE '19

Sponsor:

SIGSOFT
IEEE-CS

ICSE '19: 41st International Conference on Software Engineering

May 25 - 31, 2019

Quebec, Montreal, Canada

Acceptance Rates

Overall Acceptance Rate 276 of 1,856 submissions, 15%

Upcoming Conference

ICSE 2025

2025 IEEE/ACM 46th International Conference on Software Engineering

April 26 - May 3, 2025

Ottawa , ON , Canada

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
79
Total Downloads

Downloads (Last 12 months)4
Downloads (Last 6 weeks)0

Reflects downloads up to 26 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Chen YHuai YLi SHong CGarcia J(2024)Misconfiguration Software Testing for Failure Emergence in Autonomous Driving SystemsProceedings of the ACM on Software Engineering10.1145/36607921:FSE(1913-1936)Online publication date: 12-Jul-2024
https://dl.acm.org/doi/10.1145/3660792
Dai JGao BLuo MHuang ZLi ZZhang YYang MRoychoudhury APaiva AAbreu RStorey M(2024)SCTrans: Constructing a Large Public Scenario Dataset for Simulation Testing of Autonomous Driving SystemsProceedings of the IEEE/ACM 46th International Conference on Software Engineering10.1145/3597503.3623350(1-13)Online publication date: 20-May-2024
https://dl.acm.org/doi/10.1145/3597503.3623350
Huang YWang JLiu ZWang YWang SChen CHu YWang QRoychoudhury APaiva AAbreu RStorey M(2024)CrashTranslator: Automatically Reproducing Mobile Application Crashes Directly from Stack TraceProceedings of the IEEE/ACM 46th International Conference on Software Engineering10.1145/3597503.3623298(1-13)Online publication date: 20-May-2024
https://dl.acm.org/doi/10.1145/3597503.3623298
Tang SZhang ZZhang YZhou JGuo YLiu SGuo SLi YMa LXue YLiu Y(2023)A Survey on Automated Driving System Testing: Landscapes and TrendsACM Transactions on Software Engineering and Methodology10.1145/357964232:5(1-62)Online publication date: 24-Jul-2023
https://dl.acm.org/doi/10.1145/3579642
Gambi AHuynh TFraser GDumas MPfahl DApel SRusso A(2019)Generating effective test cases for self-driving cars from police reportsProceedings of the 2019 27th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering10.1145/3338906.3338942(257-267)Online publication date: 12-Aug-2019
https://dl.acm.org/doi/10.1145/3338906.3338942

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten