demonstration

Aletheia: a failure diagnosis toolchain

Authors:

Mojdeh Golagha,

Abu Mohammed Raisuddin,

Lennart Mittag,

Dominik Hellhake,

Alexander PretschnerAuthors Info & Claims

ICSE '18: Proceedings of the 40th International Conference on Software Engineering: Companion Proceeedings

Pages 13 - 16

https://doi.org/10.1145/3183440.3183486

Published: 27 May 2018 Publication History

Abstract

Testing and debugging are time-consuming, tedious and costly. As many automated test generation tools are being applied in practice nowadays, there is a growing need for automated failure diagnosis. We introduce Aletheia, a failure diagnosis toolchain, which aims to help developers and testers reduce failure analysis time. The key ideas include: data generation to provide the relevant data for further analysis, failure clustering to group failing tests based on the hypothesized faults, and fault localization to pinpoint suspicious elements of the code. We evaluated Aletheia in a large-scale industrial case study as well as two open-source projects. Aletheia is released as an open-source tool on Github, and a demo video can be found at: https://youtu.be/BP9D68D02ZI

References

[1]

R. Abreu, P. Zoeteweij, and Arjan J.C. Van Gemund. 2009. Localizing software faults simultaneously. In Proceedings - International Conference on Quality Software.

Digital Library

[2]

R. Abreu, P. Zoeteweij, and A. J. C. Van Gemund. 2006. An evaluation of similarity coefficients for software fault localization. In Proceedings - 12th Pacific Rim International Symposium on Dependable Computing, PRDC 2006.

Digital Library

[3]

R. Abreu, P. Zoeteweij, and A. J. C. Van Gemund. 2007. On the accuracy of spectrum-based fault localization. In Proceedings - Testing: Academic and Industrial Conference Practice and Research Techniques, TAIC PART-Mutation 2007.

Digital Library

[4]

J. Campos, A. Riboira, A. Perez, and R Abreu. 2012. GZoltar: an eclipse plug-in for testing and debugging. Proceedings of the 27th IEEE/ACM International Conference on Automated Software Engineering - ASE 2012 (2012).

Digital Library

[5]

M. Y. Chen, E. Kiciman, E. Fratkin, A. Fox, and E. Brewer. 2002. Pinpoint: Problem determination in large, dynamic internet services. In Proceedings of the 2002 International Conference on Dependable Systems and Networks.

Digital Library

[6]

E. P. Enoiu, Adnan Čaušević, Thomas J. Ostrand, Elaine J. Weyuker, Daniel Sundmark, and Paul Pettersson. 2016. Automated test generation using model checking: an industrial evaluation. International Journal on Software Tools for Technology Transfer 18, 3 (01 Jun 2016).

Digital Library

[7]

M. Golagha and A. Pretschner. 2017. Challenges of Operationalizing Spectrum-Based Fault Localization from a Data-Centric Perspective. In Proceedings - 10th IEEE International Conference on Software Testing, Verification and Validation Workshops, ICSTW 2017.

[8]

M. Golagha, A. Pretschner, D. Fisch, and R. Nagy. 2017. Reducing failure analysis time: An industrial evaluation. In Proceedings - 2017 IEEE/ACM 39th International Conference on Software Engineering: Software Engineering in Practice Track.

Digital Library

[9]

T. Janssen, A. Gemund, and R. Abreu. 2009. Zoltar: A Spectrum-based Fault Localization Tool. Instrumentation (2009).

Digital Library

[10]

J.A. Jones, M.J. Harrold, and J.T. Stasko. 2001. Visualization for fault localization. Proceedings of ICSE 2001 Workshop on Software Visualization (2001).

[11]

J. a. Jones, J. F. Bowring, and M. J. Harrold. 2007. Debugging in Parallel. In Proceedings of the 2007 international symposium on Software testing and analysis.

Digital Library

[12]

J.a. James a Jones and M. J. Harrold. 2005. Empirical evaluation of the tarantula automatic fault-localization technique. Automated Software Engineering (2005).

Digital Library

[13]

X. Ju, X. Jiang, Shand Chen, X. Wang, Y. Zhang, and H. Cao. 2014. HSFal: Effective fault localization using hybrid spectrum of full slices and execution slices. Journal of Systems and Software 90, 1 (2014).

Digital Library

[14]

R. Just, D. Jalali, and M. D. Ernst. 2014. Defects4J: a database of existing faults to enable controlled testing studies for Java programs. In Proceedings of the 2014 International Symposium on Software Testing and Analysis.

Digital Library

[15]

W. Mash. 2015. Automated Fault Localization. Advances and Challenges. In Advances in Computers. Vol. 99.

[16]

S. Pearson, J. Campos, R. Just, G. Fraser, R. Abreu, M. D. Ernst, D. Pang, and B. Keller. 2017. Evaluating and Improving Fault Localization. In Proceedings of the 39th International Conference on Software Engineering.

Digital Library

[17]

A. Podgurski, D. Leon, P. Francis, W. Masri, M. Minch, Jiayang Sun, and Bin Wang. 2003. Automated support for classifying software failure reports. In 25th International Conference on Software Engineering, 2003. Proceedings.

Digital Library

[18]

M. Utting, B. Legeard, and A. Pretschner. 2006. A Taxonomy of Model-Based Testing. Software Testing, Verification and Reliability 22, April (2006).

Digital Library

[19]

W. E. Wong, V. Debroy, R. Gao, and Y. Li. 2014. The DStar method for effective software fault localization. IEEE Transactions on Reliability 63, 1 (2014).

[20]

W. E. Wong, R. Gao, Y. Li, R. Abreu, and F. Wotawa. 2016. A Survey on Software Fault Localization. IEEE Transactions on Software Engineering PP, 99 (2016).

Digital Library

[21]

H. Yoshida, G. Li, T. Kamiya, I. Ghosh, S. Rajan, S. Tokumoto, K. Munakata, and T. Uehara. 2017. KLOVER: Automatic Test Generation for C and C++ Programs, Using Symbolic Execution. IEEE Software 34, 5 (2017), 30--37.

Digital Library

Cited By

Archana Agarwal A(2022)Evaluation of spectrum based fault localization tools15th Innovations in Software Engineering Conference10.1145/3511430.3511470(1-5)Online publication date: 24-Feb-2022
https://doi.org/10.1145/3511430.3511470
Becker MMeyer RRunge TSchaefer Ivan der Wall SWolff S(2022)Model-Based Fault Classification for Automotive SoftwareProgramming Languages and Systems10.1007/978-3-031-21037-2_6(110-131)Online publication date: 5-Dec-2022
https://dl.acm.org/doi/10.1007/978-3-031-21037-2_6
Golagha M(2022)How to Effectively Reduce Failure Analysis Time?Ernst Denert Award for Software Engineering 202010.1007/978-3-030-83128-8_4(45-71)Online publication date: 28-Feb-2022
https://doi.org/10.1007/978-3-030-83128-8_4
Show More Cited By

Index Terms

Aletheia: a failure diagnosis toolchain
1. Software and its engineering
  1. Software creation and management
    1. Software verification and validation
      1. Software defect analysis
        Software testing and debugging

Recommendations

Pairika: a failure diagnosis benchmark for C++ programs
ICSE '18: Proceedings of the 40th International Conference on Software Engineering: Companion Proceeedings

Empirical studies in software testing require realistic benchmarks which are able to mimic industry-like environments. For evaluating automated failure diagnosis techniques, one needs real reproducible bugs with at least one associated failing test. ...
Failure clustering without coverage
ISSTA 2019: Proceedings of the 28th ACM SIGSOFT International Symposium on Software Testing and Analysis

Developing and integrating software in the automotive industry is a complex task and requires extensive testing. An important cost factor in testing and debugging is the time required to analyze failing tests. In the context of regression testing, ...
A comprehensive empirical investigation on failure clustering in parallel debugging
Abstract
The clustering technique has attracted a lot of attention as a promising strategy for parallel debugging in multi-fault scenarios, this heuristic approach (i.e., failure indexing or fault isolation) enables developers to perform ...
Highlights
- The first empirical study regarding the clustering in parallel debugging.
- A ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

ICSE '18: Proceedings of the 40th International Conference on Software Engineering: Companion Proceeedings

May 2018

231 pages

ISBN:9781450356633

DOI:10.1145/3183440

Conference Chair:
Michel Chaudron
Chalmers University of Technology, University of Gothenburg, Sweden
,
General Chair:
Ivica Crnkovic
Chalmers University of Technology, University of Gothenburg, Sweden
,
Program Chairs:
Marsha Chechik
University of Toronto, Canada
,
Mark Harman
Facebook and University College London, United Kingdom

Copyright © 2018 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

SIGSOFT: ACM Special Interest Group on Software Engineering
IEEE-CS: Computer Society

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 27 May 2018

Check for updates

Author Tags

Qualifiers

Demonstration

Conference

ICSE '18

Sponsor:

SIGSOFT
IEEE-CS

ICSE '18: 40th International Conference on Software Engineering

May 27 - June 3, 2018

Gothenburg, Sweden

Acceptance Rates

Overall Acceptance Rate 276 of 1,856 submissions, 15%

Upcoming Conference

ICSE 2025

2025 IEEE/ACM 46th International Conference on Software Engineering

April 26 - May 3, 2025

Ottawa , ON , Canada

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
163
Total Downloads

Downloads (Last 12 months)12
Downloads (Last 6 weeks)1

Reflects downloads up to 23 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Archana Agarwal A(2022)Evaluation of spectrum based fault localization tools15th Innovations in Software Engineering Conference10.1145/3511430.3511470(1-5)Online publication date: 24-Feb-2022
https://doi.org/10.1145/3511430.3511470
Becker MMeyer RRunge TSchaefer Ivan der Wall SWolff S(2022)Model-Based Fault Classification for Automotive SoftwareProgramming Languages and Systems10.1007/978-3-031-21037-2_6(110-131)Online publication date: 5-Dec-2022
https://dl.acm.org/doi/10.1007/978-3-031-21037-2_6
Golagha M(2022)How to Effectively Reduce Failure Analysis Time?Ernst Denert Award for Software Engineering 202010.1007/978-3-030-83128-8_4(45-71)Online publication date: 28-Feb-2022
https://doi.org/10.1007/978-3-030-83128-8_4
Rahman MGolagha MPretschner AChaudron MCrnkovic IChechik MHarman M(2018)PairikaProceedings of the 40th International Conference on Software Engineering: Companion Proceeedings10.1145/3183440.3195097(204-205)Online publication date: 27-May-2018
https://dl.acm.org/doi/10.1145/3183440.3195097

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents