Article

Evolutionary testing: a case study

Authors:

HVC'06: Proceedings of the 2nd international Haifa verification conference on Hardware and software, verification and testing

Pages 155 - 165

Published: 23 October 2006 Publication History

Abstract

The paper presents a case study of applying genetic algorithms (GAs) to the automatic test data generation problem. We present the basic techniques implemented in our prototype test generation system, whose goal is to get branch coverage of the program under testing. We used our tool to experiment with simple programs, programs that have been used by others for test strategies benchmarking and the UNIX utility uniq. The effectiveness of GA-based testing system is compared with a Random testing system. We found that for simple programs both testing systems work fine, but as the complexity of the program or the complexity of input domain grows, GA-based testing system significantly outperforms Random testing.

References

[1]

P. McMinn. Search-based software testing: A survey. Software Testing, Verification and Reliability, 14(2): 105-156, 2004/6.

Digital Library

Google Scholar

[2]

R. Ferguson and B. Korel. The chaining approach for software test data generation. ACM Transactions on Software Engineering and Methodology, 5(1): 63-86, 1996

Digital Library

Google Scholar

[3]

G. McGraw, C. Michael, and M. Schatz. Generating software test data by evolution. IEEE Transactions on Software Engineering, 27(12):1085-1110, 2001.

Digital Library

Google Scholar

[4]

Soroush Karimi Rad. Can structural test adequacy criteria be used to predict the quality of generated invariants? MSc thesis, University of Antwerp, 2005

Google Scholar

[5]

David E. Goldberg: Genetic Algorithms in Search, Optimization and Machine Learning Kluwer Academic Publishers, Boston, MA, 1989.

Digital Library

Google Scholar

[6]

Mark Roper: Software Testing McGraw-Hill, 1994

Digital Library

Google Scholar

[7]

Codesurfer, http://www.grammatech.com/products/codesurfer, last visited July 2006

Google Scholar

[8]

http://www.mathtools.net/MATLAB/Genetic_algorithms, last visited July 2006

Google Scholar

[9]

H. Sthamer, J. Wegener and A. Baresel: Using Evolutionary Testing to improve Efficiency and Quality in Software Testing. In Proceedings of the 2nd Asia-Pacific Conference on Software Testing Analysis and Review (AsiaSTAR), July 2002. 22-24th July.

Google Scholar

[10]

S. Xanthakis, C. Ellis, C. Skourlas, A. Le Gall, S. Katsikas, and K. Karapoulios. Application of genetic algorithms to software testing (Application des algorithmes g_en_etiques au test des logiciels). In 5th International Conference on Software Engineering and its Applications, pages 625-636, Toulouse, France, 1992.

Google Scholar

[11]

J. Wegener, K. Buhr, and H. Pohlheim: Automatic test data generation for structural testing of embedded software systems by evolutionary testing. In Proceedings of the Genetic and Evolutionary Computation Conference (GECCO 2002), pages 1233-1240, New York, USA, 2002. Morgan Kaufmann.

Digital Library

Google Scholar

[12]

J. Wegener, A. Baresel, and H. Sthamer: Evolutionary test environment for automatic structural testing. Information and Software Technology, 43(14):841-854, 2001

Crossref

Google Scholar

[13]

GDB, The GNU Source-Level Debugger http://www.fismat.umich.mx/mn1/gdb/gdb_toc.html, last visited July 2006

Google Scholar

[14]

Wikipedia, Uniq http://en.wikipedia.org/wiki/Uniq, last visited November 2006

Google Scholar

Cited By

View all

Chen YZhong Y(2009)Experimental study on GA-based path-oriented test data generation using branch distanceProceedings of the 3rd international conference on Intelligent information technology application10.5555/1794554.1794608(216-219)Online publication date: 21-Nov-2009
https://dl.acm.org/doi/10.5555/1794554.1794608

Evolutionary testing: a case study
1. Software and its engineering
  1. Software creation and management
    1. Software verification and validation
      1. Software defect analysis

Recommendations

Optimisation of software testing using Genetic Algorithm

Software testing is meant to increase confidence in the correctness of software. Test data generation is one of the key issues in software testing. A properly generated test suite may not only locate the errors in a software system, but also help in ...
Data Generation for Path Testing

We present two stochastic search algorithms for generating test cases that execute specified paths in a program. The two algorithms are: a simulated annealing algorithm (SA), and a genetic algorithm (GA). These algorithms are based on an optimization ...
Evolutionary testing of object-oriented software
SAC '10: Proceedings of the 2010 ACM Symposium on Applied Computing

It is estimated that 80% of software development cost is spent on detecting and fixing defects. To tackle this issue, a number of tools and testing techniques have been developed to improve the existing testing framework. Although techniques such as ...

Comments

Information & Contributors

Information

Published In

HVC'06: Proceedings of the 2nd international Haifa verification conference on Hardware and software, verification and testing

October 2006

235 pages

ISBN:9783540708889

Editors:
Eyal Bin
IBM Labs, Haifa University, Haifa, Israel
,
Avi Ziv
IBM Labs, Haifa University, Haifa, Israel
,
Shmuel Ur
IBM Labs, Haifa University, Haifa, Israel

Publisher

Springer-Verlag

Berlin, Heidelberg

Publication History

Published: 23 October 2006

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 15 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Chen YZhong Y(2009)Experimental study on GA-based path-oriented test data generation using branch distanceProceedings of the 3rd international conference on Intelligent information technology application10.5555/1794554.1794608(216-219)Online publication date: 21-Nov-2009
https://dl.acm.org/doi/10.5555/1794554.1794608

Abstract

References

Cited By

Recommendations

Optimisation of software testing using Genetic Algorithm

Data Generation for Path Testing

Evolutionary testing of object-oriented software

Comments

Information

Published In

Sponsors

Publisher

Publication History

Author Tags

Qualifiers

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

View options

Figures

Other

Share

Share this Publication link

Share on social media

Affiliations