research-article

A comfortable testplayer for analyzing statistical usage testing strategies

Author:

Winfried DulzAuthors Info & Claims

AST '11: Proceedings of the 6th International Workshop on Automation of Software Test

Pages 36 - 42

https://doi.org/10.1145/1982595.1982604

Published: 23 May 2011 Publication History

Get Access

Abstract

We will first give a brief introduction to a versatile modeling environment that allows the early validation of system specifications by a test-driven agile simulation approach. The main focus of our paper is on providing techniques for automated test case generation relying on statistical usage models. Based on the open source software R for statistical computing and graphics the easy to handle test case generation and analyzing TestPlayer© tool was developped. Starting from customer-specific graphical Markov chain usage models test cases are automatically generated and visualized by highlighting selected nodes and arcs in the model. In addition, various metrics and corresponding diagrams offer analytical techniques to assess the quality of the derived test suite.

References

[1]

M. Beyer and W. Dulz. Scenario-Based Statistical Testing of Quality of Service Requirements. In Springer LNCS 3466. Springer, 2005.

Digital Library

Google Scholar

[2]

I. Dietrich, F. Dressler, W. Dulz, and R. German. Validating UML Simulation Models with Model-Level Unit Tests. In 3rd ACM/ICST Int. Conf. on Simulation Tools and Techniques for Communications, Networks and Systems (SIMUTools 2010), Malaga, Spain, 2010.

Digital Library

Google Scholar

[3]

A. Djanatliev, W. Dulz, R. German, F. Prester, V. Schneider, and V. Witt. VeriTAS - A Versatile Modeling Environment for Test-driven Agile Simulation. Technical report, Department of Computer Science, Friedrich-Alexander University, Erlangen, Germany, 2011. CS-2011-02.

Google Scholar

[4]

W. Dulz, S. Holpp, and R. German. A Polyhedron Approach to Calculate Probability Distributions for Markov Chain Usage Models. Electronic Notes in Theoretical Computer Science, 264(3):19--35, 2010.

Digital Library

Google Scholar

[5]

W. Dulz and F. Zhen. MaTeLo - Statistical Usage Testing by Annotated Sequence Diagrams, Markov Chains and TTCN-3. In IEEE Proc. of Third International Conference on Quality Software (QSIC 2003), pages 336--342, 2003.

Digital Library

Google Scholar

[6]

S. Prowell. Computations for Markov Chain Usage Models. Technical report, Software Engineering Institute, Carnegie-Mellon University, Pittsburgh, USA, 2000. UT-CS-03-505.

Google Scholar

[7]

S. J. Prowell. Using Markov Chain Usage Models to Test Complex Systems. In Proceedings of the 38th Hawaii International Conference on System Sciences, pages pp. 318c--318c, 2005.

Digital Library

Google Scholar

[8]

Stacy J. Prowell. Jumbl: A tool for model-based statistical testing. In HICSS, page 337, 2003.

Digital Library

Google Scholar

[9]

S. Rosaria and H. Robinson. Applying models in your testing process. Information and Software Technology, 42:815--824, 2000.

Crossref

Google Scholar

[10]

K. Sayre. Improved Techniques for Software Testing Based on Markov Chain Usage Models. PhD thesis, The University of Tennessee, Knoxville, TN, 1999.

Digital Library

Google Scholar

[11]

G. H. Walton, J. H. Poore, and C. J. Trammell. Statistical Testing of Software Based on a Usage Model. Software - Practice and Experience, 25(1):97--108, 1995.

Digital Library

Google Scholar

[12]

J. A. Whittaker and J. H. Poore. Markov Analysis of Software Specifications. ACM Transactions on Software Engineering and Methodology, 2(1):93--106, 1993.

Digital Library

Google Scholar

[13]

J. A. Whittaker and M. G. Thomason. A markov chain model for statistical software testing. IEEE Transactions on Software Engineering, 20(10), 1994.

Digital Library

Google Scholar

Cited By

View all

Dulz W(2019)Model-Based On-the-Fly Testing of Web Applications and Multilingual WebsitesSoftware Technologies10.1007/978-3-030-29157-0_3(55-78)Online publication date: 13-Aug-2019
https://doi.org/10.1007/978-3-030-29157-0_3
Dulz W(2013)Model-Based Strategies for Reducing the Complexity of Statistically Generated Test SuitesSoftware Quality. Increasing Value in Software and Systems Development10.1007/978-3-642-35702-2_7(89-103)Online publication date: 2013
https://doi.org/10.1007/978-3-642-35702-2_7
Djanatliev ADulz WGerman RSchneider V(2011)Veritas - a versatile modeling environment for test-driven agile simulationProceedings of the Winter Simulation Conference10.5555/2431518.2431953(3662-3671)Online publication date: 11-Dec-2011
https://dl.acm.org/doi/10.5555/2431518.2431953
Show More Cited By

Index Terms

A comfortable testplayer for analyzing statistical usage testing strategies
1. Software and its engineering
  1. Software creation and management
    1. Software verification and validation
      1. Software defect analysis
        Software testing and debugging

Recommendations

Scenario-Based statistical testing of quality of service requirements
SMTT'03: Proceedings of the 2003 international conference on Scenarios: models, Transformations and Tools

In this paper a general framework is presented for testing time-critical systems and software. The main focus is to derive a state-oriented statistical usage model from a set of usage scenarios in order to automatically generate test cases. We describe ...
Killing strategies for model-based mutation testing

This article presents the techniques and results of a novel model-based test case generation approach that automatically derives test cases from UML state machines. The main contribution of this article is the fully automated fault-based test case ...
Calculating the usage probabilities of statistical usage models by constraints optimization
AST '10: Proceedings of the 5th Workshop on Automation of Software Test

The systematic generation of test cases from statistical usage models has been investigated recently for specific application domains, such as wireless communications or automotive applications. For Markov chain usage models, the expected usage of a ...

Comments

Information & Contributors

Information

Published In

AST '11: Proceedings of the 6th International Workshop on Automation of Software Test

May 2011

124 pages

ISBN:9781450305921

DOI:10.1145/1982595

Program Chairs:
Antonia Bertolino
ISTI-CNR, Italy
,
Howard Foster
City University London, UK
,
J. Jenny Li
Avaya Labs Research, USA

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 23 May 2011

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

ICSE11

Sponsor:

SIGSOFT

ICSE11: International Conference on Software Engineering

May 23 - 24, 2011

HI, Waikiki, Honolulu, USA

Upcoming Conference

ICSE 2025

2025 IEEE/ACM 46th International Conference on Software Engineering

April 26 - May 3, 2025

Ottawa , ON , Canada

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
139
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 06 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Dulz W(2019)Model-Based On-the-Fly Testing of Web Applications and Multilingual WebsitesSoftware Technologies10.1007/978-3-030-29157-0_3(55-78)Online publication date: 13-Aug-2019
https://doi.org/10.1007/978-3-030-29157-0_3
Dulz W(2013)Model-Based Strategies for Reducing the Complexity of Statistically Generated Test SuitesSoftware Quality. Increasing Value in Software and Systems Development10.1007/978-3-642-35702-2_7(89-103)Online publication date: 2013
https://doi.org/10.1007/978-3-642-35702-2_7
Djanatliev ADulz WGerman RSchneider V(2011)Veritas - a versatile modeling environment for test-driven agile simulationProceedings of the Winter Simulation Conference10.5555/2431518.2431953(3662-3671)Online publication date: 11-Dec-2011
https://dl.acm.org/doi/10.5555/2431518.2431953
Djanatliev ADulz WGerman RSchneider V(2011)Veritas - a versatile modeling environment for test-driven agile simulationProceedings of the 2011 Winter Simulation Conference (WSC)10.1109/WSC.2011.6148059(3657-3666)Online publication date: Dec-2011
https://doi.org/10.1109/WSC.2011.6148059

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Scenario-Based statistical testing of quality of service requirements

Killing strategies for model-based mutation testing

Calculating the usage probabilities of statistical usage models by constraints optimization