Article

Free access

Multivariate visualization in observation-based testing

Authors:

David Leon,

Andy Podgurski,

Lee J. WhiteAuthors Info & Claims

ICSE '00: Proceedings of the 22nd international conference on Software engineering

Pages 116 - 125

https://doi.org/10.1145/337180.337195

Published: 01 June 2000 Publication History

PDF eReader

Abstract

We explore the use of multivariate visualization techniques to support a new approach to test data selection, called observation-based testing. Applications of multivariate visualization are described, including: evaluating and improving synthetic tests; filtering regression test suites; filtering captured operational executions; comparing test suites; and assessing bug reports. These applications are illustrated by the use of correspondence analysis to analyze test inputs for the GNU GCC compiler.

References

[1]

Borg, I. and Groenen, P. Modern Multidimensional Scaling: Theory and Applications, Springer, 1997.

Digital Library

Google Scholar

[2]

GCC. The GCC Home Page, http://www.gnu.org/software/gcc/gcc.html, Free Software Foundation, 1999.

Google Scholar

[3]

Greenacre, M.J. Theory and Applications of Correspondence Analysis, Academic Press, 1984.

Google Scholar

[4]

Hanson, S.J., Kraut, R.E, and Farber, J.M. Interface design and multivariate analysis of UNIX command use. ACM Transactions on Office Information Systems 2, 1 (March 1984), 42-57.

Digital Library

Google Scholar

[5]

Harrold, M.J., Gupta, R., and Soffa, M.L. A methodology for controlling the size of a test suite. ACM Transactions on Software Engineering and Methodology 2, 3 (July 1993), 270-285.

Digital Library

Google Scholar

[6]

Harrold, M.J., Rothermel, G., Wu, R., and Yi, L. An empirical investigation of program spectra. ACM SIGPLAN-SIGSOFT Workshop on Program Analysis for Software Tools and Engineering (Montreal, Canada, June 1998), 83-90.

Digital Library

Google Scholar

[7]

Harville, D.A. Matrix Algebra From a Statistician's Perspective. Springer-Verlag, 1997.

Crossref

Google Scholar

[8]

Krzanowski, W.J. Principles of Multivariate Analysis: A User's Perspective, Oxford Science Publications, 1988.

Digital Library

Google Scholar

[9]

Pavlopoulou, C. and Young, M. Residual test coverage monitoring. Proceedings of the 21 st International Conference on Software Engineering (Los Angeles, CA, May 1999), ACM Press, 277-284.

Digital Library

Google Scholar

[10]

Podgurski, A., Masri, W., McCleese, Y., Wolff, F.G., and Yang, C. Estimation of software reliability by stratified sampling. ACM Transactions on Software Engineering and Methodology 8, 9 (July, 1999), 263- 283.

Digital Library

Google Scholar

[11]

Podgurski, A. and Yang, C. Partition testing, stratified sampling, and cluster analysis. Proceedings of the First ACM Symposium on Foundations of Software Engineering (Los Angeles, CA, December 1993), ACM Press, 169-181.

Digital Library

Google Scholar

[12]

Reps, T., Ball, T., Das, M., and Larus, J. The use of program profiling for software maintenance with applications to the Year 2000 Problem. Proceedings of the 6th European Software Engineering Conference and 5th ACM SIGSOFT Symposium on the Foundations of Software Engineering (Zurich, Switzerland, September 1997), ACM Press, 432-449.

Digital Library

Google Scholar

[13]

Rothermel, G. and Harrold, M.J. A safe, efficient regression test algorithm. IEEE Transactions on Software Engineering 6, 10 (April 1997), 170-210.

Digital Library

Google Scholar

[14]

X.Org. http://www.x.org/, X.Org, 1999.

Google Scholar

Cited By

View all

Chen ALiu RXie LChen ZSu HYu J(2022)SofGAN: A Portrait Image Generator with Dynamic StylingACM Transactions on Graphics10.1145/347084841:1(1-26)Online publication date: 9-Feb-2022
https://dl.acm.org/doi/10.1145/3470848
Zhu LZheng CLu XCheng ZNie LZhang H(2021)Efficient Multi-modal Hashing with Online Query Adaption for Multimedia RetrievalACM Transactions on Information Systems10.1145/347718040:2(1-36)Online publication date: 27-Sep-2021
https://dl.acm.org/doi/10.1145/3477180
Zhu NCao JLu XXiong H(2021)Learning a Hierarchical Intent Model for Next-Item RecommendationACM Transactions on Information Systems10.1145/347397240:2(1-28)Online publication date: 27-Sep-2021
https://dl.acm.org/doi/10.1145/3473972
Show More Cited By

Index Terms

Multivariate visualization in observation-based testing

Recommendations

Fault-based test suite prioritization for specification-based testing

Context: Existing test suite prioritization techniques usually rely on code coverage information or historical execution data that serve as indicators for estimating the fault-detecting ability of test cases. Such indicators are primarily empirical in ...
Grey-box concolic testing on binary code
ICSE '19: Proceedings of the 41st International Conference on Software Engineering

We present grey-box concolic testing, a novel path-based test case generation method that combines the best of both white-box and grey-box fuzzing. At a high level, our technique systematically explores execution paths of a program under test as in white-...
Assessing model-based testing: an empirical study conducted in industry
ICSE Companion 2014: Companion Proceedings of the 36th International Conference on Software Engineering

We compare manual testing without any automation performed by a tester at a software company with model-based testing (MBT) performed by a tester at a research center.

The system under test (SUT), of which two different versions were tested by each ...

Comments

Information & Contributors

Information

Published In

ICSE '00: Proceedings of the 22nd international conference on Software engineering

June 2000

843 pages

ISBN:1581132069

DOI:10.1145/337180

Chairmen:
Carlo Ghezzi
Politecnico di Milano, Milau, Italy
,
Mehdi Jazayeri
Technical Univ. of Vienna, Vienna, Austria
,
Alexander L. Wolf
Univ. of Colorado, Boulder, USA

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 June 2000

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

ICSE00

Sponsor:

Irish Comp Soc
SIGSOFT
IEEE-CS

ICSE00: 22nd International Conference on Software Engineering

June 4 - 11, 2000

Limerick, Ireland

Acceptance Rates

Overall Acceptance Rate 276 of 1,856 submissions, 15%

Upcoming Conference

ICSE 2025

2025 IEEE/ACM 46th International Conference on Software Engineering

April 26 - May 3, 2025

Ottawa , ON , Canada

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

33
Total Citations
View Citations
757
Total Downloads

Downloads (Last 12 months)53
Downloads (Last 6 weeks)16

Reflects downloads up to 10 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Chen ALiu RXie LChen ZSu HYu J(2022)SofGAN: A Portrait Image Generator with Dynamic StylingACM Transactions on Graphics10.1145/347084841:1(1-26)Online publication date: 9-Feb-2022
https://dl.acm.org/doi/10.1145/3470848
Zhu LZheng CLu XCheng ZNie LZhang H(2021)Efficient Multi-modal Hashing with Online Query Adaption for Multimedia RetrievalACM Transactions on Information Systems10.1145/347718040:2(1-36)Online publication date: 27-Sep-2021
https://dl.acm.org/doi/10.1145/3477180
Zhu NCao JLu XXiong H(2021)Learning a Hierarchical Intent Model for Next-Item RecommendationACM Transactions on Information Systems10.1145/347397240:2(1-28)Online publication date: 27-Sep-2021
https://dl.acm.org/doi/10.1145/3473972
Zehnder JCoros SThomaszewski B(2021)SGN: Sparse Gauss-Newton for Accelerated Sensitivity AnalysisACM Transactions on Graphics10.1145/347000541:1(1-10)Online publication date: 22-Sep-2021
https://dl.acm.org/doi/10.1145/3470005
Rossi ABarbosa DFirmani DMatinata AMerialdo P(2021)Knowledge Graph Embedding for Link PredictionACM Transactions on Knowledge Discovery from Data10.1145/342467215:2(1-49)Online publication date: 4-Jan-2021
https://dl.acm.org/doi/10.1145/3424672
Fard MHasanloo MKargahi M(2021)Analytical Program Power Characterization for Battery Depletion-time EstimationACM Transactions on Embedded Computing Systems10.1145/342151120:2(1-9)Online publication date: 4-Jan-2021
https://dl.acm.org/doi/10.1145/3421511
Bou-Chaaya KChbeir RAlraja MArnould PPerera CBarhamgi MBenslimane D(2021)δ-: Toward Context-aware Multi-objective Privacy Management in Connected EnvironmentsACM Transactions on Internet Technology10.1145/341849921:2(1-31)Online publication date: 24-May-2021
https://dl.acm.org/doi/10.1145/3418499
Masri WAssi R(2014)Prevalence of coincidental correctness and mitigation of its impact on fault localizationACM Transactions on Software Engineering and Methodology10.1145/255993223:1(1-28)Online publication date: 20-Feb-2014
https://dl.acm.org/doi/10.1145/2559932
Bauer EKüster JEngels G(2011)Test suite quality for model transformation chainsProceedings of the 49th international conference on Objects, models, components, patterns10.5555/2025896.2025899(3-19)Online publication date: 28-Jun-2011
https://dl.acm.org/doi/10.5555/2025896.2025899
Yilmaz CPorter ARoman Gvan der Hoek A(2010)Combining hardware and software instrumentation to classify program executionsProceedings of the eighteenth ACM SIGSOFT international symposium on Foundations of software engineering10.1145/1882291.1882304(67-76)Online publication date: 7-Nov-2010
https://dl.acm.org/doi/10.1145/1882291.1882304
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Fault-based test suite prioritization for specification-based testing

Grey-box concolic testing on binary code

Assessing model-based testing: an empirical study conducted in industry