Comparison of software product line test derivation methods from the reuse viewpoint
Authors: 
Sungwon Kang, Jungmin Kim, Haeun Baek, Hwi Ahn, Pilsu Jung, Jihyun LeeAuthors Info & Claims
Sungwon Kang, Jungmin Kim, Haeun Baek, Hwi Ahn, Pilsu Jung, Jihyun LeeAuthors Info & ClaimsPages 1 - 8
Abstract
Product line test development is more complicated than test development for a single application, as the former has to deal with variability among assets (artifacts) and is carried out in two separate but related development phases, i.e. domain engineering and application engineering. Different software product test development methods provide different opportunities for reuse depending on how variability is represented in the domain test artifacts, when binding is formed and applied and also when test data are determined. This paper compares and analyzes the six major methods for the software product line test development in the literature. Through the comparison, we find out that existing software product line testing methods did not fully consider the aspects of software product line that are essential for reuse in software product line development such as variability representation, binding formation and application time and test data determination time. As the conclusion of this literature review, this paper suggests future research opportunities for software product line testing to explore.
References
[1]
Gomaa, H.: 'Designing Software Product Lines with UML: From Use Cases to Pattern-Based Software Architectures'. Addison-Wesley, July 2004.
[2]
Pohl, K., Böckle, G., and Linden, F.: Software Product Line Engineering: Foundations, Principles, and Techniques. Springer, 2005.
[3]
Taylor, R. N., Medvidovic, N., and Dashofy, E.: 'Software Architecture: Foundations, Theory, and Practice'. John Wiley & Sons, USA, January 2009.
[4]
Kauppinen, R., and Taina, J. J.: 'Rita environment for testing framework-based software product lines'. The 8th Symposium on Programming Languages and Software Tools 2003; 58--69.
[5]
Kamsties E., Pohl K., Reis S., and Reuys, A.: 'Testing Variabilities in Use Case Models'. Software Product family Engineering (PFE) 2003; 6--18, Springer-Verlag 2004.
[6]
Geppert, B., Li, J., RoBler, F., and Weiss, D.: 'Towards generating acceptance tests for product lines.' 8th International Conference on Software Reuse (ICSR) 2004; 35--48.
[7]
Reuys, A., Reis, S., Kamsties, E., and Pohl, K.: 'The ScenTED Method for Testing of Software Product'. Software Product Lines: Research Issues in Engineering and Management, 2006; 479--520.
[8]
Bertolino, A., Fantechi, A., Gnesi, S., and Lami, G.: 'Product Line Use Cases: Scenario-Based Specification and Testing of Requirements'. Software Product Lines: Research Issues in Engineering and Management 2006; 425--445.
[9]
Nebut, C., Le Traon, Y., and Jézéquel, J.: 'System Testing of Product Lines: From Requirements to Test Cases'. Software Product Lines: Research Issues in Engineering and Management 2006; 447--477.
[10]
Kang, S., Lee, J., Kim, M., and Lee, W.: 'Towards a Formal Framework for Product Line Test Development'. Computer and Information Technology (CIT) 2007; 921--926.
[11]
Cohen, M., Dwyer, M., and Shi, J.: 'Constructing Interaction Test Suites for Highly-Configurable Systems in the Presence of Constraints: A Greedy Approach'. IEEE Transactions on Software Engineering 2008; 34 (5): 633--650.
[12]
Olimpiew, E., and Gomaa, H.: 'Reusable Model-Based Testing. 11th International Conference on Software Reuse (ICSR) 2009; 76--85.
[13]
Stricker, V., Metzger, A., and Pohl, K.: 'Avoiding Redundant Testing in Application Engineering'. 14th International Software Product Line Conference (SPLC) 2010; 226--240.
[14]
McGregor, J.: 'Testing a Software Product Line'. Carnegie Mellon University, Software Engineering Institute, Technical Report CMU/SEI-2001-TR-022
[15]
Muccini, H., and van der Hoek, A.: 'Towards testing product line architectures'. Electronic Notes in Theoretical Computer Science 2003; 82 (6): 99--109.
[16]
Tevanlinna, A., Taina, J., and Kauppinen, R.: 'Product family testing: a survey'. ACM SIGSOFT Software Engineering Notes 2004; 29 (2): 12--17.
[17]
Edwin, O.: 'Testing in Software Product Lines.' Master Dissertation, School of Engineering, Blekinge Institute of Technology, Sweden, 2007.
[18]
Lamancha, B. P., Usaola, M. P., and Velthius, M. P.: 'Software Product Line Testing - A Systematic Review'. International Conference on Software and Data Technologies (ICSOFT) 2009; 23--30.
[19]
Neto, P., Machado, I., McGregor, J., Almeida, E., and Meira, S.: 'A systematic mapping study of software product lines testing'. Information and Software Technology 2011; 53 (5): 407--423.
[20]
Engström, E., and Runeson, P.: 'Software product line testing - A systematic mapping study'. Information and Software Technology 2011; 53 (1): 2--13.
[21]
Lee, J., Kang, S., and Lee, D.: 'A Survey on Software Product Line Testing'. 16th International Software Product Line Conference (SPLC) 2012; 31--40.
[22]
Reuys, A., Reis, S., Kamsties, E., and Pohl, K.: 'Derivation of Domain Test Scenarios from Activity Diagrams'. International Workshop on Product Line Engineering the Early Steps: Planning, Modeling, and Managing (PLEES) 2003.
[23]
Kamsties, E., Pohl, K., and Reuys, A.: 'Supporting Test Case Derivation in Domain Engineering'. Integrated Design and Process Technology (IDPT) 2003.
[24]
Reuys, A., Kamsties, E., Pohl, K., and Reis, S.: 'Model-based system testing of software product families'. Advanced Information Systems Engineering (CAiSE) 2005; 519--534.
[25]
Bertolino, A., and Gnesi, S.: 'Use Case-Based Testing of Product Lines'. The 9th European Software Engineering Conference/10th ACM SIGSOFT International Symposium on Foundations of Software Engineering 2003; 355--358.
[26]
Bertolino, A., Gnesi, S., and di Pisa, A.: 'Pluto: A test methodology for product families'. Software Product family Engineering (PFE)2003; 181--197, Springer-Verlag 2004.
[27]
Nebut, C., Pickin, S., Le Traon, Y., and Jezequel, J.: 'Automated requirements-based generation of test cases for product families.' 18th IEEE International Conference on Automated software Engineering, 2003; 263--266.
[28]
Nebut, C., Fleurey, F., Le Traon, and Y., Jézéquel, J.: A Requirement-Based Approach to Test Product Families. Software Product family Engineering (PFE) 2003; 198--210, Springer-Verlag 2004.
[29]
Olimpiew, E., and Gomaa, H.: 'Model-based testing for applications derived from software product lines'. Workshop on Advances in model-based testing, 2005; 1--7.
[30]
Cohen, M., Dwyer, M., and Shi, J.: 'Coverage and adequacy in software product line testing'. Workshop on Role of Software Architecture for Testing and Analysis (ISSTA) 2006; 53--63.
[31]
Kang, S., Shin, J., and Kim, M.: 'Interoperability Test Suite Derivation for Communication Protocols'. Computer Networks 2000; 32 (3): 347--364.
Index Terms
- Comparison of software product line test derivation methods from the reuse viewpoint
Recommendations
A survey on software product line testing
SPLC '12: Proceedings of the 16th International Software Product Line Conference - Volume 1Software product line (SPL) testing consists of two separate but closely related test engineering activities: domain testing and application testing. Various software product line testing approaches have been developed over the last decade, and surveys ...
Automated code-based test case reuse for software product line testing
Abstract ContextA software product line (SPL) grows in size as a new product is developed. A new product in an SPL should be tested extensively for quality assurance. For the efficient testing, previous studies suggested reusing the existing test cases ...
Systematic Software Product Line Test Case Derivation for Test Data Reuse
COMPSAC '15: Proceedings of the 2015 IEEE 39th Annual Computer Software and Applications Conference - Volume 03This paper proposes a systematic software product line test case derivation method that reuses test data. With the method, significant test cases reduction can be achieved over the conventional software product line testing. The key to achieving reuse ...
Comments
Information & Contributors
Information
Published In
February 2017
339 pages
Copyright © 2017 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 26 February 2017
Check for updates
Author Tags
Qualifiers
- Research-article
Conference
ICSCA 2017
ICSCA 2017: 2017 6th International Conference on Software and Computer Applications
February 26 - 28, 2017
Bangkok, Thailand
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 136Total Downloads
- Downloads (Last 12 months)1
- Downloads (Last 6 weeks)0
Reflects downloads up to 15 Sep 2024
Other Metrics
Citations
View Options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in