Cited By
View all- Agh HAzamnouri AWagner S(2024)Software product line testing: a systematic literature reviewEmpirical Software Engineering10.1007/s10664-024-10516-x29:6Online publication date: 2-Sep-2024
Design and Implementation of a Test Automation Framework for Configurable Devices
Pages 200 - 207
Abstract
Test automation supports organizations in developing better products as they gain quick feedback and thus lower the risk of bottlenecks and service disruptions that hinder customer experience. Nevertheless, software testing has always been a time-consuming task. Furthermore, the feedback gained from test execution results has to be accurate to be beneficial. Testing software product lines is particularly time-consuming, as different software variants are needed to reach good coverage. Maintaining separate test suites for different variants is hard. In this paper, we present an approach, that matches the capabilities of available test environments with the requirements of test cases and executes only those test cases that are relevant for a given variant. The approach is meant to reduce execution times by skipping those tests that will never be able to be executed in a given environment and avoid false-negative test execution results. The framework was developed in the context of systems for public transportation, where different hard- and software setups are used depending on the use case (e.g., SIM-Card, GPS-Antenna, Voice-Radio).
References
[1]
Sven Apel, Alexander Von Rhein, Philipp Wendler, Armin Größlinger, and Dirk Beyer. 2013. Strategies for product-line verification: Case studies and experiments. In 2013 35th International Conference on Software Engineering (ICSE). IEEE, 482–491. https://doi.org/10.1109/ICSE.2013.6606594
[2]
Dilara Ateşoğulları and Alok Mishra. 2020. AUTOMATION TESTING TOOLS: A COMPARATIVE VIEW. International Journal on Information Technologies & Security 12, 4(2020).
[3]
Thiago Castro, Leopoldo Teixeira, Vander Alves, Sven Apel, Maxime Cordy, and Rohit Gheyi. 2021. A formal framework of software product line analyses. ACM Transactions on Software Engineering and Methodology (TOSEM) 30, 3(2021), 1–37. https://doi.org/10.1145/3442389
[4]
C.P.Patidar and Aeun Dev Dongre. 2017. An Automated Testing Model Using Test Driven Development Approach. 2017 Oriental Journal of Computer Science and Technology (2017). https://doi.org/10.13005/ojcst/10.02.18
[5]
Felix Dobslaw, Robert Feldt, David Michaëlsson, Patrik Haar, Francisco Gomes de Oliveira Neto, and Richard Torkar. 2019. Estimating return on investment for GUI test automation frameworks. In 2019 IEEE 30th International Symposium on Software Reliability Engineering (ISSRE). IEEE, 271–282. https://doi.org/10.1109/ISSRE.2019.00035
[6]
Docs.pytest.org. 2021. Full pytest documentation - pytest documentation. Retrieved August 24, 2021 from https://docs.pytest.org/en/6.2.x/contents.html
[7]
JDAS Eleutério and CMF Rubira. 2017. A comparative study of dynamic software product line solutions for building self-adaptive systems. Comput. Inst., Univ. Campinas, Portugal, Tech. Rep. C-17-05 (2017).
[8]
Jane Dirce Alves Sandim Eleuterio, Felipe Nunes Gaia, Andrea Bondavalli, Paolo Lollini, Genaína Nunes Rodrigues, and Cecília Mary Fischer Rubira. 2016. On the dependability for dynamic software product lines: A comparative systematic mapping study. In 2016 42th Euromicro Conference on Software Engineering and Advanced Applications (SEAA). IEEE, 323–330. https://doi.org/10.1109/SEAA.2016.40
[9]
Thomas Fehlmann and Eberhard Kranich. 2020. A Framework for Automated Testing. In European Conference on Software Process Improvement. Springer, 275–288. https://doi.org/10.1007/978-3-030-56441-4_20
[10]
Milad Hanna, Amal Elsayed Aboutabl, and Mostafa-Sami M Mostafa. 2018. Automated software testing framework for web applications. International Journal of Applied Engineering Research 13, 11 (2018), 9758–9767.
[11]
Mike Hinchey, Sooyong Park, and Klaus Schmid. 2012. Building Dynamic Software Product Lines. Computer 45, 10 (2012), 22–26. https://doi.org/10.1109/MC.2012.332
[12]
Joby Joy and Devendra Pratap Singh. 2015. A generic framework design to enhance capabilities of an enterprise test automation framework. In 2015 International Conference on Applied and Theoretical Computing and Communication Technology (iCATccT). IEEE, 207–212. https://doi.org/10.1109/ICATCCT.2015.7456883
[13]
Vinodkumar H Kiranagi and Gopal Krishna Shyam. 2017. Feature Driven Hybrid Test Automation Framework (FDHTAF) for web based or cloud based application testing. In 2017 International Conference On Smart Technologies For Smart Nation (SmartTechCon). IEEE, 1555–1559. https://doi.org/10.1109/SmartTechCon.2017.8358626
[14]
Prachi Kunte and Dashrath Mane. 2017. Automation Testing of Web based application with Selenium and HP UFT (QTP). International Research Journal of Engineering and Technology (IRJET) 6 (2017), 2579–2583.
[15]
Bruno Oliveira. 2018. pytest Quick Start Guide: Write better Python code with simple and maintainable tests. Packt Publishing Ltd.
[16]
Bret Pettichord. 1999. Seven steps to test automation success. Star West, November (1999).
[17]
Sachin Sharma and Mrs VISHAWJYOTI. 2012. Study and analysis of automation testing techniques. Journal of global research in computer science 3, 12 (2012), 36–43.
[18]
Isiaka Shuaibu, Mustapha Musa Machina, and Muazzamu Ibrahim. 2019. Investigation onto the Software Testing Techniques and Tools: An Evaluation and Comparative Analysis. 2019 International Journal of Computer Applications 177 (2019), 24–30. https://doi.org/10.5120/ijca2019919685
[19]
Karuturi Sneha and Gowda M Malle. 2017. Research on software testing techniques and software automation testing tools. In 2017 International Conference on Energy, Communication, Data Analytics and Soft Computing (ICECDS). IEEE, 77–81. https://doi.org/10.1109/ICECDS.2017.8389562
[20]
Zhe Sun, Yi Zhang, and Yunqiang Yan. 2019. A Web testing platform based on hybrid automated testing framework. In 2019 IEEE 4th Advanced Information Technology, Electronic and Automation Control Conference (IAEAC), Vol. 1. IEEE, 689–692. https://doi.org/10.1109/IAEAC47372.2019.8997684
[21]
Mubarak Albarka Umar and Chen Zhanfang. 2019. A Study of Automated Software Testing: Automation Tools and Frameworks. International Journal of Computer Science Engineering (IJCSE) 6 (2019), 217–225. https://doi.org/10.5281/zenodo.3924795
[22]
Dietmar Winkler, Reinhard Hametner, and Stefan Biffl. 2009. Automation component aspects for efficient unit testing. In 2009 IEEE Conference on Emerging Technologies & Factory Automation. IEEE, 1–8. https://doi.org/10.1109/ETFA.2009.5347022
[23]
Jun Zhu, Quan Yin, Rui Zhu, Changguo Guo, Huaimin Wang, and Quanyuan Wu. 2008. A Plugin-Based Software Production Line Integrated Framework. In 2008 International Conference on Computer Science and Software Engineering, Vol. 2. IEEE, 562–565. https://doi.org/10.1109/CSSE.2008.562
Recommendations
Generating Test Scripts for Web-Based Applications
SSIP '20: Proceedings of the 2020 3rd International Conference on Sensors, Signal and Image ProcessingTesting process is an essential part of the software development process as it reveals faults of the system which leads to software reliability improvement. Manual software manual testing is a process which testers discover software's faults by hands. ...
JFuzz: A Tool for Automated Java Unit Testing Based on Data Mutation and Metamorphic Testing Methods
TSA '15: Proceedings of the 2015 Second International Conference on Trustworthy Systems and Their ApplicationsAutomated test framework plays a significant role in test driven software development methodologies. The XUnit family of testing tools has been widely used in the industry. However, they are weak in supporting test case generation and test result ...
Continuous test suite augmentation in software product lines
SPLC '13: Proceedings of the 17th International Software Product Line ConferenceSoftware Product Line (SPL) engineering offers several advantages in the development of families of software products. There is still a need, however, to generate test cases for individual products in product lines more efficiently. In this paper we ...
Comments
Information & Contributors
Information
Published In
January 2022
239 pages
ISBN:9781450395571
DOI:10.1145/3512353
Copyright © 2022 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 14 March 2022
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Conference
APIT 2022
APIT 2022: 2022 4th Asia Pacific Information Technology Conference
January 14 - 16, 2022
Virtual Event, Thailand
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- View Citations1Total Citations
- 98Total Downloads
- Downloads (Last 12 months)21
- Downloads (Last 6 weeks)1
Reflects downloads up to 30 Dec 2024
Other Metrics
Citations
Cited By
View all- Agh HAzamnouri AWagner S(2024)Software product line testing: a systematic literature reviewEmpirical Software Engineering10.1007/s10664-024-10516-x29:6Online publication date: 2-Sep-2024
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML Format