short-paper

Open access

Speeding up GUI testing by on-device test generation

Authors:

Nataniel P. Borges, Jr.,

Jenny Rau,

Andreas ZellerAuthors Info & Claims

ASE '20: Proceedings of the 35th IEEE/ACM International Conference on Automated Software Engineering

Pages 1340 - 1343

https://doi.org/10.1145/3324884.3415302

Published: 27 January 2021 Publication History

PDF eReader

Abstract

When generating GUI tests for Android apps, it typically is a separate test computer that generates interactions, which are then executed on an actual Android device. While this approach is efficient in the sense that apps and interactions execute quickly, the communication overhead between test computer and device slows down testing considerably. In this work, we present DD-2, a test generator for Android that tests other apps on the device using Android accessibility services. In our experiments, DD-2 has shown to be 3.2 times faster than its computer-device counterpart, while sharing the same source code.

References

[1]

Domenico Amalfitano, Anna Rita Fasolino, Porfirio Tramontana, Salvatore De Carmine, and Atif M Memon. 2012. Using GUI ripping for automated testing of Android applications. In Proceedings of the 27th IEEE/ACM International Conference on Automated Software Engineering. ACM, 258--261.

Digital Library

Google Scholar

[2]

Tanzirul Azim and Iulian Neamtiu. 2013. Targeted and depth-first exploration for systematic testing of Android apps. In Acm Sigplan Notices, Vol. 48. ACM, 641--660.

Digital Library

Google Scholar

[3]

Nataniel P Borges Jr, Maria Gómez, and Andreas Zeller. 2018. Guiding app testing with mined interaction models. In Proceedings of the 5th International Conference on Mobile Software Engineering and Systems (MobileSoft). ACM, 133--143.

Digital Library

Google Scholar

[4]

Nataniel P Borges Jr, Jenny Hotzkow, and Andreas Zeller. 2018. DroidMate-2: a platform for Android test generation. In Proceedings of the 33rd ACM/IEEE International Conference on Automated Software Engineering (ASE). ACM, 916--919.

Digital Library

Google Scholar

[5]

Shauvik Roy Choudhary, Alessandra Gorla, and Alessandro Orso. 2015. Automated test input generation for Android: Are we there yet? (E). In Automated Software Engineering (ASE), 2015 30th IEEE/ACM International Conference on. IEEE, 429--440.

Digital Library

Google Scholar

[6]

Rahul Gopinath, Carlos Jensen, and Alex Groce. 2014. Code coverage for suite evaluation by developers. In Proceedings of the 36th International Conference on Software Engineering. ACM, 72--82.

Digital Library

Google Scholar

[7]

Pingfan Kong, Li Li, Jun Gao, Kui Liu, Tegawendé F Bissyandé, and Jacques Klein. 2018. Automated Testing of Android Apps: A Systematic Literature Review. IEEE Transactions on Reliability 99 (2018), 1--22.

Google Scholar

[8]

Yuanchun Li, Ziyue Yang, Yao Guo, and Xiangqun Chen. 2019. Humanoid: A Deep Learning-Based Approach to Automated Black-box Android App Testing. In 2019 34th IEEE/ACM International Conference on Automated Software Engineering (ASE). IEEE, 1070--1073.

Digital Library

Google Scholar

[9]

Aravind Machiry, Rohan Tahiliani, and Mayur Naik. 2013. Dynodroid: An input generation system for Android apps. In Proceedings of the 2013 9th Joint Meeting on Foundations of Software Engineering. ACM, 224--234.

Digital Library

Google Scholar

[10]

Ke Mao, Mark Harman, and Yue Jia. 2016. Sapienz: Multi-objective automated testing for Android applications. In Proceedings of the 25th International Symposium on Software Testing and Analysis. ACM, 94--105.

Digital Library

Google Scholar

[11]

Michelle Y Wong and David Lie. 2016. IntelliDroid: A Targeted Input Generator for the Dynamic Analysis of Android Malware. In NDSS, Vol. 16. 21--24.

Google Scholar

Cited By

View all

Nie LSaid KMa LZheng YZhao Y(2023)A systematic mapping study for graphical user interface testing on mobile appsIET Software10.1049/sfw2.1212317:3(249-267)Online publication date: 2-Mar-2023
https://dl.acm.org/doi/10.1049/sfw2.12123
Said KNie LAjibode AZhou X(2020)GUI testing for mobile applications: objectives, approaches and challengesProceedings of the 12th Asia-Pacific Symposium on Internetware10.1145/3457913.3457931(51-60)Online publication date: 1-Nov-2020
https://dl.acm.org/doi/10.1145/3457913.3457931

Index Terms

Speeding up GUI testing by on-device test generation
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms
      1. Graphical user interfaces
  2. Ubiquitous and mobile computing
    1. Ubiquitous and mobile devices
      1. Smartphones
2. Software and its engineering
  1. Software creation and management
    1. Software verification and validation
      1. Software defect analysis
        Software testing and debugging
  2. Software organization and properties
    1. Software functional properties
      1. Formal methods
        Dynamic analysis

Recommendations

DroidMate-2: a platform for Android test generation
ASE '18: Proceedings of the 33rd ACM/IEEE International Conference on Automated Software Engineering

Android applications (apps) represent an ever increasing portion of the software market. Automated test input generators are the state of the art for testing and security analysis. We introduce DroidMate-2 (DM-2), a platform to easily assist both ...
ChimpCheck: property-based randomized test generation for interactive apps
Onward! 2017: Proceedings of the 2017 ACM SIGPLAN International Symposium on New Ideas, New Paradigms, and Reflections on Programming and Software

We consider the problem of generating relevant execution traces to test rich interactive applications. Rich interactive applications, such as apps on mobile platforms, are complex stateful and often distributed systems where sufficiently exercising the ...
Sapienz: multi-objective automated testing for Android applications
ISSTA 2016: Proceedings of the 25th International Symposium on Software Testing and Analysis

We introduce Sapienz, an approach to Android testing that uses multi-objective search-based testing to automatically explore and optimise test sequences, minimising length, while simultaneously maximising coverage and fault revelation. Sapienz combines ...

Comments

Information & Contributors

Information

Published In

ASE '20: Proceedings of the 35th IEEE/ACM International Conference on Automated Software Engineering

December 2020

1449 pages

ISBN:9781450367684

DOI:10.1145/3324884

General Chair:
John Grundy,
Program Chairs:
Claire Le Goues,
David Lo

This work is licensed under a Creative Commons Attribution International 4.0 License.

In-Cooperation

IEEE CS

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 27 January 2021

Check for updates

Author Tags

Qualifiers

Short-paper

Conference

ASE '20

Sponsor:

ASE '20: 35th IEEE/ACM International Conference on Automated Software Engineering

December 21 - 25, 2020

Virtual Event, Australia

Acceptance Rates

Overall Acceptance Rate 82 of 337 submissions, 24%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
425
Total Downloads

Downloads (Last 12 months)125
Downloads (Last 6 weeks)20

Reflects downloads up to 25 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Nie LSaid KMa LZheng YZhao Y(2023)A systematic mapping study for graphical user interface testing on mobile appsIET Software10.1049/sfw2.1212317:3(249-267)Online publication date: 2-Mar-2023
https://dl.acm.org/doi/10.1049/sfw2.12123
Said KNie LAjibode AZhou X(2020)GUI testing for mobile applications: objectives, approaches and challengesProceedings of the 12th Asia-Pacific Symposium on Internetware10.1145/3457913.3457931(51-60)Online publication date: 1-Nov-2020
https://dl.acm.org/doi/10.1145/3457913.3457931

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

DroidMate-2: a platform for Android test generation

ChimpCheck: property-based randomized test generation for interactive apps

Sapienz: multi-objective automated testing for Android applications