research-article

Event trace reduction for effective bug replay of Android apps via differential GUI state analysis

Authors:

Jingling XueAuthors Info & Claims

ESEC/FSE 2019: Proceedings of the 2019 27th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering

Pages 1095 - 1099

https://doi.org/10.1145/3338906.3341183

Published: 12 August 2019 Publication History

Abstract

Existing Android testing tools, such as Monkey, generate a large quantity and a wide variety of user events to expose latent GUI bugs in Android apps. However, even if a bug is found, a majority of the events thus generated are often redundant and bug-irrelevant. In addition, it is also time-consuming for developers to localize and replay the bug given a long and tedious event sequence (trace).

This paper presents ECHO, an event trace reduction tool for effective bug replay by using a new differential GUI state analysis. Given a sequence of events (trace), ECHO aims at removing bug-irrelevant events by exploiting the differential behavior between the GUI states collected when their corresponding events are triggered. During dynamic testing, ECHO injects at most one lightweight inspection event after every event to collect its corresponding GUI state. A new adaptive model is proposed to selectively inject inspection events based on sliding windows to differentiate the GUI states on-the-fly in a single testing process. The experimental results show that ECHO improves the effectiveness of bug replay by removing 85.11% redundant events on average while also revealing the same bugs as those detected when full event sequences are used.

References

[1]

{n.d.}. Addi, a math calculation environment. https://f-droid.org/en/packages/ com.addi/

[2]

{n.d.}. Appium: Mobile App Automation Made Awesome. http://appium.io/

[3]

{n.d.}. F-Droid: Open-Source Android Apps Repository. https://f-droid.org/

[4]

{n.d.}. Google Monkey. https://developer.android.com/studio/test/monkey.html

[5]

Saswat Anand, Mayur Naik, Mary Jean Harrold, and Hongseok Yang. 2012. Automated Concolic Testing of Smartphone Apps. In FSE ’12. 59.

Digital Library

[6]

Tanzirul Azim and Iulian Neamtiu. 2013. Targeted and Depth-first Exploration for Systematic Testing of Android Apps. In OOPSLA ’13. 641–660.

Digital Library

[7]

Young-Min Baek and Doo-Hwan Bae. 2016. Automated Model-based Android GUI Testing Using Multi-level GUI Comparison Criteria. In ASE ’16. 238–249.

Digital Library

[8]

Wontae Choi, George Necula, and Koushik Sen. 2013. Guided GUI Testing of Android Apps with Minimal Restart and Approximate Learning. In OOPSLA ’13. 623–640.

Digital Library

[9]

Wontae Choi, Koushik Sen, George Necula, and Wenyu Wang. 2018. DetReduce: minimizing Android GUI test suites for regression testing. In ICSE ’18. ACM, 445–455.

Digital Library

[10]

Shauvik Roy Choudhary, Alessandra Gorla, and Alessandro Orso. 2015. Automated Test Input Generation for Android: Are We There Yet? (E). In ASE ’15. 429–440.

Digital Library

[11]

Lazaro Clapp, Osbert Bastani, Saswat Anand, and Alex Aiken. 2016. Minimizing GUI Event Traces. In FSE ’16. 422–434.

Digital Library

[12]

Xiang Gao, Shin Hwei Tan, Zhen Dong, and Abhik Roychoudhury. 2018. Android testing via synthetic symbolic execution. In ASE ’18. ACM, 419–429.

Digital Library

[13]

Casper S Jensen, Mukul R Prasad, and Anders Møller. 2013. Automated testing with targeted event sequence generation. In ISSTA ’13. ACM, 67–77.

Digital Library

[14]

Bo Jiang, Yuxuan Wu, Teng Li, and W. K. Chan. 2017. SimplyDroid: Efficient Event Sequence Simplification for Android Application. In ASE ’17. 297–307.

Digital Library

[15]

Aravind Machiry, Rohan Tahiliani, and Mayur Naik. 2013. Dynodroid: An Input Generation System for Android Apps. In FSE ’13. 224–234.

Digital Library

[16]

Riyadh Mahmood, Nariman Mirzaei, and Sam Malek. 2014. EvoDroid: Segmented Evolutionary Testing of Android Apps. In FSE ’14. 599–609.

Digital Library

[17]

Ke Mao, Mark Harman, and Yue Jia. {n.d.}. Sapienz: Multi-objective Automated Testing for Android Applications. In ISSTA ’16. 94–105.

Digital Library

[18]

Nariman Mirzaei, Joshua Garcia, Hamid Bagheri, Alireza Sadeghi, and Sam Malek. 2016. Reducing Combinatorics in GUI Testing of Android Applications. In ICSE ’16. 559–570.

Digital Library

[19]

Wei Song, Xiangxing Qian, and Jeff Huang. 2017. EHBDroid: Beyond GUI Testing for Android Applications. In ASE ’17. 27–37.

Digital Library

[20]

Ting Su, Guozhu Meng, Yuting Chen, Ke Wu, Weiming Yang, Yao Yao, Geguang Pu, Yang Liu, and Zhendong Su. {n.d.}. Guided, Stochastic Model-based GUI Testing of Android Apps. In FSE ’17. 245–256.

Digital Library

[21]

Yulei Sui and Jingling Xue. 2016. SVF: interprocedural static value-flow analysis in LLVM. In CC ’16. ACM, 265–266.

Digital Library

[22]

Wenyu Wang, Dengfeng Li, Wei Yang, Yurui Cao, Zhenwen Zhang, Yuetang Deng, and Tao Xie. 2018. An empirical study of android test generation tools in industrial cases. In ASE ’18. ACM, 738–748.

Digital Library

[23]

Diyu Wu, Jie Liu, Yulei Sui, Shiping Chen, and Jingling Xue. 2019. Precise Static Happens-Before Analysis for Detecting UAF Order Violations in Android. In ICST ’19. IEEE, 276–287.

[24]

Xuezheng Xu, Yulei Sui, Hua Yan, and Jingling Xue. 2019. VFix: value-flow-guided precise program repair for null pointer dereferences. In ICSE ’19. IEEE Press, 512–523.

Digital Library

[25]

Andreas Zeller. 1999. Yesterday, My Program Worked. Today, It Does Not. Why?. In FSE ’99. 253–267.

Digital Library

[26]

A. Zeller and R. Hildebrandt. 2002. Simplifying and isolating failure-inducing input. IEEE Transactions on Software Engineering 28, 2 (2002), 183–200.

Digital Library

Cited By

Cao SPan MPei YYang WZhang TWang LLi XRoychoudhury APaiva AAbreu RStorey M(2024)Comprehensive Semantic Repair of Obsolete GUI Test Scripts for Mobile ApplicationsProceedings of the IEEE/ACM 46th International Conference on Software Engineering10.1145/3597503.3639108(1-13)Online publication date: 20-May-2024
https://dl.acm.org/doi/10.1145/3597503.3639108
Feng SChen CRoychoudhury APaiva AAbreu RStorey M(2024)Prompting Is All You Need: Automated Android Bug Replay with Large Language ModelsProceedings of the IEEE/ACM 46th International Conference on Software Engineering10.1145/3597503.3608137(1-13)Online publication date: 20-May-2024
https://dl.acm.org/doi/10.1145/3597503.3608137
Nam SSeo Y(2023)GUI Component Detection-Based Automated Software Crash DiagnosisElectronics10.3390/electronics1211238212:11(2382)Online publication date: 24-May-2023
https://doi.org/10.3390/electronics12112382
Show More Cited By

Index Terms

Event trace reduction for effective bug replay of Android apps via differential GUI state analysis
1. Theory of computation
  1. Semantics and reasoning
    1. Program reasoning
      1. Program analysis

Recommendations

GIFdroid: automated replay of visual bug reports for Android apps
ICSE '22: Proceedings of the 44th International Conference on Software Engineering

Bug reports are vital for software maintenance that allow users to inform developers of the problems encountered while using software. However, it is difficult for non-technical users to write clear descriptions about the bug occurrence. Therefore, more ...
An Empirical Analysis of Bug Reports and Bug Fixing in Open Source Android Apps
CSMR '13: Proceedings of the 2013 17th European Conference on Software Maintenance and Reengineering

Smartphone platforms and applications (apps) have gained tremendous popularity recently. Due to the novelty of the smartphone platform and tools, and the low barrier to entry for app distribution, apps are prone to errors, which affects user experience ...
GIFdroid: an automated light-weight tool for replaying visual bug reports
ICSE '22: Proceedings of the ACM/IEEE 44th International Conference on Software Engineering: Companion Proceedings

Bug reports are vital for software maintenance that allow users to inform developers of the problems encountered while using software. However, it is difficult for non-technical users to write clear descriptions about the bug occurrence. Therefore, more ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

ESEC/FSE 2019: Proceedings of the 2019 27th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering

August 2019

1264 pages

ISBN:9781450355728

DOI:10.1145/3338906

General Chairs:
Marlon Dumas
University of Tartu, Estonia
,
Dietmar Pfahl
University of Tartu, Estonia
,
Program Chairs:
Sven Apel
Saarland University, Germany
,
Alessandra Russo
Imperial College, UK

Copyright © 2019 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGSOFT: ACM Special Interest Group on Software Engineering

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 12 August 2019

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

ESEC/FSE '19

Sponsor:

SIGSOFT

ESEC/FSE '19: 27th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering

August 26 - 30, 2019

Tallinn, Estonia

Acceptance Rates

Overall Acceptance Rate 112 of 543 submissions, 21%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

7
Total Citations
View Citations
263
Total Downloads

Downloads (Last 12 months)14
Downloads (Last 6 weeks)1

Reflects downloads up to 05 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Cao SPan MPei YYang WZhang TWang LLi XRoychoudhury APaiva AAbreu RStorey M(2024)Comprehensive Semantic Repair of Obsolete GUI Test Scripts for Mobile ApplicationsProceedings of the IEEE/ACM 46th International Conference on Software Engineering10.1145/3597503.3639108(1-13)Online publication date: 20-May-2024
https://dl.acm.org/doi/10.1145/3597503.3639108
Feng SChen CRoychoudhury APaiva AAbreu RStorey M(2024)Prompting Is All You Need: Automated Android Bug Replay with Large Language ModelsProceedings of the IEEE/ACM 46th International Conference on Software Engineering10.1145/3597503.3608137(1-13)Online publication date: 20-May-2024
https://dl.acm.org/doi/10.1145/3597503.3608137
Nam SSeo Y(2023)GUI Component Detection-Based Automated Software Crash DiagnosisElectronics10.3390/electronics1211238212:11(2382)Online publication date: 24-May-2023
https://doi.org/10.3390/electronics12112382
Nie LSaid KMa LZheng YZhao Y(2023)A systematic mapping study for graphical user interface testing on mobile appsIET Software10.1049/sfw2.1212317:3(249-267)Online publication date: 2-Mar-2023
https://doi.org/10.1049/sfw2.12123
Gao YXu GLi LLuo XWang CSui YRoychoudhury ACadar CKim M(2022)Demystifying the underground ecosystem of account registration botsProceedings of the 30th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering10.1145/3540250.3549090(897-909)Online publication date: 7-Nov-2022
https://dl.acm.org/doi/10.1145/3540250.3549090
Feng SChen CDwyer MDamian DZeller A(2022)GIFdroidProceedings of the 44th International Conference on Software Engineering10.1145/3510003.3510048(1045-1057)Online publication date: 21-May-2022
https://dl.acm.org/doi/10.1145/3510003.3510048
Yan JZhou HDeng XWang PYan RYan JZhang J(2020)Efficient testing of GUI applications by event sequence reductionScience of Computer Programming10.1016/j.scico.2020.102522(102522)Online publication date: Aug-2020
https://doi.org/10.1016/j.scico.2020.102522

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten