short-paper

SoCRATES: Scala radar for test smells

Authors:

Jonas De Bleser,

Dario Di Nucci,

Coen De RooverAuthors Info & Claims

Scala '19: Proceedings of the Tenth ACM SIGPLAN Symposium on Scala

Pages 22 - 26

https://doi.org/10.1145/3337932.3338815

Published: 17 July 2019 Publication History

Abstract

Test smells are indications of poorly designed unit tests. Previous studies have demonstrated their negative impact on test understanding and maintenance. Moreover, surveys show that developers are not able to identify test smells, hindering optimal software quality. Automated tools can aid developers to handle these issues and detect test smells in the early stage of software development. However, few tools are publicly available and all of them target JUnit -- the most popular testing framework in Java. To overcome these limitations, we propose SoCRATES. This fully automated tool is able to identify six test smells in Scala Test which is the most prevalent testing framework in Scala. An empirical investigation on 164 Scala projects shows that our tool is able to reach a high precision without sacrificing recall. Moreover, the results show that Scala projects have a lower diffusion than Java projects. We make SoCRATES publicly available as an IntelliJ IDEA plugin, as well as an open-source project in order to facilitate the detection of test smells.

References

[1]

Gabriele Bavota, Abdallah Qusef, Rocco Oliveto, Andrea De Lucia, and David Binkley. 2012. An empirical analysis of the distribution of unit test smells and their impact on software maintenance. In Software Maintenance (ICSM), 2012 28th IEEE International Conference on. IEEE, 56--65.

Digital Library

[2]

Gabriele Bavota, Abdallah Qusef, Rocco Oliveto, Andrea De Lucia, and Dave Binkley. 2015. Are test smells really harmful? An empirical study. Empirical Software Engineering 20, 4 (2015), 1052--1094.

Digital Library

[3]

Kent Beck. 2003. Test-driven development: by example. Addison-Wesley Professional.

Digital Library

[4]

Jonas De Bleser, Dario Di Nucci, and Coen De Roover. 2019. Appendix: SoCRATES - Scala Radar for Test Smells. (4 2019).

[5]

Jonas De Bleser, Dario Di Nucci, and Coen De Roover. 2019. Assessing Diffusion and Perception of Test Smells in Scala Projects. In Proceedings of the 16th International Conference on Mining Software Repositories.

Digital Library

[6]

M. Greiler, Arie van Deursen, and M.-A. Storey. 2013. Automated Detection of Test Fixture Strategies and Smells. In Proceedings of the International Conference on Software Testing, Verification and Validation (ICST). 322--331.

Digital Library

[7]

Michaela Greiler, Andy Zaidman, Arie van Deursen, and M.-A. Storey. 2013. Strategies for Avoiding Text Fixture Smells During Software Evolution. In Proceedings of the 10th Working Conference on Mining Software Repositories (MSR). IEEE, 387--396.

Digital Library

[8]

Roland Kuhn, Brian Hanafee, and Jamie Allen. 2017. Reactive design patterns. Manning Publications Company.

Digital Library

[9]

Michael Nash and Wade Waldron. 2016. Applied Akka Patterns: A Hands-On Guide to Designing Distributed Applications. "O'Reilly Media, Inc.".

Digital Library

[10]

Martin Odersky, Philippe Altherr, Vincent Cremet, Burak Emir, Stphane Micheloud, Nikolay Mihaylov, Michel Schinz, Erik Stenman, and Matthias Zenger. 2007. The Scala language specification. (2007).

[11]

Fabio Palomba, Gabriele Bavota, Massimiliano Di Penta, Fausto Fasano, Rocco Oliveto, and Andrea De Lucia. 2018. On the diffuseness and the impact on maintainability of code smells: a large scale empirical investigation. Empirical Software Engineering 23, 3 (2018), 1188--1221.

Digital Library

[12]

Fabio Palomba, Dario Di Nucci, Annibale Panichella, Rocco Oliveto, and Andrea De Lucia. 2016. On the diffusion of test smells in automatically generated test code: An empirical study. In Proceedings of the 9th International Workshop on Search-Based Software Testing. ACM, 5--14.

Digital Library

[13]

A. Schneider. 2000. JUnit best practices (Java World).

[14]

Davide Spadini, Fabio Palomba, Andy Zaidman, Magiel Bruntink, and Alberto Bacchelli. 2018. On the relation of test smells to software code quality. In Proceedings of the International Conference on Software Maintenance and Evolution (ICSME). IEEE.

[15]

Michele Tufano, Fabio Palomba, Gabriele Bavota, Massimiliano Di Penta, Rocco Oliveto, Andrea De Lucia, and Denys Poshyvanyk. 2016. An Empirical Investigation into the Nature of Test Smells. In Proceedings of the 31st IEEE/ACM International Conference on Automated Software Engineering (ASE 2016). ACM, New York, NY, USA, 4--15.

Digital Library

[16]

Arie van Deursen, Leon Moonen, Alex Bergh, and Gerard Kok. 2001. Refactoring Test Code. In Proceedings of the 2nd International Conference on Extreme Programming and Flexible Processes in Software Engineering (XP). 92--95.

Cited By

Soares ERibeiro MSantos A(2024)A Multimethod Study of Test Smells: Cataloging Removal and New TypesProceedings of the XXIII Brazilian Symposium on Software Quality10.1145/3701625.3701699(676-686)Online publication date: 5-Nov-2024
https://dl.acm.org/doi/10.1145/3701625.3701699
Lopes GRomão DSoares ERibeiro MAmaral GGheyi RMachado I(2024)A Road to Find Them All: Towards an Agnostic Strategy for Test Smell DetectionProceedings of the XXIII Brazilian Symposium on Software Quality10.1145/3701625.3701662(231-241)Online publication date: 5-Nov-2024
https://dl.acm.org/doi/10.1145/3701625.3701662
Yang YHu XXia XYang X(2024)The Lost World: Characterizing and Detecting Undiscovered Test SmellsACM Transactions on Software Engineering and Methodology10.1145/363197333:3(1-32)Online publication date: 15-Mar-2024
https://dl.acm.org/doi/10.1145/3631973
Show More Cited By

Index Terms

SoCRATES: Scala radar for test smells
1. Software and its engineering
  1. Software creation and management
    1. Software verification and validation
      1. Software defect analysis

Recommendations

tsDetect: an open source test smells detection tool
ESEC/FSE 2020: Proceedings of the 28th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering

The test code, just like production source code, is subject to bad design and programming practices, also known as smells. The presence of test smells in a software project may affect the quality, maintainability, and extendability of test suites making ...
Scented since the beginning: On the diffuseness of test smells in automatically generated test code
Highlights
- A large empirical study aiming at understanding the relationships between test smells and automatically generated test cases.
Abstract
Software testing represents a key software engineering practice to ensure source code quality and reliability. To support developers in this activity and reduce testing effort, several automated unit test generation tools have been ...
Test smells 20 years later: detectability, validity, and reliability
Abstract
Test smells aim to capture design issues in test code that reduces its maintainability. These have been extensively studied and generally found quite prevalent in both human-written and automatically generated test-cases. However, most evidence of ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

Scala '19: Proceedings of the Tenth ACM SIGPLAN Symposium on Scala

July 2019

37 pages

ISBN:9781450368247

DOI:10.1145/3337932

Copyright © 2019 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGPLAN: ACM Special Interest Group on Programming Languages

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 17 July 2019

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper

Conference

Scala '19

Sponsor:

SIGPLAN

Scala '19: Tenth ACM SIGPLAN Scala Symposium

July 17, 2019

London, United Kingdom

Acceptance Rates

Scala '19 Paper Acceptance Rate 5 of 6 submissions, 83%;

Overall Acceptance Rate 5 of 6 submissions, 83%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

11
Total Citations
View Citations
105
Total Downloads

Downloads (Last 12 months)8
Downloads (Last 6 weeks)1

Reflects downloads up to 25 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Soares ERibeiro MSantos A(2024)A Multimethod Study of Test Smells: Cataloging Removal and New TypesProceedings of the XXIII Brazilian Symposium on Software Quality10.1145/3701625.3701699(676-686)Online publication date: 5-Nov-2024
https://dl.acm.org/doi/10.1145/3701625.3701699
Lopes GRomão DSoares ERibeiro MAmaral GGheyi RMachado I(2024)A Road to Find Them All: Towards an Agnostic Strategy for Test Smell DetectionProceedings of the XXIII Brazilian Symposium on Software Quality10.1145/3701625.3701662(231-241)Online publication date: 5-Nov-2024
https://dl.acm.org/doi/10.1145/3701625.3701662
Yang YHu XXia XYang X(2024)The Lost World: Characterizing and Detecting Undiscovered Test SmellsACM Transactions on Software Engineering and Methodology10.1145/363197333:3(1-32)Online publication date: 15-Mar-2024
https://dl.acm.org/doi/10.1145/3631973
Pontillo VAmoroso d’Aragona DPecorelli FDi Nucci DFerrucci FPalomba F(2024)Machine learning-based test smell detectionEmpirical Software Engineering10.1007/s10664-023-10436-229:2Online publication date: 5-Mar-2024
https://doi.org/10.1007/s10664-023-10436-2
Lima RCosta KSouza JTeixeira LFonseca BD'Amorim MRibeiro MMiranda B(2023)Do you see any problem? On the Developers Perceptions in Test Smells DetectionProceedings of the XXII Brazilian Symposium on Software Quality10.1145/3629479.3629485(21-30)Online publication date: 7-Nov-2023
https://dl.acm.org/doi/10.1145/3629479.3629485
Rzig DIqbal NAttisano IQin XHassan FJust RFraser G(2023)Virtual Reality (VR) Automated Testing in the Wild: A Case Study on Unity-Based VR ApplicationsProceedings of the 32nd ACM SIGSOFT International Symposium on Software Testing and Analysis10.1145/3597926.3598134(1269-1281)Online publication date: 12-Jul-2023
https://dl.acm.org/doi/10.1145/3597926.3598134
Santana RMartins LVirgínio TRocha LCosta HMachado I(2023)An empirical evaluation of RAIDE: a semi-automated approach for test smells detection and refactoringScience of Computer Programming10.1016/j.scico.2023.103013(103013)Online publication date: Aug-2023
https://doi.org/10.1016/j.scico.2023.103013
Chen ZJia CChen L(2023)Evaluating test quality of Python libraries for IoT applications at the network edgeWireless Networks10.1007/s11276-023-03479-2Online publication date: 2-Sep-2023
https://doi.org/10.1007/s11276-023-03479-2
Aljedaani WPeruma AAljohani AAlotaibi MMkaouer MOuni ANewman CGhallab ALudi S(2021)Test Smell Detection Tools: A Systematic Mapping StudyProceedings of the 25th International Conference on Evaluation and Assessment in Software Engineering10.1145/3463274.3463335(170-180)Online publication date: 21-Jun-2021
https://dl.acm.org/doi/10.1145/3463274.3463335
Wang TGolubev YSmirnov OLi JBryksin TAhmed IGrundy J(2021)PyNoseProceedings of the 36th IEEE/ACM International Conference on Automated Software Engineering10.1109/ASE51524.2021.9678615(593-605)Online publication date: 15-Nov-2021
https://dl.acm.org/doi/10.1109/ASE51524.2021.9678615
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten