research-article

Free access

(Re)Use of Research Results (Is Rampant)

Authors:

Maria Teresa Baldassarre,

Rahul YedidaAuthors Info & Claims

Communications of the ACM, Volume 66, Issue 2

Pages 75 - 81

https://doi.org/10.1145/3554976

Published: 20 January 2023 Publication History

All formats PDF

Abstract

Prior pessimism about reuse in software engineering research may have been a result of using the wrong methods to measure the wrong things.

References

[1]

Arcuri, A. and Briand, L. A practical guide for using statistical tests to assess randomized algorithms in software engineering. In Proceedings of the 33^rd International Conf. on Software Engineering, Association for Computing Machinery (2011), 1--10

Digital Library

[2]

Artifact review and badging. Association for Computing Machinery; https://bit.ly/3VaIQz6.

[3]

Badampudi, D., Wohlin, C., and Gorschek, T. Contextualizing research evidence through knowledge translation in software engineering. ACM International Conference Proceeding Series (2019), 306--311

Digital Library

[4]

Baker, M. and Penny, D. Is there a reproducibility crisis? Nature 533, 7604 (2016), 452--454

[5]

Baldassarre, M.T., Caivano, D., Romano, S., and Scanniello, G. Software models for source code maintainability: A systematic literature review. 2019 45^th Euromicro Conf. on Software Engineering and Advanced Applications, IEEE, 252--259.

[6]

Bentley, J.L. Multidimensional binary search trees used for associative searching. Communications of the ACM 18, 9 (September 1975), 509--517

Digital Library

[7]

Bernal-Cárdenas, C. et al. Translating video recordings of mobile app usages into replayable scenarios. In Proceedings of the ACM/IEEE 42^nd Intern. Conf. on Software Engineering (2020)

Digital Library

[8]

Childers, B.R. and Chrysanthis, P.K. Artifact evaluation: Is it a real incentive? 2017 IEEE 13^th Intern. Conf. on e-Science, 488--489; https://bit.ly/3hFa6Z4.

[9]

Collberg, C. and Proebsting, T.A. Repeatability in computer systems research. Communications of the ACM 59, 3 (2016), 62--69; https://bit.ly/3HKABXx.

Digital Library

[10]

da Silva, F.Q.B. Replication of empirical studies in software engineering research: A systematic mapping study. Empirical Software Engineering (September 2012)

Digital Library

[11]

DeVito, N.J., Bacon, S., and Goldacre, B. Compliance with legal requirement to report clinical trial results on ClinicalTrials.gov: A cohort study. The Lancet 395, 10221 (2020), 361--369; https://bit.ly/3PDwIFM.

[12]

Felizardo, K.R. et al. Secondary studies in the academic context: A systematic mapping and survey. J. of Systems and Software 170 (2020), 110734.

[13]

Fleiss, J.L. Measuring nominal scale agreement among many raters. Psychological Bulletin 76, 5 (1971), 378.

[14]

Hermann, B., Winter, S., and Siegmund, J. Community expectations for research artifacts and evaluation processes. In Proceedings of the 28^th ACM Joint Meeting on European Software Engineering Conf. and Symp. on the Foundations of Software Engineering, Association for Computing Machinery (2020), 469--480

Digital Library

[15]

Heumüller, R., Nielebock, S., Krüger, J., and Ortmeier, F. Publish or perish, but do not forget your software artifacts. Empirical Software Engineering (2020)

Digital Library

[16]

Kalliamvakou, E. et al. The promises and perils of mining GitHub. In Proceedings of the 11^th Working Conf. on Mining Software Repositories---MSR 2014, ACM Press

Digital Library

[17]

Krishnamurthi, S. and Vitek, J. The real software crisis: Repeatability as a core value. Communications of the ACM 58, 3 (February 2015), 34--36

Digital Library

[18]

Lessmann, S., Baesens, B., Mues, C., and Pietsch, S. Benchmarking classification models for software defect prediction: A proposed framework and novel findings. IEEE Transactions on Software Engineering 34, 4 (2008), 485--496; https://bit.ly/3jdmrnF.

Digital Library

[19]

Mathew, G., Agrawal, A., and Menzies, T. Finding trends in software research. IEEE Transactions on Software Engineering (2018), 1--1; https://bit.ly/3hwuUSE.

[20]

Mayo, D.G. Statistical Inference as Severe Testing: How to Get Beyond the Statistics Wars. Cambridge University Press. 2018.

[21]

Menzies, T. Guest editorial for the Special Section on Best Papers from the 2011 Conference on Predictive Models in Software Engineering (PROMISE). Information and Software Technology 55, 8 (2013), 1477--1478.

Digital Library

[22]

Moran, K. et al. Machine learning-based prototyping of graphical user interfaces for mobile apps. IEEE Transactions on Software Engineering 46, 2 (2020), 196--221

[23]

Popper, K. Conjectures and Refutations: The Growth of Scientific Knowledge. Routledge (1963).

[24]

Pritchard, A. Statistical bibliography or bibliometrics? J. of Documentation 25, 4 (1969), 348--349.

[25]

Rousseau, R. Forgotten founder of bibliometrics. Nature 510 (2014).

[26]

Russakovsky, O. et al. ImageNet large scale visual recognition challenge. Intern. J. of Computer Vision 115, 3 (2015), 211--252; https://bit.ly/3WkR6hc.

Digital Library

[27]

Santos, A., Vegas, S., Oivo, M., and Juristo, N. Comparing the results of replications in software engineering. Empirical Software Engineering 26, 2 (February 2021)

Digital Library

[28]

Schimmack, U. A meta-psychological perspective on the decade of replication failures in social psychology. Canadian Psychology 61, 4 (November 2020), 364--376

[29]

Zhou, Z.Q., Tse, T.H., and Witheridge, M. Metamorphic robustness testing: Exposing hidden defects in citation statistics and journal impact factors. IEEE Transactions on Software Engineering 47, 6 (2021), 1164--1183; https://bit.ly/3VcqG05.

Cited By

Lathouwers SLiu YZaytsev V(2025)Extract, model, refine: improved modelling of program verification tools through data enrichmentSoftware and Systems Modeling10.1007/s10270-024-01232-7Online publication date: 8-Jan-2025
https://doi.org/10.1007/s10270-024-01232-7
Frattini JMontgomery LFucci DUnterkalmsteiner MMendez DFischbach J(2024)Requirements quality research artifacts: Recovery, analysis, and management guidelineJournal of Systems and Software10.1016/j.jss.2024.112120216(112120)Online publication date: Oct-2024
https://doi.org/10.1016/j.jss.2024.112120

Index Terms

(Re)Use of Research Results (Is Rampant)
1. Social and professional topics
  1. Computing / technology policy
    1. Intellectual property
      1. Software reverse engineering
  2. Professional topics
    1. Computing industry
    2. Computing profession
2. Software and its engineering
  1. Software creation and management
    1. Designing software
      1. Software design engineering
    2. Software development techniques

Recommendations

Making ecology research results useful for resource management: a case study in visual analytics
dg.o '09: Proceedings of the 10th Annual International Conference on Digital Government Research: Social Networks: Making Connections between Citizens, Data and Government

This paper addresses challenges to resource managers' use of scientific research, and reports strategies and informatics tools to ameliorate those challenges. Our work involves repurposing fundamental ecology research data for resource managers, in ...
Automatic Generation of Use Cases from Workflows: A Petri Net Based Approach
FASE '02: Proceedings of the 5th International Conference on Fundamental Approaches to Software Engineering

This paper presents automatic generation of use cases as an alternative both to speeding up requirements elicitation and formalizing the obtained use cases to approach the requirements reuse. We propose a framework for requirements documentation as use ...
Access and use of government data by research and advocacy organisations in India: a survey of (potential) open data ecosystem
ICEGOV '14: Proceedings of the 8th International Conference on Theory and Practice of Electronic Governance

The paper presents findings from a recently competed study of the practices of accessing and using government data by selected (non-governmental and non-commercial) research and advocacy organisations in India. The study takes place in the context of ...

Comments

Information & Contributors

Information

Published In

cover image Communications of the ACM

Communications of the ACM Volume 66, Issue 2

February 2023

104 pages

ISSN:0001-0782

EISSN:1557-7317

DOI:10.1145/3581931

Editor:
James Larus
Association for Computing Machinery, New York, NY

Issue’s Table of Contents

Copyright © 2023 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 20 January 2023

Published in CACM Volume 66, Issue 2

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Research-article
Popular
Refereed

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
9,574
Total Downloads

Downloads (Last 12 months)794
Downloads (Last 6 weeks)30

Reflects downloads up to 26 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Lathouwers SLiu YZaytsev V(2025)Extract, model, refine: improved modelling of program verification tools through data enrichmentSoftware and Systems Modeling10.1007/s10270-024-01232-7Online publication date: 8-Jan-2025
https://doi.org/10.1007/s10270-024-01232-7
Frattini JMontgomery LFucci DUnterkalmsteiner MMendez DFischbach J(2024)Requirements quality research artifacts: Recovery, analysis, and management guidelineJournal of Systems and Software10.1016/j.jss.2024.112120216(112120)Online publication date: Oct-2024
https://doi.org/10.1016/j.jss.2024.112120

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Digital Edition

View this article in digital edition.

Digital Edition

Magazine Site

View this article on the magazine site (external)

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

Figures

Tables

Media

View Issue’s Table of Contents