research-article

Comparing repositories visually with repograms

Authors:

Daniel Rozenberg,

Ivan Beschastnikh,

Fabian Kosmale,

Gail C. MurphyAuthors Info & Claims

MSR '16: Proceedings of the 13th International Conference on Mining Software Repositories

Pages 109 - 120

https://doi.org/10.1145/2901739.2901768

Published: 14 May 2016 Publication History

Abstract

The availability of open source software projects has created an enormous opportunity for software engineering research. However, this availability requires that researchers judiciously select an appropriate set of evaluation targets and properly document this rationale. After all, the choice of targets may have a significant effect on evaluation.

We developed a tool called RepoGrams to support researchers in qualitatively comparing and contrasting software projects over time using a set of software metrics. RepoGrams uses an extensible, metrics-based, visualization model that can be adapted to a variety of analyses. Through a user study of 14 software engineering researchers we found that RepoGrams can assist researchers in filtering candidate software projects and make more reasoned choices of targets for their evaluations. The tool is open source and is available online: http://repograms.net/

References

[1]

An extendable open source automation server. https://jenkins-ci.org.

[2]

AngularJS - Superheroic JavaScript MVW Framework. https://angularjs.org.

[3]

Ansible is Simple IT Automation. https://www.ansible.com/.

[4]

DB Browser for SQLite project. https://github.com/sqlitebrowser/sqlitebrowser.

[5]

Flickr uploading tool for GNOME. https://github.com/GNOME/postr.

[6]

jQuery. https://jquery.com/.

[7]

Summarizing Software Artifacts. https://www.cs.ubc.ca/cs-research/software-practices-lab/projects/summarizing-software-artifacts.

[8]

Welcome to Apache Maven. http://maven.apache.org/.

[9]

C. Bird, N. Nagappan, B. Murphy, H. Gall, and P. Devanbu. Don't touch my code!: Examining the effects of ownership on software quality. In Proceedings of the 19th ACM SIGSOFT Symposium and the 13th European Conference on Foundations of Software Engineering, ESEC/FSE '11, pages 4--14, 2011.

Digital Library

[10]

C. A. Brewer. ColorBrewer2. http://colorbrewer2.org/.

[11]

K. Chen, P. Liu, and Y. Zhang. Achieving Accuracy and Scalability Simultaneously in Detecting Application Clones on Android Markets. In ICSE, 2014.

Digital Library

[12]

C. Collberg, S. Kobourov, J. Nagra, J. Pitts, and K. Wampler. A system for graph-based visualization of the evolution of software. In Proceedings of the 2003 ACM Symposium on Software Visualization, SoftVis '03, pages 77--ff, New York, NY, USA, 2003. ACM.

Digital Library

[13]

M. D'Ambros, H. Gall, M. Lanza, and M. Pinzger. Analysing software repositories to understand software evolution. In Software evolution, pages 37--67. Springer Berlin Heidelberg, 2008.

[14]

M. D'Ambros, M. Lanza, and H. Gall. Fractal figures: Visualizing development effort for cvs entities. In Visualizing Software for Understanding and Analysis, 2005. VISSOFT 2005. 3rd IEEE International Workshop on, pages 1--6, 2005.

Digital Library

[15]

M. D'Ambros, M. Lanza, and M. Lungu. The Evolution Radar: Visualizing Integrated Logical Coupling Information. In MSR, 2006.

Digital Library

[16]

S. Diehl. Software Visualization: Visualizing the Structure, Behaviour, and Evolution of Software. Springer, 2010.

Digital Library

[17]

R. Dyer, H. A. Nguyen, H. Rajan, and T. N. Nguyen. Boa: A language and infrastructure for analyzing ultra-large-scale software repositories. In ICSE, 2013.

Digital Library

[18]

M. Foucault, M. Palyart, X. Blanc, G. C. Murphy, and J.-R. Falleri. Impact of Developer Turnover on Quality in Open-source Software. In ESEC/FSE, 2015.

Digital Library

[19]

M. Foucault, M. Palyart, J.-R. Falleri, and X. Blanc. Computing contextual metric thresholds. In Proceedings of the 29th Annual ACM Symposium on Applied Computing, 2014.

Digital Library

[20]

T. Girba, A. Kuhn, M. Seeberger, and S. Ducasse. How developers drive software evolution. In Proceedings of the Eighth International Workshop on Principles of Software Evolution, IWPSE '05, pages 113--122, Washington, DC, USA, 2005. IEEE Computer Society.

Digital Library

[21]

G. Gousios. The ghtorent dataset and tool suite. In Proceedings of the 10th Working Conference on Mining Software Repositories, MSR '13, pages 233--236, Piscataway, NJ, USA, 2013. IEEE Press.

Digital Library

[22]

G. Gousios, B. Vasilescu, A. Serebrenik, and A. Zaidman. Lean ghtorrent: Github data on demand. In Proceedings of the 11th Working Conference on Mining Software Repositories, MSR 2014, pages 384--387, New York, NY, USA, 2014. ACM.

Digital Library

[23]

K. Herzig and A. Zeller. The Impact of Tangled Code Changes. In MSR, 2013.

Digital Library

[24]

R. Just, D. Jalali, and M. D. Ernst. Defects4J: A database of existing faults to enable controlled testing studies for Java programs. In Proceedings of the International Symposium on Software Testing and Analysis (ISSTA), pages 437--440, San Jose, CA, USA, July 23--25 2014.

Digital Library

[25]

E. Kalliamvakou, G. Gousios, K. Blincoe, L. Singer, D. M. German, and D. Damian. The promises and perils of mining github. In Proceedings of the 11th Working Conference on Mining Software Repositories, MSR 2014, New York, NY, USA, 2014. ACM.

Digital Library

[26]

M. Lanza. The evolution matrix: Recovering software evolution using software visualization techniques. In Proceedings of the 4th International Workshop on Principles of Software Evolution, IWPSE '01, pages 37--42, New York, NY, USA, 2001. ACM.

Digital Library

[27]

M. Lungu, M. Lanza, T. Gîrba, and R. Robbes. The Small Project Observatory: Visualizing Software Ecosystems. Sci. Comput. Program., 75(4):264--275, Apr. 2010.

Digital Library

[28]

T. Mens and S. Demeyer. Future trends in software evolution metrics. In Proceedings of the 4th International Workshop on Principles of Software Evolution, IWPSE '01, pages 83--86, New York, NY, USA, 2001. ACM.

Digital Library

[29]

C. Metz. How github conquered google, microsoft, and everyone else. http://www.wired.com/2015/03/github-conquered-google-microsoft-everyone-else/.

[30]

T. Munzner. Visualization Analysis and Design. CRC Press, 2014.

[31]

M. Nagappan, T. Zimmermann, and C. Bird. Diversity in software engineering research. In Proceedings of the 2013 9th Joint Meeting on Foundations of Software Engineering, ESEC/FSE 2013, pages 466--476, New York, NY, USA, 2013. ACM.

Digital Library

[32]

D. L. Parnas. Classics in Software Engineering. chapter On the Criteria to Be Used in Decomposing Systems into Modules, pages 139--150. Yourdon Press, Upper Saddle River, NJ, USA, 1979.

Digital Library

[33]

M. Pinzger, H. Gall, M. Fischer, and M. Lanza. Visualizing multiple evolution metrics. In Proceedings of the 2005 ACM symposium on Software visualization, pages 67--75. ACM, 2005.

Digital Library

[34]

F. Rahman and P. Devanbu. Ownership, Experience and Defects: A Fine-grained Study of Authorship. In ICSE, 2011.

Digital Library

[35]

S. Rastkar, G. C. Murphy, and G. Murray. Summarizing software artifacts: A case study of bug reports. In ICSE, 2010.

Digital Library

[36]

B. Ray, D. Posnett, V. Filkov, and P. Devanbu. A large scale study of programming languages and code quality in github. In Proceedings of the 22Nd ACM SIGSOFT International Symposium on Foundations of Software Engineering, FSE 2014, New York, NY, USA, 2014. ACM.

Digital Library

[37]

D. Rozenberg, I. Beschastnikh, F. Kosmale, V. Poser, H. Becker, M. Palyart, and G. C. Murphy. RepoGrams evaluation details. http://repograms.net/msr2016.

[38]

F. Servant and J. A. Jones. History slicing: Assisting code-evolution tasks. In Proceedings of the ACM SIGSOFT 20th International Symposium on the Foundations of Software Engineering, FSE '12, pages 43:1--43:11, New York, NY, USA, 2012. ACM.

Digital Library

[39]

F. Sokol, M. Finavaro Aniche, and M. Gerosa. Metricminer: Supporting researchers in mining software repositories. In Source Code Analysis and Manipulation (SCAM), 2013 IEEE 13th International Working Conference on, pages 142--146, Sept 2013.

[40]

C. Taylor and M. Munro. Revision towers. In Visualizing Software for Understanding and Analysis, 2002. Proceedings. First International Workshop on, pages 43--50, 2002.

Digital Library

[41]

E. Tempero, C. Anslow, J. Dietrich, T. Han, J. Li, M. Lumpe, H. Melton, and J. Noble. Qualitas corpus: A curated collection of java code for empirical studies. In 2010 Asia Pacific Software Engineering Conference (APSEC2010), pages 336--345, Dec. 2010.

Digital Library

[42]

C. Treude and M. Storey. Work item tagging: Communicating concerns in collaborative software development. Software Engineering, IEEE Transactions on, 38(1):19--34, Jan 2012.

Digital Library

[43]

L. Voinea and A. Telea. An Open Framework for CVS Repository Querying, Analysis and Visualization. In MSR, 2006.

Digital Library

[44]

S. L. Voinea and A. Telea. CVSgrab: Mining the History of Large Software Projects. In EuroVis, 2006.

Digital Library

[45]

J. Warner. Top 100 most popular languages on github. https://jaxbot.me/articles/github-most-popular-languages, July 2014.

[46]

J. Wu, R. Holt, and A. Hassan. Exploring software evolution using spectrographs. In Reverse Engineering, 2004. Proceedings. 11th Working Conference on, pages 80--89, Nov 2004.

Digital Library

Cited By

Lumbard KGermonprez MGoggins S(2023)An empirical investigation of social comparison and open source community healthInformation Systems Journal10.1111/isj.1248534:2(499-532)Online publication date: 15-Nov-2023
https://doi.org/10.1111/isj.12485
Li XMoreschini SZhang ZTaibi D(2022)Exploring factors and metrics to select open source software components for integration: An empirical studyJournal of Systems and Software10.1016/j.jss.2022.111255188(111255)Online publication date: Jun-2022
https://doi.org/10.1016/j.jss.2022.111255
Falessi DAhluwalia APenta M(2021)The Impact of Dormant Defects on Defect Prediction: A Study of 19 Apache ProjectsACM Transactions on Software Engineering and Methodology10.1145/346789531:1(1-26)Online publication date: 28-Sep-2021
https://dl.acm.org/doi/10.1145/3467895
Show More Cited By

Recommendations

Comparing software metrics tools
ISSTA '08: Proceedings of the 2008 international symposium on Software testing and analysis

This paper shows that existing software metric tools interpret and implement the definitions of object-oriented software metrics differently. This delivers tool-dependent metrics results and has even implications on the results of analyses based on ...
Mining source code changes from software repositories
CEE-SECR '11: Proceedings of the 2011 7th Central and Eastern European Software Engineering Conference

The primary goal of software repositories is to store the source code of software during its development. Developers constantly store small parts (i.e. software modifications) of code into the repository and share those parts with others until the ...
Tools in Mining Software Repositories
ICCSA '13: Proceedings of the 2013 13th International Conference on Computational Science and Its Applications

Mining software repositories (MSR) is an important area of research. An international workshop on MSR has been established under the umbrella of international conference on software engineering (ICSE) in year 2004. The quality papers received and ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

MSR '16: Proceedings of the 13th International Conference on Mining Software Repositories

May 2016

544 pages

ISBN:9781450341868

DOI:10.1145/2901739

General Chair:
Miryung Kim
University of California, Los Angeles
,
Program Chairs:
Romain Robbes
University of Chile, Chile
,
Christian Bird
Microsoft Research

Copyright © 2016 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

ACM: Association for Computing Machinery
SIGSOFT: ACM Special Interest Group on Software Engineering
IEEE-CS\DATC: IEEE Computer Society
TCSE: IEEE Computer Society's Tech. Council on Software Engin.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 14 May 2016

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Research-article

Funding Sources

Natural Sciences and Engineering Research Council of Canada

Conference

ICSE '16

Sponsor:

ACM
SIGSOFT
IEEE-CS\DATC
TCSE

ICSE '16: 38th International Conference on Software Engineering

May 14 - 22, 2016

Texas, Austin

Upcoming Conference

ICSE 2025

2025 IEEE/ACM 46th International Conference on Software Engineering

April 26 - May 3, 2025

Ottawa , ON , Canada

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

20
Total Citations
View Citations
335
Total Downloads

Downloads (Last 12 months)16
Downloads (Last 6 weeks)0

Reflects downloads up to 06 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Lumbard KGermonprez MGoggins S(2023)An empirical investigation of social comparison and open source community healthInformation Systems Journal10.1111/isj.1248534:2(499-532)Online publication date: 15-Nov-2023
https://doi.org/10.1111/isj.12485
Li XMoreschini SZhang ZTaibi D(2022)Exploring factors and metrics to select open source software components for integration: An empirical studyJournal of Systems and Software10.1016/j.jss.2022.111255188(111255)Online publication date: Jun-2022
https://doi.org/10.1016/j.jss.2022.111255
Falessi DAhluwalia APenta M(2021)The Impact of Dormant Defects on Defect Prediction: A Study of 19 Apache ProjectsACM Transactions on Software Engineering and Methodology10.1145/346789531:1(1-26)Online publication date: 28-Sep-2021
https://dl.acm.org/doi/10.1145/3467895
Kim YKim JJeon HKim YSong HKim BSeo J(2021)Githru: Visual Analytics for Understanding Software Development History Through Git Metadata AnalysisIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2020.303041427:2(656-666)Online publication date: Feb-2021
https://doi.org/10.1109/TVCG.2020.3030414
Goggins SLumbard KGermonprez M(2021)Open Source Community Health: Analytical Metrics and Their Corresponding Narratives2021 IEEE/ACM 4th International Workshop on Software Health in Projects, Ecosystems and Communities (SoHeal)10.1109/SoHeal52568.2021.00010(25-33)Online publication date: May-2021
https://doi.org/10.1109/SoHeal52568.2021.00010
Ma YDey TBogart CAmreen SValiev MTutko AKennard DZaretzki RMockus A(2021)World of code: enabling a research workflow for mining and analyzing the universe of open source VCS dataEmpirical Software Engineering10.1007/s10664-020-09905-926:2Online publication date: 25-Feb-2021
https://doi.org/10.1007/s10664-020-09905-9
Chotisarn NMerino LZheng XLonapalawong SZhang TXu MChen W(2020)A systematic literature review of modern software visualizationJournal of Visualization10.1007/s12650-020-00647-wOnline publication date: 16-Jun-2020
https://doi.org/10.1007/s12650-020-00647-w
Ma YBogart CAmreen SZaretzki RMockus AStorey MAdams BHaiduc S(2019)World of codeProceedings of the 16th International Conference on Mining Software Repositories10.1109/MSR.2019.00031(143-154)Online publication date: 26-May-2019
https://dl.acm.org/doi/10.1109/MSR.2019.00031
Ahluwalia AFalessi DDi Penta MStorey MAdams BHaiduc S(2019)SnoringProceedings of the 16th International Conference on Mining Software Repositories10.1109/MSR.2019.00019(63-67)Online publication date: 26-May-2019
https://dl.acm.org/doi/10.1109/MSR.2019.00019
Behnamghader PBoehm B(2019)Towards Better Understanding of Software Maintainability EvolutionSystems Engineering in Context10.1007/978-3-030-00114-8_47(593-603)Online publication date: 22-Jun-2019
https://doi.org/10.1007/978-3-030-00114-8_47
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents