skip to main content
10.1145/2652524.2652586acmconferencesArticle/Chapter ViewAbstractPublication PagesesemConference Proceedingsconference-collections
research-article

Effect of temporal collaboration network, maintenance activity, and experience on defect exposure

Published: 18 September 2014 Publication History

Abstract

Context: Number of defects fixed in a given month is used as an input for several project management decisions such as release time, maintenance effort estimation and software quality assessment. Past activity of developers and testers may help us understand the future number of reported defects. Goal: To find a simple and easy to implement solution, predicting defect exposure. Method: We propose a temporal collaboration network model that uses the history of collaboration among developers, testers, and other issue originators to estimate the defect exposure for the next month. Results: Our empirical results show that temporal collaboration model could be used to predict the number of exposed defects in the next month with R2 values of 0.73. We also show that temporality gives a more realistic picture of collaboration network compared to a static one. Conclusions: We believe that our novel approach may be used to better plan for the upcoming releases, helping managers to make evidence based decisions.

References

[1]
N. E. Fenton and M. Neil, "A Critique of Software Defect Prediction Models," IEEE Trans Softw Eng, vol. 25, no. 5, pp. 675--689, Sep. 1999.
[2]
B. Caglayan, A. B. Bener, and A. Miranskyy, "Emergence of developer teams in the collaboration network," in 2013 6th Int. Workshop on Cooperative and Human Aspects of Software Engineering (CHASE), 2013, pp. 33--40.
[3]
S. Bicer, A. Bener, and B. Caglayan, "Defect Prediction Using Social Network Analysis on Issue Repositories," in Proc. of the 2011 Int. Conference on Software and Systems Process, New York, NY, USA, 2011, pp. 63--71.
[4]
P. Holme and J. Saramäki, Eds., Temporal Networks. New York: Springer, 2013.
[5]
A. Meneely, L. Williams, W. Snipes, and J. Osborne, "Predicting Failures with Developer Networks and Social Network Analysis," in Proc. of the 16th ACM SIGSOFT International Symposium on Foundations of Software Engineering, 2008, pp. 13--23.
[6]
N. Nagappan, B. Murphy, and V. R. Basili, "The influence of organizational structure on software quality," in ACM/IEEE 30th Int. Conference on Software Engineering, 2008. ICSE '08, 2008, pp. 521--530.
[7]
T. Zimmermann and N. Nagappan, "Predicting Defects Using Network Analysis on Dependency Graphs," in Proc. of the 30th International Conference on Software Engineering, 2008, pp. 531--540.
[8]
C. Bird, N. Nagappan, H. Gall, B. Murphy, and P. Devanbu, "Putting It All Together: Using Socio-technical Networks to Predict Failures," in 20th Int. Symp. on Softw Reliability Eng, 2009. ISSRE '09, 2009, pp. 109--119.
[9]
M. Cataldo and K. Ehrlich, "The Impact of Communication Structure on New Product Development Outcomes," in Proc. of the SIGCHI Conference on Human Factors in Computing Systems, 2012, pp. 3081--3090.
[10]
T. Wolf, A. Schroter, D. Damian, and T. Nguyen, "Predicting Build Failures Using Social Network Analysis on Developer Communication," in Proc. of the 31st International Conference on Softw Eng, 2009, pp. 1--11.
[11]
M. Cataldo and J. D. Herbsleb, "Coordination Breakdowns and Their Impact on Development Productivity and Software Failures," IEEE Trans. Softw. Eng., vol. 39, no. 3, pp. 343--360, Mar. 2013.
[12]
N. Fenton, M. Neil, W. Marsh, P. Hearty, D. Marquez, P. Krause, and R. Mishra, "Predicting Software Defects in Varying Development Lifecycles Using Bayesian Nets," Inf Softw Technol, vol. 49, no. 1, pp. 32--43, Jan. 2007.
[13]
S. Brin and L. Page, "The Anatomy of a Large-scale Hypertextual Web Search Engine," Comput Netw ISDN Syst, vol. 30, no. 1--7, pp. 107--117, Apr. 1998.
[14]
T. J. Ostrand, E. J. Weyuker, and R. M. Bell, "Where the Bugs Are," in Proc. of the 2004 ACM SIGSOFT International Symposium on Software Testing and Analysis, 2004, pp. 86--96.
[15]
T. Menzies, Z. Milton, B. Turhan, B. Cukic, Y. Jiang, and A. Bener, "Defect Prediction from Static Code Features: Current Results, Limitations, New Approaches," Autom. Softw. Engg, vol. 17, no. 4, pp. 375--407, Dec. 2010.
[16]
J. F. Hair, B. Black, B. Babin, R. E. Anderson, and R. L. Tatham, Multivariate Data Analysis, 6th, Prentice Hall, 2005.
[17]
R. K. Yin, Case study research: design and methods, 3rd ed. Sage Publ., 2003.
[18]
B. Caglayan, A. T. Misirli, G. Calikli, A. Bener, T. Aytac, and B. Turhan, "Dione: An Integrated Measurement and Defect Prediction Solution," in Proc. of the ACM SIGSOFT 20th Int. Symposium on the Foundations of Software Engineering, 2012, pp. 20:1--20:2.
[19]
W. Kruskal, "Relative Importance by Averaging Over Orderings," Am. Stat., vol. 41, no. 1, pp. 6--10, Feb. 1987.

Cited By

View all

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
ESEM '14: Proceedings of the 8th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement
September 2014
461 pages
ISBN:9781450327749
DOI:10.1145/2652524
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 18 September 2014

Check for updates

Author Tags

  1. collaboration network
  2. linear regression model
  3. prediction quality

Qualifiers

  • Research-article

Conference

ESEM '14
Sponsor:

Acceptance Rates

ESEM '14 Paper Acceptance Rate 23 of 123 submissions, 19%;
Overall Acceptance Rate 130 of 594 submissions, 22%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)2
  • Downloads (Last 6 weeks)0
Reflects downloads up to 20 Jan 2025

Other Metrics

Citations

Cited By

View all

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media