research-article

An exploratory study of the pull-based software development model

Authors:

Georgios Gousios,

Martin Pinzger,

Arie van DeursenAuthors Info & Claims

ICSE 2014: Proceedings of the 36th International Conference on Software Engineering

Pages 345 - 355

https://doi.org/10.1145/2568225.2568260

Published: 31 May 2014 Publication History

Abstract

The advent of distributed version control systems has led to the development of a new paradigm for distributed software development; instead of pushing changes to a central repository, developers pull them from other repositories and merge them locally. Various code hosting sites, notably Github, have tapped on the opportunity to facilitate pull-based development by offering workflow support tools, such as code reviewing systems and integrated issue trackers. In this work, we explore how pull-based software development works, first on the GHTorrent corpus and then on a carefully selected sample of 291 projects. We find that the pull request model offers fast turnaround, increased opportunities for community engagement and decreased time to incorporate contributions. We show that a relatively small number of factors affect both the decision to merge a pull request and the time to process it. We also examine the reasons for pull request rejection and find that technical ones are only a small minority.

References

[1]

J. Anvik, L. Hiew, and G. C. Murphy. Who should fix this bug? In Proceedings of ICSE ’06, pages 361–370. ACM, 2006.

Digital Library

[2]

E. T. Barr, C. Bird, P. C. Rigby, A. Hindle, D. M. German, and P. Devanbu. Cohesive and isolated development with branches. In Proceedings of FASE ’12. Springer, 2012.

Digital Library

[3]

O. Baysal, R. Holmes, and M. W. Godfrey. Mining usage data and development artifacts. In Proceedings of MSR ’09, pages 98–107. IEEE, 2012.

[4]

C. Bird, A. Gourley, and P. Devanbu. Detecting patch submission and acceptance in oss projects. In Proceedings of MSR ’07, page 26. IEEE Computer Society, 2007.

Digital Library

[5]

C. Bird, A. Gourley, P. Devanbu, A. Swaminathan, and G. Hsu. Open borders? Immigration in open source projects. In Proceedings of MSR ’07, page 6. IEEE Computer Society, 2007.

Digital Library

[6]

C. Bird, P. C. Rigby, E. T. Barr, D. J. Hamilton, D. M. German, and P. Devanbu. The promises and perils of mining Git. In Proceedings of MSR ’09, pages 1–10, 2009.

Digital Library

[7]

C. Bird and T. Zimmermann. Assessing the value of branches with what-if analysis. In Proceedings of FSE ’12, pages 45:1–45:11. ACM, 2012.

Digital Library

[8]

S. Chacon. Pro Git. Expert’s Voice in Software Development. Apress, 1rst edition, Aug 2009.

Digital Library

[9]

L. Dabbish, C. Stuart, J. Tsay, and J. Herbsleb. Social coding in Github: transparency and collaboration in an open software repository. In Proceedings of CSCW ’12, pages 1277–1286. ACM, 2012.

Digital Library

[10]

L. Dabbish, C. Stuart, J. Tsay, and J. Herbsleb. Leveraging transparency. IEEE Software, 30(1):37–43, 2013.

Digital Library

[11]

B. Fluri, M. Wursch, M. PInzger, and H. Gall. Change distilling: Tree differencing for fine-grained source code change extraction. IEEE Trans. Soft. Eng., 33(11):725–743, 2007.

Digital Library

[12]

R. Genuer, J.-M. Poggi, and C. Tuleau-Malot. Variable selection using random forests. Pattern Recognition Letters, 31(14):2225 – 2236, 2010.

Digital Library

[13]

E. Giger, M. D’Ambros, M. Pinzger, and H. C. Gall. Method-level bug prediction. In In Proceedings of ESEM ’12, pages 171–180. ACM, 2012.

Digital Library

[14]

E. Giger, M. Pinzger, and H. Gall. Predicting the fix time of bugs. In In Proceedings of RSSE ’10, pages 52–56. ACM, 2010.

Digital Library

[15]

T. Girba, S. Ducasse, and M. Lanza. Yesterday’s weather: guiding early reverse engineering efforts by summarizing the evolution of changes. In Proceedings of ICSM ’04, pages 40 – 49, sept. 2004.

Digital Library

[16]

G. Gousios. The GHTorrent dataset and tool suite. In Proceedings of MSR ’13, May 2013.

Digital Library

[17]

N. V. Ivankova, J. W. Creswell, and S. L. Stick. Using mixed-methods sequential explanatory design: From theory to practice. Field Methods, 18(1):3–20, 2006.

[18]

C. Jensen and W. Scacchi. Role migration and advancement processes in OSSD projects: A comparative case study. In Proceedings of ICSE ’07, pages 364–374. IEEE Computer Society, 2007.

Digital Library

[19]

G. Jeong, S. Kim, T. Zimmermann, and K. Yi. Improving code review by predicting reviewers and acceptance of patches. Research on Software Analysis for Error-free Computing Center Tech-Memo (ROSAEC MEMO), 2009.

[20]

Y. Jiang, B. Adams, and D. M. German. Will my patch make it? and how fast?: case study on the Linux kernel. In Proceedings of MSR ’13, pages 101–110. IEEE Press, 2013.

Digital Library

[21]

S. Lessmann, B. Baesens, C. Mues, and S. Pietsch. Benchmarking classification models for software defect prediction: A proposed framework and novel findings. IEEE Trans. Softw. Eng., 34(4):485–496, July 2008.

Digital Library

[22]

N. McDonald and S. Goggins. Performance and participation in open source software on github. In CHI ’13 Extended Abstracts on Human Factors in Computing Systems, CHI EA ’13, pages 139–144. ACM, 2013.

Digital Library

[23]

A. Mockus, R. T. Fielding, and J. D. Herbsleb. Two case studies of open source software development: Apache and Mozilla. ACM Trans. Softw. Eng. Methodol., 11(3):309–346, 2002.

Digital Library

[24]

N. Nagappan and T. Ball. Use of relative code churn measures to predict system defect density. In Proceedings of ICSE ’05, pages 284–292. ACM, 2005.

Digital Library

[25]

K. Peterson. The github open source development process. Technical report, Mayo Clinic, May 2013.

[26]

R. Pham, L. Singer, O. Liskin, F. Figueira Filho, and K. Schneider. Creating a shared understanding of testing culture on a social coding site. In Proceedings of ICSE ’13, pages 112–121. IEEE Press, 2013.

Digital Library

[27]

J. Ratzinger, M. Pinzger, and H. Gall. EQ-mine: predicting short-term defects for software evolution. In Proceedings of FASE ’07, pages 12–26. Springer-Verlag, 2007.

Digital Library

[28]

P. C. Rigby and C. Bird. Convergent software peer review practices. In Proceedings of FSE ’13, 2013.

Digital Library

[29]

P. C. Rigby and D. M. German. A preliminary examination of code review processes in open source projects. University of Victoria, Canada, Tech. Rep. DCS-305-IR, 2006.

[30]

P. C. Rigby, D. M. German, and M.-A. Storey. Open source software peer review practices: a case study of the Apache server. In Proceedings of ICSE ’08, pages 541–550. ACM, 2008.

Digital Library

[31]

E. Shihab, C. Bird, and T. Zimmermann. The effect of branching strategies on software quality. In In Proceedings of ESEM ’12, pages 301–310. ACM, 2012.

Digital Library

[32]

P. Weißgerber, D. Neu, and S. Diehl. Small patches get in! In Proceedings of MSR ’08, pages 67–76. ACM, 2008.

Digital Library

Cited By

Song FAgarwal AWen W(2024)The Impact of Generative AI on Collaborative Open-Source Software Development: Evidence from GitHub CopilotSSRN Electronic Journal10.2139/ssrn.4856935Online publication date: 2024
https://doi.org/10.2139/ssrn.4856935
Yu YRong GShen HZhang HShao DWang MWei ZXu YWang J(2024)Fine-Tuning Large Language Models to Improve Accuracy and Comprehensibility of Automated Code ReviewACM Transactions on Software Engineering and Methodology10.1145/369599334:1(1-26)Online publication date: 14-Sep-2024
https://dl.acm.org/doi/10.1145/3695993
Yang LXu JZhang HWu FLyu JLi YBacchelli AFilkov VRay BZhou M(2024)GPP: A Graph-Powered Prioritizer for Code Review RequestsProceedings of the 39th IEEE/ACM International Conference on Automated Software Engineering10.1145/3691620.3694990(104-116)Online publication date: 27-Oct-2024
https://dl.acm.org/doi/10.1145/3691620.3694990
Show More Cited By

Index Terms

An exploratory study of the pull-based software development model
1. Social and professional topics
  1. Professional topics
    1. Management of computing and information systems
      1. Project and people management
      2. Software management
        Software maintenance
2. Software and its engineering
  1. Software creation and management
    1. Software development process management
    2. Software post-development issues
  2. Software notations and tools
    1. Software configuration management and version control systems

Recommendations

Work practices and challenges in pull-based development: the contributor's perspective
ICSE '16: Proceedings of the 38th International Conference on Software Engineering

The pull-based development model is an emerging way of contributing to distributed software projects that is gaining enormous popularity within the open source software (OSS) world. Previous work has examined this model by focusing on projects and their ...
An insight into the pull requests of GitHub
MSR 2014: Proceedings of the 11th Working Conference on Mining Software Repositories

Given the increasing number of unsuccessful pull requests in GitHub projects, insights into the success and failure of these requests are essential for the developers. In this paper, we provide a comparative study between successful and unsuccessful ...
A dataset for pull-based development research
MSR 2014: Proceedings of the 11th Working Conference on Mining Software Repositories

Pull requests form a new method for collaborating in distributed software development. To study the pull request distributed development model, we constructed a dataset of almost 900 projects and 350,000 pull requests, including some of the largest ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

ICSE 2014: Proceedings of the 36th International Conference on Software Engineering

May 2014

1139 pages

ISBN:9781450327565

DOI:10.1145/2568225

General Chair:
Pankaj Jalote
IIIT-Delhi, India
,
Program Chairs:
Lionel Briand
University of Luxembourg, Luxembourg
,
André van der Hoek
University of California, Irvine, USA

Copyright © 2014 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGSOFT: ACM Special Interest Group on Software Engineering

In-Cooperation

TCSE: IEEE Computer Society's Tech. Council on Software Engin.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 31 May 2014

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

ICSE '14

Sponsor:

SIGSOFT

ICSE '14: 36th International Conference on Software Engineering

May 31 - June 7, 2014

Hyderabad, India

Acceptance Rates

Overall Acceptance Rate 276 of 1,856 submissions, 15%

Upcoming Conference

ICSE 2025

2025 IEEE/ACM 46th International Conference on Software Engineering

April 26 - May 3, 2025

Ottawa , ON , Canada

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

423
Total Citations
View Citations
3,076
Total Downloads

Downloads (Last 12 months)272
Downloads (Last 6 weeks)35

Reflects downloads up to 26 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Song FAgarwal AWen W(2024)The Impact of Generative AI on Collaborative Open-Source Software Development: Evidence from GitHub CopilotSSRN Electronic Journal10.2139/ssrn.4856935Online publication date: 2024
https://doi.org/10.2139/ssrn.4856935
Yu YRong GShen HZhang HShao DWang MWei ZXu YWang J(2024)Fine-Tuning Large Language Models to Improve Accuracy and Comprehensibility of Automated Code ReviewACM Transactions on Software Engineering and Methodology10.1145/369599334:1(1-26)Online publication date: 14-Sep-2024
https://dl.acm.org/doi/10.1145/3695993
Yang LXu JZhang HWu FLyu JLi YBacchelli AFilkov VRay BZhou M(2024)GPP: A Graph-Powered Prioritizer for Code Review RequestsProceedings of the 39th IEEE/ACM International Conference on Automated Software Engineering10.1145/3691620.3694990(104-116)Online publication date: 27-Oct-2024
https://dl.acm.org/doi/10.1145/3691620.3694990
Chouchen MOuni AMkaouer M(2024)MULTICR: Predicting Merged and Abandoned Code Changes in Modern Code Review Using Multi-Objective SearchACM Transactions on Software Engineering and Methodology10.1145/368047233:8(1-44)Online publication date: 30-Jul-2024
https://dl.acm.org/doi/10.1145/3680472
Coutinho DCito LLima MArantes BAlves Pereira JArriel JGodinho JMartins VLibório PLeite LGarcia AAssunção WSteinmacher IBaffa AFonseca B(2024)"Looks Good To Me ;-)": Assessing Sentiment Analysis Tools for Pull Request DiscussionsProceedings of the 28th International Conference on Evaluation and Assessment in Software Engineering10.1145/3661167.3661189(211-221)Online publication date: 18-Jun-2024
https://dl.acm.org/doi/10.1145/3661167.3661189
de Souza CMa EWong JYoon DBeschastnikh I(2024)Revealing Software Development Work Patterns with PR-Issue Graph TopologiesProceedings of the ACM on Software Engineering10.1145/36608131:FSE(2402-2423)Online publication date: 12-Jul-2024
https://dl.acm.org/doi/10.1145/3660813
Ketkar ARamos DClapp LBarik RRamanathan M(2024)A Lightweight Polyglot Code Transformation LanguageProceedings of the ACM on Programming Languages10.1145/36564298:PLDI(1288-1312)Online publication date: 20-Jun-2024
https://dl.acm.org/doi/10.1145/3656429
Pan SWang YLiu ZHu XXia XLi SChristakis MPradel M(2024)Automating Zero-Shot Patch Porting for Hard ForksProceedings of the 33rd ACM SIGSOFT International Symposium on Software Testing and Analysis10.1145/3650212.3652134(363-375)Online publication date: 11-Sep-2024
https://dl.acm.org/doi/10.1145/3650212.3652134
Zhao GGeorgiou SHassan SZou YTruong DCorbin TSpinellis DConstantinou EBacchelli A(2024)Enhancing Performance Bug Prediction Using Performance Code MetricsProceedings of the 21st International Conference on Mining Software Repositories10.1145/3643991.3644920(50-62)Online publication date: 15-Apr-2024
https://dl.acm.org/doi/10.1145/3643991.3644920
Yabesi SAmini MRistic JSharafi ZBaysal OLinares-Vasquez MMoran KSteinmacher I(2024)Exploring the Effects of Urgency and Reputation in Code Review: An Eye-Tracking StudyProceedings of the 32nd IEEE/ACM International Conference on Program Comprehension10.1145/3643916.3644425(202-213)Online publication date: 15-Apr-2024
https://dl.acm.org/doi/10.1145/3643916.3644425
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents