research-article

Continuous Delivery

Author:

Lianping ChenAuthors Info & Claims

Journal of Systems and Software, Volume 128, Issue C

Pages 72 - 86

https://doi.org/10.1016/j.jss.2017.02.013

Published: 01 June 2017 Publication History

Abstract

Present six strategies to overcome Continuous Delivery (CD) adoption challenges.Identify and elaborate eight further challenges for research.They are based on four years CD adoption experience at a multi-billion-euro company. Continuous Delivery (CD) is a relatively new software development approach. Companies that have adopted CD have reported significant benefits. Motivated by these benefits, many companies would like to adopt CD. However, adopting CD can be very challenging for a number of reasons, such as obtaining buy-in from a wide range of stakeholders whose goals may seemingly be different fromor even conflict withour own; gaining sustained support in a dynamic complex enterprise environment; maintaining an application development team's momentum when their application's migration to CD requires an additional strenuous effort over a long period of time; and so on. To help overcome the adoption challenges, I present six strategies: (1) selling CD as a painkiller; (2) establishing a dedicated team with multi-disciplinary members; (3) continuous delivery of continuous delivery; (4) starting with the easy but important applications; (5) visual CD pipeline skeleton; (6) expert drop. These strategies were derived from four years of experience in implementing CD at a multi-billion-euro company. Additionally, our experience led to the identification of eight further challenges for research. The information contributes toward building a body of knowledge for CD adoption.

References

[1]

B. Adams, S. Bellomo, C. Bird, T. Marshall-Keim, F. Khomh, K. Moir, The practice and future of release engineering: a roundtable with three release engineers, IEEE Software, 32 (2015) 42-49.

Digital Library

[2]

D.J. Anderson, Kanban: Successful Evolutionary Change for Your Technology Business, Blue Hole Press, 2010.

[3]

L. Bass, R. Holz, P. Rimba, A.B. Tran, L. Zhu, Securing a deployment pipeline, in: Presented at the 2015 IEEE/ACM 3rd International Workshop on Release Engineering (RELENG), 2015.

Digital Library

[4]

K. Beck, Test Driven Development: By Example, Addison-Wesley Professional, Boston, MA, 2002.

Digital Library

[5]

Beck, K., Beedle, M., Van Bennekum, A., Cockburn, A., Cunningham, W., Fowler, M., et al., 2001. Manifesto for agile software development.

[6]

K. Bennett, Legacy systems: coping with success, IEEE Software, 12 (1995) 19-23.

Digital Library

[7]

Change Management (2016). Available: https://en.wikipedia.org/wiki/Change_management (Accessed 30.10.16).

[8]

L. Chen, Continuous delivery: huge benefits, but challenges too, IEEE Software, 32 (2015) 50-54.

Digital Library

[9]

L. Chen, Towards architecting for continuous delivery, in: 2015 12th Working IEEE/IFIP Conference on Software Architecture (WICSA), 2015, pp. 131-134.

Digital Library

[10]

G.G. Claps, R. Berntsson Svensson, A. Aurum, On the journey to continuous deployment: technical and social challenges along the way, Inform. Software Tech., 57 (2015) 21-31.

[11]

A. Debbiche, M. Dienr, R. Berntsson Svensson, Challenges when adopting continuous integration: a case study, in: Product-Focused Software Process Improvement, vol. 8892, Springer International Publishing, 2014, pp. 17-32.

[12]

A. Donovan, B.W. Kernighan, The Go Programming Language, Addison-Wesley, 2015.

Digital Library

[13]

E. Engstrm, P. Runeson, M. Skoglund, A systematic review on regression test selection techniques, Inform. Software Tech., 52 (2010) 14-30.

Digital Library

[14]

D.G. Feitelson, E. Frachtenberg, K.L. Beck, Development and deployment at Facebook, IEEE Internet Comput., 17 (2013) 8-17.

Digital Library

[15]

M.Z. Gligoric, Regression Test Selection: Theory and Practice, University of Illinois at Urbana-Champaign, 2015.

[16]

J. Humble, D. Farley, Continuous Delivery: Reliable Software Releases through Build, Test, and Deployment Automation, Addison-Wesley, New York, 2010.

Digital Library

[17]

T. Karvonen, L.E. Lwakatare, T. Sauvola, J. Bosch, H.H. Olsson, P. Kuvaja, Hitting the target: practices for moving toward innovation experiment systems, in: Software Business: 6th international conference, ICSOB 2015, Braga, Portugal, June 10-12, 2015, proceedings, Cham: Springer International Publishing, 2015, pp. 117-131.

[18]

S. Krusche, L. Alperowitz, Introduction of continuous delivery in multi-customer project courses, in: Presented at the Companion Proceedings of the 36th International Conference on Software Engineering (ICSE Companion 2014), 2014.

Digital Library

[19]

E. Laukkanen, J. Itkonen, C. Lassenius, Problems, causes and solutions when adopting continuous deliverya systematic literature review, Inf. Software Technol., 82 (2017) 55-79.

[20]

E. Laukkanen, M. Paasivaara, T. Arvonen, Stakeholder perceptions of the adoption of continuous integration a case study, in: 2015 Agile Conference (AGILE), 2015, pp. 11-20.

Digital Library

[21]

M. Leppanen, S. Makinen, M. Pagels, V.-P. Eloranta, J. Itkonen, M.V. Mantyla, The highways and country roads to continuous deployment, IEEE Software, 32 (2015) 64-72.

Digital Library

[22]

M. Marschall, Transforming a six month release cycle to continuous flow, in: 2007 Agile Conference (AGILE), 2007, pp. 395-400.

Digital Library

[23]

P. Mell, T. Grance, The NIST definition of cloud computing, National Institute of Standards and Technology, Gathersburg, MD, 2011.

[24]

S. Neely, S. Stolt, Continuous delivery? Easy! Just change everything (Well, maybe it is not that easy), in: 2013 Agile Conference (AGILE), 2013, pp. 121-128.

Digital Library

[25]

K. Noureddine, K. Foutse, Factors impacting rapid releases: an industrial case study, in: Presented at the Proceedings of the 8th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement (ESEM '14), 2014.

Digital Library

[26]

C. O'Dell, M. Skelton, Continuous Delivery with Windows and .NET, O'Reilly, 2016.

[27]

M. Odersky, L. Spoon, B. Venners, Programming in Scala: A Comprehensive Step-by-Step Guide, Artima Press, 2016.

Digital Library

[28]

H.H. Olsson, H. Alahyari, J. Bosch, Climbing the "Stairway to Heaven" a mulitiple-case study exploring barriers in the transition from agile development towards continuous deployment of software, in: 2012 38th EUROMICRO Conference on Software Engineering and Advanced Applications (SEAA), 2012, pp. 392-399.

Digital Library

[29]

Organizational Structure. Available: https://en.wikipedia.org/wiki/Organizational_structure. (Accessed 30.10.16).

[30]

Continuous Delivery: The New Normal for Software Development, 2015.

[31]

A. Puneet, Continuous SCRUM: agile management of SAAS products, in: Presented at the Proceedings of the 4th India Software Engineering Conference (ISEC '11), 2011.

Digital Library

[32]

A.A.U. Rahman, E. Helms, L. Williams, C. Parnin, Synthesizing continuous deployment practices used in software development, in: 2015 Agile Conference (AGILE), 2015, pp. 1-10.

Digital Library

[33]

O. Rissanen, J. Mnch, Transitioning towards continuous delivery in the B2B domain: a case study, in: Agile Processes in Software Engineering and Extreme Programming: 16th International Conference, XP 2015, Helsinki, Finland, May 25-29, 2015, Proceedings, Cham: Springer International Publishing, 2015, pp. 154-165.

[34]

A. Rob, Effective IT Service Management: To ITIL and Beyond!, Springer-Verlag, New York, Inc, 2007.

Digital Library

[35]

P. Rodrguez, A. Haghighatkhah, L.E. Lwakatare, S. Teppola, T. Suomalainen, J. Eskeli, Continuous deployment of software intensive products and services: a systematic mapping study, J. Syst. Software (2016).

[36]

R.O. Rogers, Scaling Continuous Integration, in: Extreme Programming and Agile Processes in Software Engineering: 5th International Conference, XP 2004, Garmisch-Partenkirchen, Germany, June 6-10, 2004. Proceedings, Springer Berlin Heidelberg, Berlin, Heidelberg, 2004, pp. 68-76.

[37]

T. Savor, M. Douglas, M. Gentili, L. Williams, K. Beck, M. Stumm, Continuous deployment at Facebook and OANDA, in: Presented at the Proceedings of the 38th International Conference on Software Engineering Companion (ICSE '16), 2016.

Digital Library

[38]

N. Sekitoleko, F. Evbota, E. Knauss, A. Sandberg, M. Chaudron, H.H. Olsson, Technical dependency challenges in large-scale agile software development, in: Agile Processes in Software Engineering and Extreme Programming: 15th International Conference, XP 2014, Rome, Italy, May 26-30, 2014. Proceedings, Cham: Springer International Publishing, 2014, pp. 46-61.

Digital Library

[39]

Y. Singh, A. Kaur, B. Suri, S. Singhal, Systematic literature review on regression test prioritization techniques, Informatica, 36 (2012).

[40]

R. Souza, C. Chavez, R.A. Bittencourt, Rapid releases and patch backouts: a software analytics approach, IEEE Software, 32 (2015) 89-96.

Digital Library

[41]

R. Todnem By, Organisational change management: a critical review, J. Change Manage., 5 (2005) 369-380.

[42]

G. Volker, H. Christoph, J. Christian, Security of public continuous integration services, in: Presented at the Proceedings of the 9th International Symposium on Open Collaboration (WikiSym '13), 2013.

Digital Library

[43]

M. Wynne, A. Hellesoy, The Cucumber Book: Behaviour-Driven Development For Testers and Developers, Pragmatic Bookshelf, Dallas, TX, 2012.

Digital Library

[44]

L. Zhu, D. Xu, A.B. Tran, X. Xu, L. Bass, I. Weber, Achieving reliable high-frequency releases in cloud environments, IEEE Software, 32 (2015) 73-80.

Digital Library

Cited By

Lönnfält ATu VGay GSingh ATahvili S(2025)An intelligent test management system for optimizing decision making during software testingJournal of Systems and Software10.1016/j.jss.2024.112202219:COnline publication date: 1-Jan-2025
https://dl.acm.org/doi/10.1016/j.jss.2024.112202
Aouni FMoumane KIdri ANajib MJan S(2025)A systematic literature review on Agile, Cloud, and DevOps integrationInformation and Software Technology10.1016/j.infsof.2024.107569177:COnline publication date: 1-Jan-2025
https://dl.acm.org/doi/10.1016/j.infsof.2024.107569
Azad NHyrynsalmi S(2024)Multivocal Literature Review on DevOps Critical Success FactorsProceedings of the 28th International Conference on Evaluation and Assessment in Software Engineering10.1145/3661167.3661236(520-527)Online publication date: 18-Jun-2024
https://dl.acm.org/doi/10.1145/3661167.3661236
Show More Cited By

Recommendations

Beyond continuous delivery: an empirical investigation of continuous deployment challenges
ESEM '17: Proceedings of the 11th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement

Context: A growing number of software organizations have been adopting Continuous DElivery (CDE) and Continuous Deployment (CD) practices. Researchers have started investing significant efforts in studying different aspects of CDE and CD. Many studies ...
Research opportunities in continuous delivery: reflections from two years' experiences in a large bookmaking company
RELENG '15: Proceedings of the Third International Workshop on Release Engineering

We have been implementing continuous delivery in Paddy Power, a large organization in the bookmaking industry, for more than two years. In this talk, I will reflect on our journey to continuous delivery and discuss the research opportunities I see.
Continuous delivery at scale: challenges and opportunities
RCoSE '18: Proceedings of the 4th International Workshop on Rapid Continuous Software Engineering

Continuous Delivery (CD) can bring huge benefits, but implementing CD is challenging. This is particularly true for implementing CD at an ultra-large-scale (across an R&D organization of tens of thousands of staff) for mission critical systems. In this ...

Comments

Information & Contributors

Information

Published In

cover image Journal of Systems and Software

Journal of Systems and Software Volume 128, Issue C

June 2017

256 pages

ISSN:0164-1212

Issue’s Table of Contents

Copyright © The Author.

Publisher

Elsevier Science Inc.

United States

Publication History

Published: 01 June 2017

Author Tags

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

33
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 20 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Lönnfält ATu VGay GSingh ATahvili S(2025)An intelligent test management system for optimizing decision making during software testingJournal of Systems and Software10.1016/j.jss.2024.112202219:COnline publication date: 1-Jan-2025
https://dl.acm.org/doi/10.1016/j.jss.2024.112202
Aouni FMoumane KIdri ANajib MJan S(2025)A systematic literature review on Agile, Cloud, and DevOps integrationInformation and Software Technology10.1016/j.infsof.2024.107569177:COnline publication date: 1-Jan-2025
https://dl.acm.org/doi/10.1016/j.infsof.2024.107569
Azad NHyrynsalmi S(2024)Multivocal Literature Review on DevOps Critical Success FactorsProceedings of the 28th International Conference on Evaluation and Assessment in Software Engineering10.1145/3661167.3661236(520-527)Online publication date: 18-Jun-2024
https://dl.acm.org/doi/10.1145/3661167.3661236
Amaro RPereira RMira da Silva M(2024)DevOps Metrics and KPIs: A Multivocal Literature ReviewACM Computing Surveys10.1145/365250856:9(1-41)Online publication date: 13-Mar-2024
https://dl.acm.org/doi/10.1145/3652508
Mastropaolo AZampetti FBavota GDi Penta MRoychoudhury APaiva AAbreu RStorey M(2024)Toward Automatically Completing GitHub WorkflowsProceedings of the IEEE/ACM 46th International Conference on Software Engineering10.1145/3597503.3623351(1-12)Online publication date: 20-May-2024
https://dl.acm.org/doi/10.1145/3597503.3623351
Zampetti FTamburri DPanichella SPanichella ACanfora GDi Penta M(2023)Continuous Integration and Delivery Practices for Cyber-Physical Systems: An Interview-Based StudyACM Transactions on Software Engineering and Methodology10.1145/357185432:3(1-44)Online publication date: 26-Apr-2023
https://dl.acm.org/doi/10.1145/3571854
Chondamrongkul NSun J(2023)Software evolutionary architectureScience of Computer Programming10.1016/j.scico.2023.102978230:COnline publication date: 1-Aug-2023
https://dl.acm.org/doi/10.1016/j.scico.2023.102978
Azad NHyrynsalmi S(2023)DevOps critical success factors — A systematic literature reviewInformation and Software Technology10.1016/j.infsof.2023.107150157:COnline publication date: 1-May-2023
https://dl.acm.org/doi/10.1016/j.infsof.2023.107150
Panek MPomykała AJabłoński IWoźniak M(2023)5G/5G+ network management employing AI-based continuous deploymentApplied Soft Computing10.1016/j.asoc.2023.109984134:COnline publication date: 1-Feb-2023
https://dl.acm.org/doi/10.1016/j.asoc.2023.109984
Rostami Mazrae PMens TGolzadeh MDecan A(2023)On the usage, co-usage and migration of CI/CD tools: A qualitative analysisEmpirical Software Engineering10.1007/s10664-022-10285-528:2Online publication date: 7-Mar-2023
https://dl.acm.org/doi/10.1007/s10664-022-10285-5
Show More Cited By

View Options

View options

Media

Figures

Other

Tables

View Issue’s Table of Contents