research-article

Impact of process simulation on software practice: an initial report

Authors:

Liming ZhuAuthors Info & Claims

ICSE '11: Proceedings of the 33rd International Conference on Software Engineering

Pages 1046 - 1056

https://doi.org/10.1145/1985793.1985993

Published: 21 May 2011 Publication History

Abstract

Process simulation has become a powerful technology in support of software project management and process improvement over the past decades. This research, inspired by the Impact Project, intends to investigate the technology transfer of software process simulation to the use in industrial settings, and further identify the best practices to release its full potential in software practice. We collected the reported applications of process simulation in software industry, and identified its wide adoption in the organizations delivering various software intensive systems. This paper, as an initial report of the research, briefs a historical perspective of the impact upon practice based on the documented evidence, and also elaborates the research-practice transition by examining one detailed case study. It is shown that research has a significant impact on practice in this area. The analysis of impact trace also reveals that the success of software process simulation in practice highly relies on the association with other software process techniques or practices and the close collaboration between researchers and practitioners.

References

[1]

T. K. Abdel-Hamid. The dynamics of software development project management: an integrative system dynamics perspective. PhD thesis, Massachusetts Institute of Technology, 1984.

[2]

T. K. Abdel-Hamid and S. E. Madnick. A model of software project management dynamics. In 6th Computer Software and Application Conference (COMPSAC'82). IEEE, November 1982.

[3]

T. K. Abdel-Hamid and S. E. Madnick. Software Project Dynamics: An Integrated Approach. Prentice Hall, Englewood Cliffs, N.J., 1991.

Digital Library

[4]

J. Banks, J. S. Carson, B. L. Nelson, and D. Nicol. Discrete-Event System Simulation. Prentice-Hall, Englewood Cliffs, NJ, 4th edition, 2004.

[5]

B. Boehm. Software Engineering Economics. Prentice Hall, Englewood, Cliffs, NJ, 1981.

Digital Library

[6]

A. G. Cass, B. S. Lerner, E. K. McCall, L. J. Osterweil, S. M. J. Sutton, and A. Wise. Little-jil/juliette: A process definition language and interpreter. In 22nd International Conference on Software Engineering (ICSE'00), pages 754--757, Limerick, Ireland, June 2000. IEEE.

Digital Library

[7]

R. Coyle. System Dynamics Modelling: A Practical Approach. Chapman & Hall/CRC, 1996.

[8]

B. Curtis, M. I. Kellner, and J. Over. Process modeling. Communications of the ACM, 35(9):75--90, 1992.

Digital Library

[9]

W. Emmerich, M. Aoyama, and J. Sventek. The impact of research on the development of middleware technology. ACM Transactions on Software Engineering and Methodology, 17(4):1--48, 2008.

Digital Library

[10]

J. Estublier, D. Leblang, A. V. D. Hoek, R. Conradi, G. Clemm, W. Tichy, and D. Wiborg-Weber. Impact of software engineering research on the practice of software configuration management. ACM Transactions on Software Engineering and Methodology, 14(4):383--430, 2005.

Digital Library

[11]

J. W. Forrester. Industrial Dynamics. System Dynamics Series. Pegasus Communications, 1961.

[12]

J. W. Forrester. Principles of Systems. System Dynamics Series. Pegasus Communications, 1968.

[13]

D. Houston. A case study in software enhancements as six sigma process improvements: Simulating productivity savings. In 4th International Workshop on Software Process Modeling and Simulation (PROSIM'03), Portland, OR, May 2003.

[14]

D. Houston. An experience in facilitating process improvement with an integration problem reporting process simulation. Software Process: Improvement and Practice, 11(4):361--371, 2006.

[15]

D. Houston, D. Buettner, and M. Hecht. Dynamic coqualmo defect profiling over development cycles. In International Conference on Software Process (ICSP'09), volume LNCS 5543, pages 161--172, Vancouver, Canada, May 2009. Springer.

Digital Library

[16]

D. Houston and M. Lieu. Modeling a resource-constrained test-and-fix cycle and test phase duration. In International Conference on Software Process (ICSP'10), volume LNCS 6195, pages 211--221, Paderborn, Germany, July 2010. Springer.

Digital Library

[17]

W. S. Humphrey and M. I. Kellner. Software process modeling: Principles of entity process models. In 11th International Conference on Software Engineering (ICSE'89), pages 331--342, Pittsburgh, PA, May 1989. ACM.

Digital Library

[18]

M. I. Kellner, P. H. Feiler, A. Finkelstein, T. Katayama, L. J. Osterweil, M. H. Penedo, and H. D. Rombach. Ispw-6 software process example. In 6th International Software Process Workshop (ISPW), pages 176--186, Hakodate, Hokkaido, Japan, 1991.

[19]

M. I. Kellner, R. J. Madachy, and D. M. Raffo. Software process simulation modeling: Why? what? how? Journal of Systems and Software, 46(2/3):91--105, 1999.

[20]

B. Kuipers. Qualitative Reasoning: Modeling and Simulation with Incomplete Knowledge. MIT Press, 1994.

Digital Library

[21]

A. M. Law and W. D. Kelton. Simulation Modeling and Analysis. McGraw Hill, 3rd edition, 2000.

Digital Library

[22]

R. Madachy and D. Tarbet. Case studies in software process modeling with system dynamics. Software Process: Improvement and Practice, 5(2--3):15--27, 2000.

[23]

R. J. Madachy. A Software Project Dynamics Model for Process Cost, Schedule, and Risk Assessment. PhD thesis, University of Southern California, 1994.

Digital Library

[24]

R. J. Madachy. System dynamics modeling of an inspection-based process. In 18th International Conference on Software Engineering (ICSE'96), pages 376--386, Berlin, Germany, March 1996. IEEE.

Digital Library

[25]

R. H. Martin and D. M. Raffo. Application of a hybrid process simulation model to a software development project. Journal of Systems and Software, 59(3):237--246, 2001.

[26]

E. O. Navarro and A. v. d. Hoek. Software process modeling for an educational software engineering simulation game. Software Process: Improvement and Practice, 10(3):311--325, 2005.

[27]

L. Osterweil, C. Ghezzi, J. Kramer, and a. L. Wolf. Determining the impact of software engineering research on practice. Computer, 41(3):39--49, 2008.

Digital Library

[28]

L. J. Osterweil. Software processes are software too. In 9th International Conference on Software Engineering (ICSE'87), pages 2--13, Monterey, CA, March-April 1987. ACM.

Digital Library

[29]

L. J. Osterweil. Unifying microprocess and macroprocess research. In Software Process Workshop (SPW'05), volume LNCS 3840, pages 68--74, Beijing, China, May 2005. Springer.

Digital Library

[30]

D. Pfahl. An Integrated Approach to Simulation-Based Learning in Support of Strategic and Project Management in Software Organisations. PhD thesis, University of Kaiserslautern, 2001.

[31]

D. Pfahl and K. Lebsanft. Integration of system dynamics modelling with descriptive process modelling and goal-oriented measurement. Journal of Systems and Software, 46(2--3):135--150, 1999.

[32]

D. Pfahl and K. Lebsanft. Using simulation to analyse the impact of software requirement volatility on project performance. Information and Software Technology, 42(14):1001--1008, 2000.

[33]

D. Raffo, R. Ferguson, S.-o. Setamanit, and B. Sethanandha. Evaluating the impact of requirements analysis tools using simulation. Software Process: Improvement and Practice, 13(1):63--73, 2008.

Digital Library

[34]

D. Raffo and T. Menzies. Evaluating the impact of a new technology using simulation: The case for mining software repositories. In 6th International Workshop on Software Process Modeling and Simulation (PROSIM'05), pages 57--62, St. Louis, MO, May 2005.

[35]

D. Raffo, U. Nayak, and W. Wakeland. Implementing generalized process simulation models. In 6th International Workshop on Software Process Modeling and Simulation (PROSIM'05), pages 139--143, St. Louis, MO, May 2005.

[36]

D. M. Raffo. Modeling Software Processes Quantitatively and Assessing the Impact of Potential Process Changes on Process Performance. PhD thesis, Carnegie Mellon University, 1996.

Digital Library

[37]

D. M. Raffo, J. V. Vandeville, and R. H. Martin. Software process simulation to achieve higher cmm levels. Journal of Systems and Software, 46(2/3):163--172, 1999.

[38]

D. Rombach, M. Ciolkowski, R. Jeffery, O. Laitenberger, F. McGarry, and F. Shull. Impact of research on practice in the field of inspections, reviews and walkthroughs. ACM SIGSOFT Software Engineering Notes, 33(6):26, 2008.

Digital Library

[39]

W. Royce. Trw's ada process model for incremental development of large software systems. In 12th International Conference on Software Engineering (ICSE'90), pages 2--11, Nice, France, March 1990. IEEE.

Digital Library

[40]

I. Rus. Modeling the Impact on Cost and Schedule on Software Quality Engineering Practices. PhD thesis, Arizona State University, 1998.

Digital Library

[41]

I. Rus, J. Collofello, and P. Lakey. Software process simulation for reliability management. Journal of Systems and Software, 46(2-3):173--182, 1999.

[42]

N. Smith, A. Capiluppi, and J. F. Ramil. Agent-based simulation of open source evolution. Software Process: Improvement and Practice, 11(4):423--434, 2006.

[43]

P. Wernick and M. M. Lehman. Software process white box modelling for feast/1. Journal of Systems and Software, 46(2-3):193--202, 1999.

[44]

A. Wise. Little-jil 1.5 language report. Technical report, University of Massachusetts, Amherst, 2006.

[45]

M. Wooldridge. An Introduction to MultiAgent Systems. John Wiley & Sons, 2002.

Digital Library

[46]

E. Yourdon. Rise and Resurrection of the American Programmer. Prentice-Hall, Upper Saddle River, NJ, 1997.

Digital Library

[47]

H. Zhang. Qualitative and Semi-Quantitative Modeling and Simulation of Software Engineering Processes. PhD thesis, University of New South Wales, 2008.

[48]

H. Zhang, R. Jeffery, and L. Zhu. Hybrid modeling of test-and-fix processes in incremental development. In International Conference on Software Process (ICSP'08), volume LNCS 5007, pages 333--344, Leipzig, Germany, May 2008. Springer.

Digital Library

[49]

H. Zhang and B. Kitchenham. Semi-quantitative simulation modeling of software engineering process. In Software Process Workshop/International Workshop on Software Process Simulation and Modeling (SPW/ProSim'06), volume LNCS 3966, pages 242--253, Shanghai, China, May 2006. Springer.

Digital Library

[50]

H. Zhang, B. Kitchenham, and D. Pfahl. Reflections on 10 years of software process simulation modelling: A systematic review. In International Conference on Software Process (ICSP'08), volume LNCS 5007, pages 345--365, Leipzig, Germany, May 2008. Springer.

Digital Library

[51]

H. Zhang, B. Kitchenham, and D. Pfahl. Software process simulation modeling: Facts, trends, and directions. In 15th Asia-Pacific Software Engineering Conference (APSEC'08), pages 59--66, Beijing, China, December 2008. IEEE.

Digital Library

[52]

H. Zhang, B. Kitchenham, and D. Pfahl. Software process simulation modeling: An extended systematic review. In International Conference on Software Process (ICSP'10), volume LNCS 6195, pages 309--320, Paderborn, Germany, July 2010. Springer.

Digital Library

[53]

L. Zhu, L. Osterweil, M. Staples, U. Kannengiesser, and B. Simidchieva. Desiderata for languages to be used in the definition of reference business processes. International Journal of Software and Informatics, 1(1):37--66, 2008.

Cited By

Liu BZhang HDong LWang ZLi S(2024)Metrics for software process simulation modelingJournal of Software: Evolution and Process10.1002/smr.2676Online publication date: 11-Jul-2024
https://doi.org/10.1002/smr.2676
Saravanos ACuringa M(2023)Simulating the Software Development Lifecycle: The Waterfall ModelApplied System Innovation10.3390/asi60601086:6(108)Online publication date: 14-Nov-2023
https://doi.org/10.3390/asi6060108
de França BAli N(2020)The Role of Simulation-Based Studies in Software Engineering ResearchContemporary Empirical Methods in Software Engineering10.1007/978-3-030-32489-6_10(263-287)Online publication date: 28-Aug-2020
https://doi.org/10.1007/978-3-030-32489-6_10
Show More Cited By

Index Terms

Impact of process simulation on software practice: an initial report
1. Software and its engineering
  1. Software creation and management
    1. Software development process management

Recommendations

Change Impact Analysis of a Software Process Using Process Slicing
QSIC '09: Proceedings of the 2009 Ninth International Conference on Quality Software

A software process needs to be changed for various reasons during or before its enactment. To accommodate the change in the software process, it is necessary to analyze the impacts of the change. Few researches provide the methods to structurally analyze ...
Simulation modeling of evolving software processes
ICSSP '12: Proceedings of the International Conference on Software and System Process

Software processes evolve as software too. The evolving software processes are adapted to accommodate the rapid progress and changes in software engineering practice. Software process simulation has to evolve as well in order to effectively investigate ...
An approach to analyzing the software process change impact using process slicing and simulation

When a software process is changed, a project manager needs to perform two types of change impact analysis activities: one for identifying the affected elements of a software process which is affected by the change and the other for analyzing the ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

ICSE '11: Proceedings of the 33rd International Conference on Software Engineering

May 2011

1258 pages

ISBN:9781450304450

DOI:10.1145/1985793

General Chair:
Richard N. Taylor
UC Irvine, USA
,
Program Chairs:
Harald Gall
University of Zurich, Switzerland
,
Nenad Medvidović
University of Southern California, USA

Copyright © 2011 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 21 May 2011

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

ICSE11

Sponsor:

SIGSOFT

ICSE11: International Conference on Software Engineering

May 21 - 28, 2011

HI, Waikiki, Honolulu, USA

Acceptance Rates

Overall Acceptance Rate 276 of 1,856 submissions, 15%

Upcoming Conference

ICSE 2025

2025 IEEE/ACM 46th International Conference on Software Engineering

April 26 - May 3, 2025

Ottawa , ON , Canada

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

20
Total Citations
View Citations
467
Total Downloads

Downloads (Last 12 months)3
Downloads (Last 6 weeks)0

Reflects downloads up to 06 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Liu BZhang HDong LWang ZLi S(2024)Metrics for software process simulation modelingJournal of Software: Evolution and Process10.1002/smr.2676Online publication date: 11-Jul-2024
https://doi.org/10.1002/smr.2676
Saravanos ACuringa M(2023)Simulating the Software Development Lifecycle: The Waterfall ModelApplied System Innovation10.3390/asi60601086:6(108)Online publication date: 14-Nov-2023
https://doi.org/10.3390/asi6060108
de França BAli N(2020)The Role of Simulation-Based Studies in Software Engineering ResearchContemporary Empirical Methods in Software Engineering10.1007/978-3-030-32489-6_10(263-287)Online publication date: 28-Aug-2020
https://doi.org/10.1007/978-3-030-32489-6_10
Ahmed APage JOlsen J(2019)Enhancing Six Sigma methodology using simulation techniquesInternational Journal of Lean Six Sigma10.1108/IJLSS-03-2018-0033Online publication date: 23-May-2019
https://doi.org/10.1108/IJLSS-03-2018-0033
Kerzazi N(2019)Localizing Inconsistencies into Software Process Models at a Conceptual LevelNew Knowledge in Information Systems and Technologies10.1007/978-3-030-16181-1_73(775-788)Online publication date: 27-Mar-2019
https://doi.org/10.1007/978-3-030-16181-1_73
Tanir O(2017)Simulation-Based Software EngineeringGuide to Simulation-Based Disciplines10.1007/978-3-319-61264-5_7(151-166)Online publication date: 28-Jul-2017
https://doi.org/10.1007/978-3-319-61264-5_7
Fernandes EOliveira JFigueiredo E(2016)Investigating how features of online learning support software process education2016 IEEE Frontiers in Education Conference (FIE)10.1109/FIE.2016.7757681(1-8)Online publication date: Oct-2016
https://doi.org/10.1109/FIE.2016.7757681
Saremi RYang YFraser GLaToza TMariani L(2015)Dynamic simulation of software workers and task completionProceedings of the Second International Workshop on CrowdSourcing in Software Engineering10.5555/2820116.2820120(17-23)Online publication date: 16-May-2015
https://dl.acm.org/doi/10.5555/2820116.2820120
Bodi ŞDragomir MBanyai DDragomir D(2015)Process Improvements Using Simulation Software and Quality ToolsApplied Mechanics and Materials10.4028/www.scientific.net/AMM.808.376808(376-381)Online publication date: Nov-2015
https://doi.org/10.4028/www.scientific.net/AMM.808.376
Gao CZhang HJiang SPfahl DBendraou RTurner RKuhrmann MHebig RMaggi F(2015)Constructing hybrid software process simulation modelsProceedings of the 2015 International Conference on Software and System Process10.1145/2785592.2785610(157-166)Online publication date: 24-Aug-2015
https://dl.acm.org/doi/10.1145/2785592.2785610
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents