skip to main content
10.1109/ESEM.2009.5315983guideproceedingsArticle/Chapter ViewAbstractPublication PagesesemConference Proceedingsconference-collections
Article
Free access

Tool supported detection and judgment of nonconformance in process execution

Published: 15 October 2009 Publication History

Abstract

In the past decades the Software Engineering community has proposed a large collection of software development life cycles, models, and processes. The goal of a major set of these processes is to assure that the product is finished within time and budget, and that a predefined set of functional and non functional requirements (e.g. quality goals) are satisfied at delivery time. Based upon the assumption that there is a real relationship between the process applied and the characteristics of the product developed from that process, we developed a tool-supported approach that uses process nonconformance detection to identify potential risks in achieving the required process characteristics. In this paper we present the approach and a feasibility study that demonstrates its use on a large-scale software development project in the aerospace domain. We demonstrate that our approach, in addition to meeting the criteria above, can be applied to a real system of reasonable size; can represent a useful and adequate set of rules of relevance in such an environment; and can detect relevant examples of process nonconformance that provide useful insight to the project manager.

References

[1]
Werth ."Lecture Notes on Software Process Improvement" by Laurie Honour Werth, document number CMU/SEI-93-EM-8, copyright 1993 by Carnegie Mellon University. http://www2.umassd.edu/SWPI/curriculummodule/em8. part1.pdf.
[2]
S. Sørumgård. "Verification of Process Conformance in Empirical Studies of Software Development". Ph.D. thesis, Norwegian University of Science and Technology, 1997.
[3]
Marvin V. Zelkowitz and Dolores Wallace. Experimental Models for Software Diagnosis. Technical report NISTR 5889, September 1996.
[4]
A. Finkelstein, J. Kramer, B. Nuseineh (eds.). Software Process Modeling. John Wiley RSP, 1994.
[5]
Kellner, M. I. 1988. Representation formalisms for software process modelling. In Proceedings of the 4th international Software Process Workshop on Representing and Enacting the Software Process (Devon, United Kingdom). C. Tully, Ed. ACM, New York, NY, 93-96.
[6]
Roethlisberger, Fritz J., and W. J. Dickson. Management and the Worker. Harvard University Press, 1939.
[7]
Quality systems - Model for quality assurance in design, development, production, installation and servicing. International Organization for Standardization, 1993.
[8]
Information Technology - Software life cycle processes. International Organization for Standardization, 1995.
[9]
Lanubile, F. and Visaggio, G., "Evaluating Defect Detection Techniques for Software Requirements Inspections", ISERN Report no. 00-08, 2000.
[10]
Silva, L.F.S.; Travassos, G.H., "Tool-supported unobtrusive evaluation of software engineering process conformance," Empirical Software Engineering, 2004. ISESE '04. Proceedings. 2004 International Symposium on, vol., no., pp. 127-135, 19-20 Aug. 2004.
[11]
Johnson, P.M.; Hongbing Kou; Agustin, J.M.; Qin Zhang; Kagawa, A.; Yamashita, T., "Practical automated process and product metric collection and analysis in a classroom setting: lessons learned from Hackystat-UH," Empirical Software Engineering, 2004. ISESE '04. Proceedings. 2004 International Symposium on, vol., no., pp. 136-144, 19-20 Aug. 2004.
[12]
Lorin Hochstein, Taiga Nakamura, Forrest Shull, Nico Zazworka, Victor R. Basili, Marvin V. Zelkowitz "An Environment for Conducting Families of Software Engineering Experiments", Advances in Computers (ed. by Marvin Zelkowitz), Vol. 74, ElseVier, 2008.
[13]
Cook, J. E. and Wolf, A. L. 1998. Discovering models of software processes from event-based data. ACM Trans. Softw. Eng. Methodol. 7, 3 (Jul. 1998), 215-249.
[14]
Basili, V., Caldiera, G., and Rombach, D. Experience Factory. Encyclopedia of Software Engineering Volume 1:469-476, Marciniak, J. ed. John Wiley & Sons, 1994.
[15]
M. Fowler. Refactoring: Improving the Design of Existing Code. Addison-Wesley, 1999.
[16]
Basili, V. R. 1992 Software Modeling and Measurement: the Goal/Question/Metric Paradigm. Technical Report. University of Maryland at College Park.
[17]
Nagappan, N.; Ball, T., "Use of relative code churn measures to predict system defect density," Software Engineering, 2005. ICSE 2005. Proceedings. 27th International Conference on, vol., no., pp. 284-292, 15- 21 May 2005.

Cited By

View all
  • (2024)Mining Pull Requests to Detect Process Anomalies in Open Source Software DevelopmentProceedings of the IEEE/ACM 46th International Conference on Software Engineering10.1145/3597503.3639196(1-13)Online publication date: 20-May-2024
  • (2015)The Art and Science of Analyzing Software DataundefinedOnline publication date: 15-Sep-2015
  • (2014)Impact of process conformance on the effects of test-driven developmentProceedings of the 8th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement10.1145/2652524.2652526(1-10)Online publication date: 18-Sep-2014
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image Guide Proceedings
ESEM '09: Proceedings of the 2009 3rd International Symposium on Empirical Software Engineering and Measurement
October 2009
601 pages
ISBN:9781424448425

Publisher

IEEE Computer Society

United States

Publication History

Published: 15 October 2009

Qualifiers

  • Article

Acceptance Rates

Overall Acceptance Rate 130 of 594 submissions, 22%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)30
  • Downloads (Last 6 weeks)3
Reflects downloads up to 25 Dec 2024

Other Metrics

Citations

Cited By

View all
  • (2024)Mining Pull Requests to Detect Process Anomalies in Open Source Software DevelopmentProceedings of the IEEE/ACM 46th International Conference on Software Engineering10.1145/3597503.3639196(1-13)Online publication date: 20-May-2024
  • (2015)The Art and Science of Analyzing Software DataundefinedOnline publication date: 15-Sep-2015
  • (2014)Impact of process conformance on the effects of test-driven developmentProceedings of the 8th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement10.1145/2652524.2652526(1-10)Online publication date: 18-Sep-2014
  • (2013)Towards flexible automated support to improve the quality of computational science and engineering softwareProceedings of the 5th International Workshop on Software Engineering for Computational Science and Engineering10.5555/2663370.2663384(88-91)Online publication date: 18-May-2013
  • (2010)CodeVizardProceedings of the 2010 ACM-IEEE International Symposium on Empirical Software Engineering and Measurement10.1145/1852786.1852865(1-1)Online publication date: 16-Sep-2010
  • (2010)Are developers complying with the processProceedings of the 2010 ACM-IEEE International Symposium on Empirical Software Engineering and Measurement10.1145/1852786.1852805(1-10)Online publication date: 16-Sep-2010

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Login options

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media