article

An Empirical Exploration of the Distributions of the Chidamber and Kemerer Object-Oriented Metrics Suite

Authors:

Giancarlo Succi,

Witold Pedrycz,

Snezana Djokic,

Barbara RussoAuthors Info & Claims

Empirical Software Engineering, Volume 10, Issue 1

Pages 81 - 104

https://doi.org/10.1023/B:EMSE.0000048324.12188.a2

Published: 01 January 2005 Publication History

Abstract

The object-oriented metrics suite proposed by Chidamber and Kemerer (CK) is a measurement approach towards improved object-oriented design and development practices. However, existing studies evidence traces of collinearity between some of the metrics and low ranges of other metrics, two facts which may endanger the validity of models based on the CK suite. As high correlation may be an indicator of collinearity, in this paper, we empirically determine to what extent high correlations and low ranges might be expected among CK metrics.

To draw as much general conclusions as possible, we extract the CK metrics from a large data set (200 public domain projects) and we apply statistical meta-analysis techniques to strengthen the validity of our results. Homogenously through the projects, we found a moderate (∼0.50) to high correlation (>0.80) between some of the metrics and low ranges of other metrics.

Results of this empirical analysis supply researchers and practitioners with three main advises: a) to avoid the use in prediction systems of CK metrics that have correlation more than 0.80 b) to test for collinearity those metrics that present moderate correlations (between 0.50 and 0.60) c) to avoid the use as response in continuous parametric regression analysis of the metrics presenting low variance. This might therefore suggest that a prediction system may not be based on the whole CK metrics suite, but only on a subset consisting of those metrics that do not present either high correlation or low ranges.

References

[1]

Aron, A., and Aron, E. N. 1997. Statistics for the Behavioral and Social Sciences. Prentice Hall.

[2]

Barnston, A. G. 1994. Linear statistical short-term climate predictive skill in the northern hemisphere. J. Climate 7: 1513-1564.

[3]

Basili, V. R., Briand, L. C., and Melo, W. L. 1996. A validation of object-oriented design metrics as quality indicators. IEEE Trans. Softw. Eng. 22(10): October, 751-761.

Digital Library

[4]

Belanger, S. E. 1997. Literature review and analysis of biological complexity in model stream ecosystems: Influence of size and experimental design. Eco. Environ. Saf. 36(1): 1-16.

[5]

Belsley, D. A. 1991. Conditioning Diagnostics: Collinearity and Weak Data in Regression. New York: J. Wiley.

[6]

Briand, L., and Wüst, J. 2001. Modeling development effort in object-oriented systems using design properties. IEEE Trans. Softw. Eng. 27(11): November, 963-986.

Digital Library

[7]

Briand, L., Ikonomovski, S. V., and Lounis, H. 1999. Investigating quality factors in object-oriented designs: An industrial case study. Proc. 21st Int. Conf. on Softw. Eng. Los Angeles, May 16-22, 345-354.

Digital Library

[8]

Briand, L., Melo, W., and Wüst, J. 2002. Assessing the applicability of fault-proneness models across object-oriented software projects. IEEE Trans. Softw. Eng. 28(7): July, 706-720.

Digital Library

[9]

Cartwright, M., and Shepperd, M. 2000. An empirical investigation of an object-oriented software system. IEEE Trans. Softw. Eng. 26(8): August, 786-796.

Digital Library

[10]

Chidamber, S. R., and Kemerer, C. F. 1994. A metrics suite for object-oriented design. IEEE Trans. Softw. Eng. 20(6): June, 476-493.

Digital Library

[11]

Chidamber, S. R., and Kemerer, C. F. 1991. Towards a metrics suite for object oriented design, Proceedings of the 6th ACM Conference on Object-Oriented Programming, Systems Languages, and Applications (OOPSLA'91), Phoenix, AZ, pp. 197-211.

Digital Library

[12]

Chidamber, S. R., Darcy, D. P., and Kemerer, C. F. 1998. Managerial use of metrics for object-oriented software: An exploratory analysis. IEEE Trans. Softw. Eng. 24(8): August, 629-639.

Digital Library

[13]

Churcher, N., and Shepperd, M. J. 1995. Comments on "A metrics suite for object oriented design". IEEE Trans. Softw. Eng. 21(3): March, 263-265.

Digital Library

[14]

Cohen, J. 1977. Statistical Power Analysis for the Behavioral Sciences. New York: Academic Press.

[15]

Cook, T. D., Cooper H., Cordray D. S., Hartmann H., Hedges L. V., Light R. J., Louis T. A., and Mosteller F. 1994. Meta-Analysis for explanation--A casebook.

[16]

Cooper, H. M., and Hedges, L. V. (eds.) 1994. The Handbook of Research Synthesis. New York: The Russell Sage Foundation.

Digital Library

[17]

Daly, J., Brooks, A., Miller, J., Roper, M., and Wood, M. 1996. Evaluating inheritance depth on the maintainability of object-oriented software. Empir. Soft. Eng. 1(2): 109-132.

[18]

El Emam, K., Benlarbi, S., and Goel, N. 1999. The confounding effect of class size on the validity of object-oriented metrics. Technical Report, NRC/ERB-1062, September.

[19]

El Emam, K., Melo, W., and Machado, J. C. 2001. The prediction of faulty classes using object-oriented metrics. J. Syst. Softw. 56(1): 63-75.

Digital Library

[20]

Fenton, N. E., and Neil, M. 1999. A critique of software defect prediction models. IEEE Trans. Softw. Eng. 25(5): September/October, 675-689.

Digital Library

[21]

Harrison, R., Counsell, S., and Nithi, R. 1998. Coupling metrics for object-oriented design. Proc. 5th Int. Symp. Softw. Metr. Bethesda Maryland, November.

Digital Library

[22]

Hayes, W. 2000. Research synthesis in software engineering: A case for meta-analysis. Proc. 6th IEEE Int. Symp. Softw. Metr. Boca-Raton, Florida, USA, November.

Digital Library

[23]

Hedges, L. V., and Olkin, I. 1985. Statistical Methods for Meta-Analysis. Orlando: Academic Press.

[24]

Henderson-Sellers, B., Constantine, L. L., and Graham, I. M. 1996. Coupling and cohesion (towards a valid metrics suite for object-oriented analysis and design). Object Oriented Syst. 3(3): 143-158.

[25]

Hitz, M., and Montazeri, B. 1996. Chidamber and Kemerer's metrics suite: A measurement theory perspective. IEEE Trans. Softw. Eng. 22(4): 267-271.

Digital Library

[26]

Hu, Q. 1997. Evaluating alternative software production functions. IEEE Trans. Softw. Eng. 23(6): June, 379-387.

Digital Library

[27]

Hunter, J. E., and Schmidt, F. L. 1990. Methods for Meta-Analysis: Correcting Error and Bias in Research Findings. Newbury Park, CA: Sage.

[28]

Kendall, M. G. 1949. Rank and product-moment correlation. Biometrika 36: 177-193.

[29]

Kendall, M. G., and Gibbons, J. D. 1990. Rank Correlation Methods, 5th edition. New York: Oxford University Press.

[30]

Li, W., and Henry, S. 1993. Object-oriented metrics that predict maintainability. J. Syst. Softw. 23: 111-122.

Digital Library

[31]

Liao, Yuen-Kuang Cliff. 1998. Effects on hypermedia versus traditional instruction on students' achievement: A meta-analysis. J. Res. Comput. Educ. 30(4): 341-359.

[32]

Lloyd, C. J. 1999. Statistical Analysis of Categorical Data. Wiley-Interscience.

[33]

Miller, J. 2000. Can results from software engineering experiments be safely combined? Proc. 6th IEEE Int. Symp. Softw. Metr. Boca-Raton, Florida, USA, November.

Digital Library

[34]

Mi¿i¿, V. B., and Te¿i¿, D. N. 1997. Estimation of effort and complexity: An object-oriented case study. J. Syst. Softw. 41(2): 133-143.

Digital Library

[35]

Nesi, P., and Querci, T. 1998. Effort estimation and prediction of object-oriented systems. J. Syst. Softw. 42(1): 89-102.

Digital Library

[36]

Pearson, K. 1907. Mathematical contributions to the theory of evolution. XVI. On further methods of determining correlation. Drapers' Company Research Memoirs (Biometric Series 4). Cambridge University Press.

[37]

Pickard, L. M., Kitchenham, B. A., and Jones, P. W. 1998. Combining empirical results in software engineering. Inf. Softw. Technol. 40(14): 811-821.

Digital Library

[38]

Ronchetti, M., and Succi, G. 1999. Early estimation of software size in object-oriented environments a case study in a CMM level 3 software firm. Submitted to IEEE Trans. Softw. Eng.

[39]

Rosenthal, R. 1991. Meta-Analytical Procedures for Social Research, Revised edition. Newbury Park, CA: Sage.

[40]

Rupinski, M. T., and Dunlap, W. P. 1996. Approximating Pearson product-moment correlations from Kendall's tau and Spearman's rho. Educ. Psychol. Meas. 56(3): 419-429.

[41]

Succi, G., Benedicenti, L., Bonamico, C., and Vernazza, T. 1998. The Webmetrics project--exploiting software tools on demand. World Multiconference on Systemics, Cybernetics, and Informatics. Orlando, FL.

[42]

Tang, M. H., Kao, M. H., and Chen, M. H. 1998. An empirical study on object-oriented metrics. Proc. 6th IEEE Int. Symp. Softw. Metr. Boca-Raton, Florida, USA, November.

Digital Library

[43]

Wood, M., Daly, J., Miller, J., and Roper, M. 1999. Multi-method research: An empirical investigation of object-oriented technology. J. Syst. Softw. 48(1): 13-26.

Digital Library

Cited By

Giordano GFesta GCatolino GPalomba FFerrucci FGravino C(2023)On the adoption and effects of source code reuse on defect proneness and maintenance effortEmpirical Software Engineering10.1007/s10664-023-10408-629:1Online publication date: 12-Dec-2023
https://dl.acm.org/doi/10.1007/s10664-023-10408-6
Schnappinger MFietzke APretschner A(2021)Human-level Ordinal Maintainability Prediction Based on Static Code MetricsProceedings of the 25th International Conference on Evaluation and Assessment in Software Engineering10.1145/3463274.3463315(160-169)Online publication date: 21-Jun-2021
https://dl.acm.org/doi/10.1145/3463274.3463315
Banerjee SKumar N(2019)Exploring Visual Analytics to Measure Reliability for IoT Oriented Pollution Detection Software PerspectivesInternational Journal of Distributed Systems and Technologies10.4018/IJDST.201904010110:2(1-19)Online publication date: 1-Apr-2019
https://dl.acm.org/doi/10.4018/IJDST.2019040101
Show More Cited By

Index Terms

An Empirical Exploration of the Distributions of the Chidamber and Kemerer Object-Oriented Metrics Suite

Recommendations

Chidamber and Kemerer's Metrics Suite: A Measurement Theory Perspective

The metrics suite for object-oriented design put forward by Chidamber and Kemerer [8] is partly evaluated by applying principles of measurement theory. Using the object coupling measure (CBO) as an example, it is shown that failing to establish a sound ...
Detection of Software Anomalies Using Object-oriented Metrics
ICEIS 2014: Proceedings of the 16th International Conference on Enterprise Information Systems - Volume 2

The development of quality software has always been the aim of many studies in past years, in which the

focus was on seeking for better software production with high effectiveness and quality. In order to evaluate software quality, software metrics were ...
Managerial Use of Metrics for Object-Oriented Software: An Exploratory Analysis

With the increasing use of object-oriented methods in new software development there is a growing need to both document and improve current practice in object-oriented design and development. In response to this need, a number of researchers have ...

Comments

Information & Contributors

Information

Published In

cover image Empirical Software Engineering

Empirical Software Engineering Volume 10, Issue 1

January 2005

100 pages

ISSN:1382-3256

Issue’s Table of Contents

Copyright © Copyright © 2005 Springer Science + Business Media, Inc.

Publisher

Kluwer Academic Publishers

United States

Publication History

Published: 01 January 2005

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

20
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 06 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Giordano GFesta GCatolino GPalomba FFerrucci FGravino C(2023)On the adoption and effects of source code reuse on defect proneness and maintenance effortEmpirical Software Engineering10.1007/s10664-023-10408-629:1Online publication date: 12-Dec-2023
https://dl.acm.org/doi/10.1007/s10664-023-10408-6
Schnappinger MFietzke APretschner A(2021)Human-level Ordinal Maintainability Prediction Based on Static Code MetricsProceedings of the 25th International Conference on Evaluation and Assessment in Software Engineering10.1145/3463274.3463315(160-169)Online publication date: 21-Jun-2021
https://dl.acm.org/doi/10.1145/3463274.3463315
Banerjee SKumar N(2019)Exploring Visual Analytics to Measure Reliability for IoT Oriented Pollution Detection Software PerspectivesInternational Journal of Distributed Systems and Technologies10.4018/IJDST.201904010110:2(1-19)Online publication date: 1-Apr-2019
https://dl.acm.org/doi/10.4018/IJDST.2019040101
Alshehri Y(2019)Applying explanatory analysis in education using different regression methodsProceedings of the 4th International Conference on Information and Education Innovations10.1145/3345094.3345111(109-115)Online publication date: 10-Jul-2019
https://dl.acm.org/doi/10.1145/3345094.3345111
Capiluppi AAjienka NAdams BConstantinou EMens TStewart KRobles G(2019)The relevance of application domains in empirical findingsProceedings of the 2nd International Workshop on Software Health10.1109/SoHeal.2019.00010(17-24)Online publication date: 28-May-2019
https://dl.acm.org/doi/10.1109/SoHeal.2019.00010
Mamun MBerger CHansson J(2019)Effects of measurements on correlations of software code metricsEmpirical Software Engineering10.1007/s10664-019-09714-924:4(2764-2818)Online publication date: 1-Aug-2019
https://dl.acm.org/doi/10.1007/s10664-019-09714-9
Chowdhury SMohian SMehra SGawsane SJohnson TCsallner CChaudron MCrnkovic IChechik MHarman M(2018)Automatically finding bugs in a commercial cyber-physical system development tool chain with SLforgeProceedings of the 40th International Conference on Software Engineering10.1145/3180155.3180231(981-992)Online publication date: 27-May-2018
https://dl.acm.org/doi/10.1145/3180155.3180231
Rathore SKumar S(2017)A decision tree logic based recommendation system to select software fault prediction techniquesComputing10.5555/3057337.305744199:3(255-285)Online publication date: 1-Mar-2017
https://dl.acm.org/doi/10.5555/3057337.3057441
Bansal A(2017)Empirical analysis of search based algorithms to identify change prone classes of open source softwareComputer Languages, Systems and Structures10.1016/j.cl.2016.10.00147:P2(211-231)Online publication date: 1-Jan-2017
https://dl.acm.org/doi/10.1016/j.cl.2016.10.001
Zhang FKeivanloo IZou Y(2017)Data Transformation in Cross-project Defect PredictionEmpirical Software Engineering10.1007/s10664-017-9516-222:6(3186-3218)Online publication date: 1-Dec-2017
https://dl.acm.org/doi/10.1007/s10664-017-9516-2
Show More Cited By

View Options

View options

Media

Figures

Other

Tables

View Issue’s Table of Contents