Article

Performance prediction of component-based systems

Authors:

Steffen Becker,

Raffaela Mirandola,

Sven OverhageAuthors Info & Claims

Proceedings of the 2004 international conference on Architecting Systems with Trustworthy Components

Pages 169 - 192

https://doi.org/10.1007/11786160_10

Published: 12 December 2004 Publication History

Abstract

Performance predictions of component assemblies and the ability of obtaining system-level performance properties from these predictions are a crucial success factor when building trustworthy component-based systems. In order to achieve this goal, a collection of methods and tools to capture and analyze the performance of software systems has been developed. These methods and tools aim at helping software engineers by providing them with the capability to understand design trade-offs, optimize their design by identifying performance inhibitors, or predict a system's performance within a specified deployment environment. In this paper, we analyze the applicability of various performance prediction methods for the development of component-based systems and contrast their inherent strengths and weaknesses in different engineering problem scenarios. In so doing, we establish a basis to select an appropriate prediction method and to provide recommendations for future research activities, which could significantly improve the performance prediction of component-based systems.

References

[1]

Smith, C.U.: Performance Engineering of Software Systems. Addison-Wesley, Reading, MA, USA (1990)

Digital Library

[2]

Smith, C.U., Williams, L.G.: Performance Solutions: a practical guide to creating responsive, scalable software. Addison-Wesley (2002)

Digital Library

[3]

Szyperski, C., Gruntz, D., Murer, S.: Component Software: Beyond Object-Oriented Programming. 2 edn. ACM Press and Addison-Wesley, New York, NY (2002)

Digital Library

[4]

Sha, L., Rajkumar, R., Lehoczky, J.P.: Priority inheritance protocols: An approach to realtime synchronization. IEEE Trans. Comput. 39 (1990) 1175-1185

Digital Library

[5]

Musa, J.D., Iannino, A., Okumoto, K.: Software Reliability - Measurement, prediction, application. McGraw-Hill, New York (1987)

Digital Library

[6]

Dongarra, J., Martin, J., Vorlton, J.: Computer benchmarking: paths and pitfalls. IEEE Spectr. 24 (1987) 38-43

Digital Library

[7]

Balsamo, S., Marco, A.D., Inverardi, P., Simeoni, M.: Model-Based Performance Prediction in Software Development: A Survey. IEEE Transactions on Software Engineering 30 (2004) 295-310

Digital Library

[8]

Yacoub, S.M.: Performance Analysis of Component-Based Applications. In Chastek, G.J., ed.: Software Product Lines, Second International Conference, SPLC 2, San Diego, CA, USA, August 19-22, 2002, Proceedings. Volume 2379 of Lecture Notes in Computer Science., Berlin, Heidelberg, Springer (2002) 299-315

Digital Library

[9]

Chen, S., Gorton, I., Liu, A., Liu, Y.: Performance Prediction of COTS Component-Based Enterprise Applications. In: Proceedings of 5th ICSE workshop on Component-Based Software Engineering (CBSE 2002). (2002)

[10]

Denaro, G., Polini, A., Emmerich, W.: Early Performance Testing of Distributed Software Applications. In Dujmovic, J.J., Almeida, V.A.F., Lea, D., eds.: Proceedings of the Fourth International Workshop on Software and Performance, WOSP 2004, Redwood Shores, California, USA, January 14-16, 2004, New York, NY, ACM Press (2004) 94-103

Digital Library

[11]

Sitaraman, M., Kulczycki, G., Krone, J., Ogden, W.F., Reddy, A.L.N.: Performance Specification of Software Components. In: Proceedings of the Symposium on Software Reusability: Putting Software Reuse in Context, May 18-20, 2001, Toronto, Ontario, Canada, New York, NY, ACM Press (2001) 3-10

Digital Library

[12]

Hissam, S.A., Moreno, G.A., Stafford, J.A., Wallnau, K.C.: Packaging Predictable Assembly. In Bishop, J.M., ed.: Component Deployment, IFIP/ACM Working Conference, CD 2002, Berlin, Germany, June 20-21, 2002, Proceedings. Volume 2370 of Lecture Notes in Computer Science., Berlin, Heidelberg, Springer (2002) 108-124

Digital Library

[13]

Hissam, S., Hudak, J., Ivers, J., Klein, M., Larsson, M., Moreno, G., Northrop, L., Plakosh, D., Stafford, J., Wallnau, K., Wood, W.: Predictable Assembly of Substation Automation Systems: An Experiment Report. Technical Report CMU/SEI-2002-TR-031, Software Engineering Institute (2002)

[14]

Wallnau, K.C.: A Technology for Predictable Assembly from Certifiable Components. Technical Report CMU/SEI-2003-TR-009, Software Engineering Institute (2003)

[15]

Bertolino, A., Mirandola, R.: Towards Component-Based Ssoftware Performance Engineering. In: Proceedings of 6th ICSE workshop on Component-Based Software Engineering (CBSE 2003). (2003)

[16]

Bertolino, A., Mirandola, R.: CB-SPE Tool: Putting Component-Based Performance Engineering into Practice. In Crnkovic, I., Stafford, J.A., Schmidt, H.W., Wallnau, K.C., eds.: Component-Based Software Engineering, 7th International Symposium, CBSE 2004, Edinburgh, UK, May 24-25, 2004, Proceedings. Volume 3054 of Lecture Notes in Computer Science., Berlin, Heidelberg, Springer (2004) 233-248

[17]

OMG: UML Profile for Schedulability, Performance, and Time. OMG Specification ptc/2002-03-02, Object Management Group (2002)

[18]

Wu, X., McMullan, D., Woodside, M.: Component-Based Performance Prediction. In: Proceedings of 6th ICSE workshop on Component-Based Software Engineering (CBSE 2003). (2003)

[19]

Wu, X., Woodside, C.M.: Performance Modeling from Software Components. In Dujmovic, J.J., Almeida, V.A.F., Lea, D., eds.: Proceedings of the Fourth International Workshop on Software and Performance, WOSP 2004, Redwood Shores, California, USA, January 14-16, 2004, New York, NY, ACM Press (2004) 290-301

Digital Library

[20]

Balsamo, S., Marzolla, M.: A Simulation-Based Approach to Software Performance Modeling. In: ESEC/FSE-11: Proceedings of the 9th European software engineering conference held jointly with 11th ACM SIGSOFT international symposium on Foundations of software engineering, New York, NY, ACM Press (2003) 363-366

Digital Library

[21]

Eskenazi, E.M., Fioukov, A.V., Hammer, D.K., Obbink, H., Pronk, B.: Analysis and Prediction of Performance for Evolving Architectures. In IEEE, ed.: Proceedings of the 30th EUROMICRO Conference 2004, 31 August - 3 September 2004, Rennes, France, Los Alamitos, CA, IEEE Computer Society Press (2004) 22-31

Digital Library

[22]

Eskenazi, E.M., Fioukov, A.V., Hammer, D.K.: Performance Prediction for Component Compositions. In Crnkovic, I., Stafford, J.A., Schmidt, H.W., Wallnau, K.C., eds.: Component-Based Software Engineering, 7th International Symposium, CBSE 2004, Edinburgh, UK, May 24-25, 2004, Proceedings. Volume 3054 of Lecture Notes in Computer Science., Berlin, Heidelberg, Springer (2004) 280-293

[23]

Bondarev, E., de With, P.H., Chaudron, M.R.V.: Towards Predicting Real-Time Properties of a Component Assembly. In IEEE, ed.: Proceedings of the 30th EUROMICRO Conference 2004, 31 August - 3 September 2004, Rennes, France, Los Alamitos, CA, IEEE Computer Society Press (2004) 601-610

Digital Library

[24]

Reussner, R.H., Firus, V., Becker, S.: Parametric Performance Contracts for Software Components and their Compositionality. In Weck, W., Bosch, J., Szyperski, C., eds.: Proceedings of the 9th International Workshop on Component-Oriented Programming (WCOP 04). (2004)

[25]

Menasce, D.A., Ruan, H., Gomaa, H.: A Framework for QoS-Aware Software Components. In: Proceedings of the Fourth International Workshop on Software and Performance, WOSP 2004, Redwood Shores, California, USA, January 14-16, 2004, New York, NY, ACM Press (2004) 186-196

Digital Library

[26]

Diaconescu, A., Mos, A., Murphy, J.: Automatic Performance Management in Component Based Software Systems. In IEEE, ed.: Proceedings of the 1st International Conference on Autonomic Computing (ICAC 2004), 17-19 May 2004, New York, NY, USA, Los Alamitos, CA, IEEE Computer Society Press (2004) 214-221

Digital Library

[27]

Liu, Y., Fekete, A., Gorton, I.: Predicting the Performance of Middleware-Based Applications at the Design Level. In: Proceedings of the Fourth International Workshop on Software and Performance, WOSP 2004, Redwood Shores, California, USA, January 14-16, 2004, New York, NY, ACM Press (2004) 166-170

Digital Library

[28]

Wallnau, K.C., Stafford, J., Hissam, S., Klein, M.: On the Relationship of Software Architecture to Software Component Technology. In: Proceedings of the Sixth International Workshop on Component-Oriented Programming (WCOP'01), Budapest, Hungary, 19 June 2001. (2001)

[29]

Solberg, A., Husa, K.E., Aagedal, J., Abrahamsen, E.: QoS-Aware MDA. In: Proceedings of the Workshop Model-Driven Architecture in the Specification, Implementation and Validation of Object-Oriented Embedded Systems (SIVOES-MDA'03) in conjunction with UML'03. (2003)

[30]

Grassi, V., Mirandola, R.: A Model-Driven Approach to Predictive Non-Functional Analysis of Component-Based Systems. In: Proceedings of the Workshop Models for Nonfunctional Aspects of Component-Based Software at UML 2004, 12 October 2004,. (2004)

[31]

Petriu, D.B., Woodside, C.M.: A Metamodel for Generating Performance Models from UML Designs. In Baar, T., Strohmeier, A., Moreira, A.M.D., Mellor, S.J., eds.: UML 2004 - The Unified Modelling Language:Modelling Languages and Applications. 7th International Conference, Lisbon, Portugal, October 11-15, 2004. Proceedings. Volume 3273 of Lecture Notes in Computer Science., Berlin, Heidelberg, Springer (2004) 41-53

[32]

Woodside, M., Petriu, D.C., Petriu, D.B., Shen, H., Israr, T., J.Merseguer: Performance by Unified Model Analysis (PUMA). In: Proceedings of the Fifth International Workshop on Software and Performance, WOSP 2005, Palma, Illes Balears, Spain, July 11-15, 2005, New York, NY, ACM Press (2005) forthcoming

Digital Library

[33]

Gu, G., Petriu, D.C.: From UML to LQN by XML Algebra-Based Graph Transformations. In: Proceedings of the Fifth International Workshop on Software and Performance, WOSP 2005, Palma, Illes Balears, Spain, July 11-15, 2005, New York, NY, ACM Press (2005) forthcoming

Digital Library

[34]

Grassi, V., Mirandola, R., Sabetta, A.: From Design to Analysis Models: A Kernel Language for Performance and Reliability Analysis of Component-Based Systems. In: Proceedings of the Fifth International Workshop on Software and Performance, WOSP 2005, Palma, Illes Balears, Spain, July 11-15, 2005, New York, NY, ACM Press (2005) forthcoming

Digital Library

[35]

Zschaler, S.: Towards a Semantic Framework for Non-Functional Specifications of Component-Based Systems. In IEEE, ed.: Proceedings of the 30th EUROMICRO Conference 2004, 31 August - 3 September 2004, Rennes, France, Los Alamitos, CA, IEEE Computer Society Press (2004) 92-99

Digital Library

[36]

Grassi, V., Mirandola, R.: Towards Automatic Compositional Performance Analysis of Component-Based Systems. In: Proceedings of the Fourth International Workshop on Software and Performance, WOSP 2004, Redwood Shores, California, USA, January 14-16, 2004, New York, NY, ACM Press (2004) 59-63

Digital Library

[37]

Frølund, S., Koistinen, J.: Quality-of-Service Specification in Distributed Object Systems. Technical Report HPL-98-159, Hewlett Packard, Software Technology Laboratory (1998)

[38]

Larsson, M.: Predicting Quality Attributes in Component-Based Software Systems. PhD thesis, Mlardalen University (2004)

[39]

Meyer, B.: Applying "Design by Contract". IEEE Computer 25 (1992) 40-51

Digital Library

[40]

Liu, Y., Gorton, I., Liu, A., Jiang, N., Chen, S.: Designing a test suite for empirically-based middleware performance prediction. In Noble, J., Potter, J., eds.: Fortieth International Conference on Technology of Object-Oriented Languages and Systems (TOOLS Pacific 2002). Conferences in Research and Practice in Information Technology, Sydney, Australia, ACS (2002)

Digital Library

[41]

Firus, V., Becker, S., Happe, J.: Parametric performance contracts for qml-specified software components. In: Formal Foundations of Embedded Software and Component-based Software Architectures (FESCA). Electronic Notes in Theoretical Computer Science, ETAPS 2005 (2005)

Digital Library

[42]

Crnkovic, I., Firus, V., Grunske, L., Jezequel, J.M., Overhage, S., Reussner, R.: Unified Models for Predicting the Quality of Component-Based Software Architectures. In Reussner, R., Stafford, J., Szyperski, C., eds.: Architecting System with Trustworthy Components. Lecture Notes in Computer Science, Berlin, Heidelberg, Springer (2005) forthcoming

Cited By

Dürschmid TTimperley CGarlan DLe Goues CRoychoudhury APaiva AAbreu RStorey M(2024)ROSInfer: Statically Inferring Behavioral Component Models for ROS-based Robotics SystemsProceedings of the IEEE/ACM 46th International Conference on Software Engineering10.1145/3597503.3639206(1-13)Online publication date: 20-May-2024
https://dl.acm.org/doi/10.1145/3597503.3639206
Müller HKharitonov ANahhas ABosse STurowski K(2022)Addressing IT Capacity Management Concerns Using Machine Learning TechniquesSN Computer Science10.1007/s42979-021-00862-83:1Online publication date: 1-Jan-2022
https://dl.acm.org/doi/10.1007/s42979-021-00862-8
He SLiu TLama PLee JKim IWang WGrundy J(2021)Performance testing for cloud computing with dependent data bootstrappingProceedings of the 36th IEEE/ACM International Conference on Automated Software Engineering10.1109/ASE51524.2021.9678687(666-678)Online publication date: 15-Nov-2021
https://dl.acm.org/doi/10.1109/ASE51524.2021.9678687
Show More Cited By

Recommendations

Simulation-Trace-Based Component Performance Prediction
SS '00: Proceedings of the 33rd Annual Simulation Symposium

Large software systems are composed of interdependent distributed components, some developed in-house, some commercially available, and others developed by the customer. The system architecture, that is, the components comprising the system and their ...
Performance Analysis of Component-Based Applications
SPLC 2: Proceedings of the Second International Conference on Software Product Lines

Performance analysis is a software engineering activity that involves analyzing a software application with respect to performance quality attributes such as response and execution times. Performance analysis tools provide the necessary support for the ...
State dependence in performance evaluation of component-based software systems
WOSP/SIPEW '10: Proceedings of the first joint WOSP/SIPEW international conference on Performance engineering

Integrating rising variability of software systems in performance prediction models is crucial to allow widespread industrial use of performance prediction. One of such variabilities is the dependency of system performance on the context and history-...

Comments

Information & Contributors

Information

Published In

cover image Guide Proceedings

Proceedings of the 2004 international conference on Architecting Systems with Trustworthy Components

December 2004

298 pages

ISBN:3540358005

Editors:
Ralf H. Reussner
Chair for Software Design and Quality, University of Karlsruhe (TH), Am Fasanengarten 5, Karlsruhe, Germany
,
Judith A. Stafford
Computer Science, Boston, Tufts University, 161 College Avenue, Medford, Germany
,
Clemens A. Szyperski
Computer Science, Boston, Microsoft, 161 College Avenue, Medford, Germany

Publisher

Springer-Verlag

Berlin, Heidelberg

Publication History

Published: 12 December 2004

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

26
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 05 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Dürschmid TTimperley CGarlan DLe Goues CRoychoudhury APaiva AAbreu RStorey M(2024)ROSInfer: Statically Inferring Behavioral Component Models for ROS-based Robotics SystemsProceedings of the IEEE/ACM 46th International Conference on Software Engineering10.1145/3597503.3639206(1-13)Online publication date: 20-May-2024
https://dl.acm.org/doi/10.1145/3597503.3639206
Müller HKharitonov ANahhas ABosse STurowski K(2022)Addressing IT Capacity Management Concerns Using Machine Learning TechniquesSN Computer Science10.1007/s42979-021-00862-83:1Online publication date: 1-Jan-2022
https://dl.acm.org/doi/10.1007/s42979-021-00862-8
He SLiu TLama PLee JKim IWang WGrundy J(2021)Performance testing for cloud computing with dependent data bootstrappingProceedings of the 36th IEEE/ACM International Conference on Automated Software Engineering10.1109/ASE51524.2021.9678687(666-678)Online publication date: 15-Nov-2021
https://dl.acm.org/doi/10.1109/ASE51524.2021.9678687
Jamshidi PCámara JSchmerl BKästner CGarlan DLitoiu MClarke STei K(2019)Machine learning meets quantitative planningProceedings of the 14th International Symposium on Software Engineering for Adaptive and Self-Managing Systems10.1109/SEAMS.2019.00015(39-50)Online publication date: 25-May-2019
https://dl.acm.org/doi/10.1109/SEAMS.2019.00015
Meedeniya IMoser IAleti AGrunske L(2018)Evaluating probabilistic models with uncertain model parametersSoftware and Systems Modeling (SoSyM)10.1007/s10270-012-0277-513:4(1395-1415)Online publication date: 21-Dec-2018
https://dl.acm.org/doi/10.1007/s10270-012-0277-5
Jamshidi PVelez MKästner CSiegmund NKawthekar PGarlan DNuseibeh B(2017)Transfer learning for improving model predictions in highly configurable softwareProceedings of the 12th International Symposium on Software Engineering for Adaptive and Self-Managing Systems10.1109/SEAMS.2017.11(31-41)Online publication date: 20-May-2017
https://dl.acm.org/doi/10.1109/SEAMS.2017.11
Spichkova MSchmidt HGray JChechik MKulkarni VPaige R(2015)Reconciling a component and process viewProceedings of the Seventh International Workshop on Modeling in Software Engineering10.5555/2820489.2820491(1-6)Online publication date: 16-May-2015
https://dl.acm.org/doi/10.5555/2820489.2820491
Happe LBuhnova BReussner R(2014)Stateful component-based performance modelsSoftware and Systems Modeling (SoSyM)10.1007/s10270-013-0336-613:4(1319-1343)Online publication date: 1-Oct-2014
https://dl.acm.org/doi/10.1007/s10270-013-0336-6
Moreno-Delgado ADurán FZschaler STroya J(2014)Modular DSLs for Flexible AnalysisProceedings of the 10th European Conference on Modelling Foundations and Applications - Volume 856910.1007/978-3-319-09195-2_9(132-147)Online publication date: 21-Jul-2014
https://dl.acm.org/doi/10.1007/978-3-319-09195-2_9
Zhang LSun YSong HWang WHuang GMei HLv JWang QLiu L(2012)Detecting anti-patterns in Java EE runtime system modelProceedings of the Fourth Asia-Pacific Symposium on Internetware10.1145/2430475.2430496(1-8)Online publication date: 30-Oct-2012
https://dl.acm.org/doi/10.1145/2430475.2430496
Show More Cited By

View Options

View options

Media

Figures

Other

Tables

View Table of Contents