research-article

Event capture and compare for runtime monitoring of systems of systems

Authors:

Jürgen Thanhofer-Pilisch,

Michael Vierhauser,

Paul GrünbacherAuthors Info & Claims

VACE '16: Proceedings of the 1st International Workshop on Variability and Complexity in Software Design

Pages 1 - 4

https://doi.org/10.1145/2897045.2897046

Published: 14 May 2016 Publication History

Abstract

Today's complex software systems are highly variable systems of systems (SoS) that evolve continuously to meet new customer requirements or to address technological changes. Despite thorough testing of the different parts of an SoS, the full behavior often emerges during operation only. The systems and their interactions thus need to be continuously monitored and checked during operation to determine compliance with their requirements. In particular, after changes to one system, it is necessary to check whether the overall SoS still behaves correctly and as intended. Based on an existing monitoring framework we are developing support for capturing and comparing event traces in SoS. Our approach facilitates, and partly automates, identifying differences in event traces, which often indicate undesirable behavior introduced during evolution. In this position paper we motivate capture-and-compare support in SoS using an industrial example and present early research results including a prototype.

References

[1]

Maier, M. W. Architecting principles for systems-of-systems. Systems Engineering, 1, 4 (1998), 267--284.

[2]

Robinson, W. N. A requirements monitoring framework for enterprise systems. Requirements Engineering, 11, 1 (2006), 17--41.

Digital Library

[3]

Ghezzi, C., Mocci, A., and Sangiorgio, M. Runtime monitoring of component changes with Spy@Runtime. In Proc. of the 34th Int'l Conf. on Software Engineering, IEEE/ACM, 2012, 1403--1406.

Digital Library

[4]

van Hoorn, A., Waller, J., and Hasselbring, W. Kieker: A framework for application performance monitoring and dynamic software analysis. In Proc. of the 3rd Joint Int'l Conf. on Performance Engineering, ACM, 2012, 247--248.

Digital Library

[5]

Vierhauser, M., Rabiser, R., Grünbacher, P., Seyerlehner, K., Wallner, S., and Zeisel, H. ReMinds: A Flexible Runtime Monitoring Framework for Systems of Systems. Journal of Systems and Software, 112 (2016), 123--136.

Digital Library

[6]

Vierhauser, M., Rabiser, R., and Grünbacher, P. A Case Study on Testing, Commissioning, and Operation of Very-Large-Scale Software Systems. In Proc. of the 36th Int'l Conf. on Software Engineering, ICSE Companion, ACM, 2014, 125--134.

Digital Library

[7]

Maletic, J. I. and Collard, M. L. Supporting source code difference analysis. In Proc. of the 20th IEEE Int'l Conf. on Software Maintenance, IEEE, 2004, 210--219.

Digital Library

[8]

Maoz, S., Ringert, J. O., and Rumpe, B. A Manifesto for Semantic Model Differencing. In Proc. of the Workshops and Symposia at MODELS 2010, Springer, 2010, 194--203.

Digital Library

[9]

Miranskyy, A. V., Davison, M., Reesor, R. M., and Murtaza, S. S. Using entropy measures for comparison of software traces. Information Sciences, 203, 25 (2012), 59--72.

Digital Library

[10]

Haran, M., Karr, A., Orso, A., Porter, A., and Sanil A. Applying Classification Techniques to Remotely Collected Program Execution Data. In Proc. of the Joint 10th European Software Engineering Conf. and 13th ACM SIGSOFT Symp. on the Foundations of Software Engineering, ACM, 2005, 146--155.

Digital Library

[11]

Needleman, S. B. and Wunsch, C. D. A general method applicable to the search for similarities in the amino acid sequence of two proteins. Journal of Molecular Biology, 48 (1970), 443--453.

[12]

Orso A. and Kennedy, B. Selective capture and replay of program executions. In Proc. of the 3rd Int'l WS on Dynamic analysis, ACM, 2005, 1--7.

Digital Library

[13]

Prähofer, H., Schatz, R., Wirth, C., and Mössenböck, H. A Comprehensive Solution for Deterministic Replay Debugging of SoftPLC Applications. IEEE Transactions on Industrial Informatics, 7, 4 (2011), 641--651

[14]

Czarnecki, K., Grünbacher, P., Rabiser, R., Schmid, K., and Wasowski, A. Cool Features and Tough Decisions: A Comparison of Variability Modeling Approaches. In Proc. of the 6th Int'l WS on Variability Modelling of Software-Intensive Systems, ACM, 2012, 173--182.

Digital Library

[15]

Quinton, C., Rabiser, R., Vierhauser, M., Grünbacher, P., and Baresi, L. Evolution in Dynamic Software Product Lines: Challenges and Perspectives. In Proc. of the 19th Int'l Software Product Line Conf., ACM, 2015, 126--130.

Digital Library

[16]

Dwyer, M., Avrunin, G., and Corbett, J. Patterns in property specifications for finitestate verification. In Proc. of the Int'l Conf. on Software Engineering, IEEE, 1999, 411--420.

Digital Library

[17]

Lemieux, C., Park, D., and Beschastnikh, I. General LTL Specification Mining (T). In Proc. of the 30th IEEE/ACM Int'l Conf. on Automated Software Engineering, IEEE, 2015, 81--92.

[18]

Vierhauser, M., Rabiser, R., Grünbacher, P. and Egyed, A. Developing a DSL-Based Approach for Event-Based Monitoring of Systems of Systems: Experiences and Lessons Learned. In Proc. of the 30th IEEE/ACM Int'l Conf. on Automated Software Engineering, IEEE, 2015, 715--725.

Digital Library

[19]

Rabiser, R., Vierhauser, M., and Grünbacher, P. Variability Management for a Runtime Monitoring Infrastructure. In Proc. of the 9th Int'l WS on Variability Modelling of Software-intensive Systems, ACM, 2015, 35--42.

Digital Library

[20]

Vierhauser, M., Rabiser, R., Grünbacher, P., and Aumayr, B. A Requirements Monitoring Model for Systems of Systems. In Proc. of the 23rd IEEE Int'l Requirements Engineering Conf., IEEE, 2015, 96--105.

[21]

Zaidman, A. and Demeyer, S. Managing trace data volume through a heuristical clustering process based on event execution frequency. In Proc. of the 8th European Conf. on Software Maintenance and Reengineering, IEEE, 2004, 329--338.

Digital Library

Cited By

Stadler MVierhauser MCleland-Huang JAngerer ACiccozzi FMalavolta IWortmann A(2022)Towards flexible runtime monitoring support for ROS-based applicationsProceedings of the 4th International Workshop on Robotics Software Engineering10.1145/3526071.3527515(43-46)Online publication date: 9-May-2022
https://dl.acm.org/doi/10.1145/3526071.3527515
Thanhofer-Pilisch JRabiser RKrismayer TVierhauser MGrünbacher PWallner SSeyerlehner KZeisel H(2017)An Event-based Capture-and-Compare Approach to Support the Evolution of Systems of SystemsProceedings of the 11th ACM International Conference on Distributed and Event-based Systems10.1145/3093742.3093909(261-270)Online publication date: 8-Jun-2017
https://dl.acm.org/doi/10.1145/3093742.3093909

Index Terms

Event capture and compare for runtime monitoring of systems of systems
1. Software and its engineering
  1. Software creation and management
    1. Software post-development issues
      1. Maintaining software
      2. Software evolution
  2. Software notations and tools
    1. Software maintenance tools

Recommendations

An Event-based Capture-and-Compare Approach to Support the Evolution of Systems of Systems
DEBS '17: Proceedings of the 11th ACM International Conference on Distributed and Event-based Systems

Industrial software systems are often systems of systems (SoS) that evolve continuously to meet new customer requirements or to address technological changes. Despite thorough testing of the different contributing parts, the full behavior of SoS only ...
Towards a model-integrated runtime monitoring infrastructure for cyber-physical systems
ICSE-NIER '21: Proceedings of the 43rd International Conference on Software Engineering: New Ideas and Emerging Results

Runtime monitoring is essential for ensuring the safe operation and enabling self-adaptive behavior of Cyber-Physical Systems (CPS). It requires the creation of system monitors, instrumentation for data collection, and the definition of constraints. All ...
Evolved open-endedness, not open-ended evolution

Open-endedness is often considered a prerequisite property of the whole evolutionary system and its dynamical behaviors. In the actual history of evolution on Earth, however, there are many examples showing that open-endedness is rather a consequence of ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

VACE '16: Proceedings of the 1st International Workshop on Variability and Complexity in Software Design

May 2016

43 pages

ISBN:9781450341769

DOI:10.1145/2897045

Copyright © 2016 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

ACM: Association for Computing Machinery
SIGSOFT: ACM Special Interest Group on Software Engineering
IEEE-CS\DATC: IEEE Computer Society
TCSE: IEEE Computer Society's Tech. Council on Software Engin.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 14 May 2016

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Christian Doppler Forschungsgesellschaft

Conference

ICSE '16

Sponsor:

ACM
SIGSOFT
IEEE-CS\DATC
TCSE

ICSE '16: 38th International Conference on Software Engineering

May 14 - 22, 2016

Texas, Austin

Upcoming Conference

ICSE 2025

2025 IEEE/ACM 46th International Conference on Software Engineering

April 26 - May 3, 2025

Ottawa , ON , Canada

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
99
Total Downloads

Downloads (Last 12 months)2
Downloads (Last 6 weeks)0

Reflects downloads up to 14 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Stadler MVierhauser MCleland-Huang JAngerer ACiccozzi FMalavolta IWortmann A(2022)Towards flexible runtime monitoring support for ROS-based applicationsProceedings of the 4th International Workshop on Robotics Software Engineering10.1145/3526071.3527515(43-46)Online publication date: 9-May-2022
https://dl.acm.org/doi/10.1145/3526071.3527515
Thanhofer-Pilisch JRabiser RKrismayer TVierhauser MGrünbacher PWallner SSeyerlehner KZeisel H(2017)An Event-based Capture-and-Compare Approach to Support the Evolution of Systems of SystemsProceedings of the 11th ACM International Conference on Distributed and Event-based Systems10.1145/3093742.3093909(261-270)Online publication date: 8-Jun-2017
https://dl.acm.org/doi/10.1145/3093742.3093909

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents