skip to main content
10.1109/SEAMS.2019.00013acmconferencesArticle/Chapter ViewAbstractPublication PagesicseConference Proceedingsconference-collections
research-article

Using unstructured data to improve the continuous planning of critical processes involving humans

Published: 25 May 2019 Publication History

Abstract

The success of processes executed in uncertain and changing environments is reliant on the dependable use of relevant information to support continuous planning at runtime. At the core of this planning is a model which, if incorrect, can lead to failures and, in critical processes such as evacuation and disaster relief operations, to harm to humans. Obtaining reliable and timely estimations of model parameters is often difficult, and considerable research effort has been expended to derive methods for updating models at run-time. Typically, these methods use data sources such as system logs, run-time events and sensor readings, which are well structured. However, in many critical processes, the most relevant data are produced by human participants to, and observers of, the process and its environment (e.g., through social media) and is unstructured. For such scenarios we propose COPE, a work-in-progress method for the continuous planning of critical processes involving humans and carried out in uncertain, changing environments. COPE uses a combination of runtime natural-language processing (to update a stochastic model of the target process based on unstructured data) and stochastic model synthesis (to generate Pareto-optimal plans for the process). Preliminary experiments indicate that COPE can support continuous planning effectively for a simulated evacuation operation after a natural disaster.

References

[1]
C. Ayora, V. Torres, M. Reichert, B. Weber, and V. Pelechano, "Towards run-time flexibility for process families: open issues and research challenges," in International Conference on Business Process Management. Springer, 2012, pp. 477--488.
[2]
R. Calinescu, "Emerging techniques for the engineering of self-adaptive high-integrity software." Assurances for Self-Adaptive Systems, vol. 7740, pp. 297--310, 2013.
[3]
S. Gerasimou, G. Tamburrelli, and R. Calinescu, "Search-based synthesis of probabilistic models for quality-of-service software engineering (t)," in 30th IEEE/ACM International Conference on Automated Software Engineering (ASE). IEEE, 2015, pp. 319--330.
[4]
S. Luna and M. J. Pennock, "Social media applications and emergency management: a literature review and research agenda," International Journal of Disaster Risk Reduction, vol. 28, pp. 565--577, 2018.
[5]
R. de Lemos, D. Garlan, C. Ghezzi, H. Giese, J. Andersson, M. Litoiu, B. Schmerl, D. Weyns, L. Baresi, N. Bencomo, Y. Brun, J. Camara, R. Calinescu, M. B. Cohen, A. Gorla, V. Grassi, L. Grunske, P. Inverardi, J.-M. Jezequel, S. Malek, R. Mirandola, M. Mori, H. A. Müller, R. Rouvoy, C. M. F. Rubira, E. Rutten, M. Shaw, G. Tamburrelli, G. Tamura, N. M. Villegas, T. Vogel, and F. Zambonelli, "Software engineering for self-adaptive systems: Research challenges in the provision of assurances," in Software Engineering for Self-Adaptive Systems III. Assurances, R. de Lemos, D. Garlan, C. Ghezzi, and H. Giese, Eds. Springer, 2017, pp. 3--30.
[6]
H. Hansson and B. Jonsson, "A logic for reasoning about time and reliability," Formal Aspects of Computing, vol. 6, no. 5, pp. 512--535, 1994.
[7]
S. Andova, H. Hermanns, and J.-P. Katoen, "Discrete-time rewards model-checked," in International Conference on Formal Modeling and Analysis of Timed Systems. Springer, 2003, pp. 88--104.
[8]
R. Calinescu, M. Autili, J. Cámara, A. Di Marco, S. Gerasimou, P. Inverardi, A. Perucci, N. Jansen, J.-P. Katoen, M. Kwiatkowska et al., "Synthesis and verification of self-aware computing systems," in Self-Aware Computing Systems. Springer, 2017, pp. 337--373.
[9]
G. Mason, R. Calinescu, D. Kudenko, and A. Banks, "Assurance in reinforcement learning using quantitative verification," in Advances in Hybridization of Intelligent Methods. Springer, 2018, pp. 71--96.
[10]
R. Calinescu and M. Kwiatkowska, "CADS<sup>*</sup>: Computer-aided development of self-<sup>*</sup> systems," in International Conference on Fundamental Approaches to Software Engineering. Springer, 2009, pp. 421--424.
[11]
A. Komninos and S. Manandhar, "Dependency based embeddings for sentence classification tasks." in HLT-NAACL, 2016, pp. 1490--1500.
[12]
A. Komninos, "Structured generative models of continuous features for word sense induction." in COLING, 2016, pp. 3577--3587.
[13]
A. Komninos, "Feature-rich networks for knowledge base completion," in ACL, 2017.
[14]
R. Calinescu, Y. Rafiq, K. Johnson, and M. E. Bakir, "Adaptive model learning for continual verification of non-functional properties," in 5th ACM/SPEC International Conference on Performance Engineering. ACM, 2014, pp. 87--98.
[15]
A. Filieri, L. Grunske, and A. Leva, "Lightweight adaptive filtering for efficient learning and updating of probabilistic models," in 37th International Conference on Software Engineering. IEEE Press, 2015, pp. 200--211.
[16]
C. Paterson and R. Calinescu, "Accurate analysis of quality properties of software with observation-based Markov chain refinement," in 2017 IEEE International Conference on Software Architecture (ICSA). IEEE, 2017, pp. 121--130.
[17]
C. A. Paterson and R. Calinescu, "Observation-enhanced QoS analysis of component-based systems," IEEE Transactions on Software Engineering, vol. PP, p. 1, 2018. {Online}. Available
[18]
F. Chollet, "keras," https://github.com/fchollet/keras, 2015.
[19]
M. Abadi et al., "TensorFlow: Large-scale machine learning on heterogeneous systems," 2015, software available from tensorflow.org. {Online}. Available: http://tensorflow.org/
[20]
E. Loper and S. Bird, "NLTK: The natural language toolkit," in ACL-02 Workshop on Effective Tools and Methodologies for Teaching Natural Language Processing and Computational Linguistics - Volume 1, 2002, pp. 63--70.
[21]
I. de Jong, "Pyro4," https://github.com/irmen/Pyro4, 2018.
[22]
J. Pennington, R. Socher, and C. Manning, "Glove: Global vectors for word representation," in Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP), 2014, pp. 1532--1543.
[23]
J. R. Finkel, T. Grenager, and C. Manning, "Incorporating non-local information into information extraction systems by Gibbs sampling," in 43rd Annual Meeting of the Association for Computational Linguistics, 2005, pp. 363--370.
[24]
M. Kwiatkowska, G. Norman, and D. Parker, "PRISM 4.0: Verification of probabilistic real-time systems," in 23rd International Conference on Computer Aided Verification. Springer, 2011, pp. 585--591.
[25]
S. Gerasimou, R. Calinescu, and G. Tamburrelli, "Synthesis of probabilistic models for quality-of-service software engineering," Automated Software Engineering, vol. 25, no. 4, pp. 785--831, 2018.
[26]
R. Calinescu, M. Češka, S. Gerasimou, M. Kwiatkowska, and N. Paoletti, "Efficient synthesis of robust models for stochastic systems," Journal of Systems and Software, vol. 143, pp. 140--158, 2018.
[27]
K. Deb, A. Pratap, S. Agarwal, and T. Meyarivan, "A fast and elitist multiobjective genetic algorithm: NSGA-II," IEEE Transactions on Evolutionary Computation, vol. 6, no. 2, pp. 182--197, 2002.
[28]
J. Cámara, G. A. Moreno, and D. Garlan, "Reasoning about human participation in self-adaptive systems," in Proceedings of the 10th International Symposium on Software Engineering for Adaptive and Self-Managing Systems. IEEE Press, 2015, pp. 146--156.
[29]
T. W. Anderson and L. A. Goodman, "Statistical inference about markov chains," The Annals of Mathematical Statistics, pp. 89--110, 1957.
[30]
R. Calinescu, K. Johnson, and Y. Rafiq, "Using observation ageing to improve Markovian model learning in QoS engineering," in 2nd ACM/SPEC International Conference on Performance engineering. ACM, 2011, pp. 505--510.
[31]
I. Epifani, C. Ghezzi, R. Mirandola, and G. Tamburrelli, "Model evolution by run-time parameter adaptation," in 31st International Conference on Software Engineering. IEEE Computer Society, 2009, pp. 111--121.
[32]
I. Epifani, C. Ghezzi, and G. Tamburrelli, "Change-point detection for black-box services," in 18th ACM SIGSOFT International Symposium on Foundations of Software Engineering. ACM, 2010, pp. 227--236.
[33]
T. Zheng, C. M. Woodside, and M. Litoiu, "Performance model estimation and tracking using optimal filters," IEEE Transactions on Software Engineering, vol. 34, no. 3, pp. 391--406, 2008.
[34]
S. Vieweg, C. Castillo, and M. Imran, "Integrating social media communications into the rapid assessment of sudden onset disasters," in International Conference on Social Informatics. Springer, 2014, pp. 444--461.
[35]
M. Imran, C. Castillo, F. Diaz, and S. Vieweg, "Processing social media messages in mass emergency: A survey," ACM Computing Surveys (CSUR), vol. 47, no. 4, p. 67, 2015.
[36]
F. Atefeh and W. Khreich, "A survey of techniques for event detection in twitter," Computational Intelligence, vol. 31, no. 1, pp. 132--164, 2015.
[37]
M. Hasan, M. A. Orgun, and R. Schwitter, "A survey on real-time event detection from the twitter data stream," Journal of Information Science, p. 0165551517698564, 2017.
[38]
P. Yadav, M. Steinbach, V. Kumar, and G. Simon, "Mining electronic health records (EHRs): a survey," ACM Computing Surveys (CSUR), vol. 50, no. 6, p. 85, 2018.
[39]
F. Hogenboom, F. Frasincar, U. Kaymak, F. De Jong, and E. Caron, "A survey of event extraction methods from text for decision support systems," Decision Support Systems, vol. 85, pp. 12--22, 2016.
[40]
R. Calinescu, D. Weyns, S. Gerasimou, M. U. Iftikhar, I. Habli, and T. Kelly, "Engineering trustworthy self-adaptive software with dynamic assurance cases," IEEE Transactions on Software Engineering, vol. 44, no. 11, pp. 1039--1069, 2018.

Cited By

View all
  • (2023)Human–machine Teaming with Small Unmanned Aerial Systems in a MAPE-K EnvironmentACM Transactions on Autonomous and Adaptive Systems10.1145/361800119:1(1-35)Online publication date: 4-Sep-2023
  • (2022)Extending MAPE-K to support human-machine teamingProceedings of the 17th Symposium on Software Engineering for Adaptive and Self-Managing Systems10.1145/3524844.3528054(120-131)Online publication date: 18-May-2022
  • (2019)Socio-cyber-physical systemsProceedings of the 5th International Workshop on Software Engineering for Smart Cyber-Physical Systems10.1109/SEsCPS.2019.00008(2-6)Online publication date: 28-May-2019

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
SEAMS '19: Proceedings of the 14th International Symposium on Software Engineering for Adaptive and Self-Managing Systems
May 2019
223 pages
  • General Chair:
  • Marin Litoiu,
  • Program Chairs:
  • Siobhán Clarke,
  • Kenji Tei

Sponsors

Publisher

IEEE Press

Publication History

Published: 25 May 2019

Check for updates

Author Tags

  1. natural-language processing
  2. probabilistic model checking
  3. stochastic model synthesis

Qualifiers

  • Research-article

Conference

ICSE '19
Sponsor:

Acceptance Rates

Overall Acceptance Rate 17 of 31 submissions, 55%

Upcoming Conference

ICSE 2025

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)5
  • Downloads (Last 6 weeks)0
Reflects downloads up to 24 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2023)Human–machine Teaming with Small Unmanned Aerial Systems in a MAPE-K EnvironmentACM Transactions on Autonomous and Adaptive Systems10.1145/361800119:1(1-35)Online publication date: 4-Sep-2023
  • (2022)Extending MAPE-K to support human-machine teamingProceedings of the 17th Symposium on Software Engineering for Adaptive and Self-Managing Systems10.1145/3524844.3528054(120-131)Online publication date: 18-May-2022
  • (2019)Socio-cyber-physical systemsProceedings of the 5th International Workshop on Software Engineering for Smart Cyber-Physical Systems10.1109/SEsCPS.2019.00008(2-6)Online publication date: 28-May-2019

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media