Article

A model-based approach for real-time embedded multimodal systems in military aircrafts

Authors:

Philippe Palanque,

Pierre DragicevicAuthors Info & Claims

ICMI '04: Proceedings of the 6th international conference on Multimodal interfaces

Pages 243 - 250

https://doi.org/10.1145/1027933.1027974

Published: 13 October 2004 Publication History

Abstract

This paper presents the use of a model-based approach for the formal description of real-time embedded multimodal systems. This modeling technique has been used in the field of military fighter aircrafts. The paper presents the formal description techniques, its application on the case study of a multimodal command and control interface for the Rafale aircraft as well as its relationship with architectural model for interactive systems.

References

[1]

Bares, M. and Pastor, D. Principes d'un moteur d'interaction multimodale pour systèmes embarqués. L'Interface des Mondes Réels et Virtuels, Cinquièmes Journées Internationales INFORMATIQUE: 471--483, 1996.

[2]

Bass, L., Pellegrino, R., Reed, S., Seacord, R., Sheppard, R., and Szezur, M. R. The Arch model: Seeheim revisited. In proceeding of the User Interface Developpers' workshop. version 1.0, 1991.

[3]

Bastide R., Navarre D., and Palanque P. A Model-Based Tool for Interactive Prototyping of Highly Interactive Applications. Proceedings of the ACM SIGCHI 2002 (Extended Abstracts): 516--517, 2002.

Digital Library

[4]

Bastide R., Palanque P., Le Duc H., and Munoz J. Integrating Rendering Specifications into a Formalism for the Design of Interactive Systems Proceedings of the 5th Eurographics workshop on Design, Specification and Verification of Interactive systems DSV-IS'98. Springer Verlag, 1998.

[5]

Bolt, R. Put That There : Voice and Gesture at the Graphics Interface. SIGGRAPH'80 Proceeding. Vol 14, Number 3: ACM Press: p262--270, 1980.

Digital Library

[6]

Bourguet, M. L. Outil de Prototypage pour la Conception et l'Evaluation d'Interfaces Utilisateur Multimodales. 14eme Conférence sur l'Interaction Homme-MachineACM Press, 2002.

Digital Library

[7]

Cohen, Philip R., Johnston, Michael, McGee, David, Oviatt, Sharon, Pittman, Jay, Smith, Ira, Chen, Liang, and Clow, Josh. QuickSet: multimodal interaction for distributed applications . Proceedings of the fifth ACM international conference on Multimedia ACM Press: p 31--40, 1997.

Digital Library

[8]

Coutaz J., Paterno F., Faconti G., and Nigay L. A Comparison of Approaches for Specifying MultiModal Interactive Systems. Proceedings of the ERCIM Workshop on Multimodal Human-Computer Interaction.: 165-174, 1993.

[9]

Coutaz, Joelle, Nigay, Laurence, Salber, Daniel, Blandford, A., May, J., and Young, R. Four Easy Pieces for Assessing the Usability of Multimodal in Interaction : the CARE Properties. Human Computer Interaction, Interact' 95Nordby, K. // Helmenrsen, P.//Gilmore, D. //Arnesen, S. Chapman & Hall (IFIP): pp. 115--120, 1995.

[10]

Duke, D. and Harrison, M. D. MATIS: A Case Study in Formal Specification Technical Report SM/WP17, ESPRIT BRA 7040, Amodeus-2 York: University of York, 1994.

[11]

Genrich, H. J. Predicate/Transition Nets High-Level Petri Nets: Theory and Application Berlin: K. Jensen and G. Rozenberg (Eds.), Springer Verlag: 3--43., 1997.

[12]

Hinckley, K., Czerwinski, M., and Sinclair, M. Interaction and Modeling Techniques for Desktop Two-Handed Input . http://research.microsoft.com/users/kenh/papers/two-hand.pdf, 1998.

[13]

Jacobson, I, Booch, G., and Rumbaugh, J. The Unified Software Development ProcessAddison-Wesley, 1999.

Digital Library

[14]

Lacaze, X, Palanque, P., Navarre, D., and Bastide, R. Performance Evaluation as a Tool for Quantitative Assessment of Complexity of Interactive Systems. DSV-IS'02 9th workshop on Design Specification and Verification of Interactive Systems, 2002.

Digital Library

[15]

Latoschik, M. E. Designing Transition Networks for Multimodal VR-Interactions Using a Markup Language. Proceedings of the IEEE fourth International Conference on Multimodal Interfaces, ICMI 2002ACM Press: 411--416, 2002.

Digital Library

[16]

MacColl, I. and Carrington, D. Testing MATIS : a case study on specification-based testing of interactive systems. FAHCI 98 P57-69: ISBN 0-86339-7948, 1998.

[17]

Navarre, D., Palanque, P., Bastide, R., and Sy, O. Structuring Interactive Systems Specifications for Executability and Prototypability 7th Eurographics Workshop on Design, Specification and Verification of Interacive Systems DSV-IS'2000 Limerick, Ireland: Lecture Notes in Computer Science; 1946, 2000.

Digital Library

[18]

Oviatt, Sharon. Ten myths of Multimodal Interaction Communication of the ACM; 42: 11: 74--81, 1999.

Digital Library

[19]

Palanque, P. and Schyn, A. A Model-Based Approach for Engineering Multimodal Interactive . Proceeding of the Ninth IFIP TC13 International Conference on Human-Computer Interaction (INTERACT'2003), IFIP, 2003.

[20]

Smith, Shamus and Duke, David. Using CSP to specify interaction in virtual environmentsUniversity of York, 1999.

[21]

Van Schooten, B., Donk, O., and Zwiers, J. Modelling Interaction in Virtual Environments using Process Algebra. Proceedings TWLT 15: Interactions in Virtual Worlds, 1999.

[22]

Wieting, Ralf. Hybrid High-Level Nets . Proceedings of the 1996 Winter Simulation ConferenceJ. M. Charnes, D. T. Morrice and D. T. Brunner ed.ACM Press: 848--855, 1996.

Digital Library

[23]

Willans, James S. and Harrison, Michael D. Prototyping pre-implementation designs of virtual environment behaviour. 8th IFIP Working conference on engineering for human-computer interaction (EHCI'01) Lecture notes in computer science, 2001.

Digital Library

Cited By

Korsun OPirozhkov AGlukhova ESkryabikov N(2023)System Methodologies for the Design of Human–Machine Interfaces for Advanced AircraftRecent Developments in High-Speed Transport10.1007/978-981-19-9010-6_3(23-31)Online publication date: 11-Apr-2023
https://doi.org/10.1007/978-981-19-9010-6_3
Palanque PNavarre D(2021)Dependability and Safety: Two Clouds in the Blue Sky of Multimodal InteractionProceedings of the 2021 International Conference on Multimodal Interaction10.1145/3462244.3479881(781-787)Online publication date: 18-Oct-2021
https://dl.acm.org/doi/10.1145/3462244.3479881
Canny AMartinie CNavarre DPalanque PBarboni EGris C(2021)Engineering Model-Based Software Testing of WIMP Interactive ApplicationsProceedings of the ACM on Human-Computer Interaction10.1145/34617295:EICS(1-30)Online publication date: 29-May-2021
https://dl.acm.org/doi/10.1145/3461729
Show More Cited By

Index Terms

A model-based approach for real-time embedded multimodal systems in military aircrafts
1. Human-centered computing
  1. Interaction design
    1. Interaction design process and methods
      1. Interface design prototyping
2. Software and its engineering

Recommendations

Formal description techniques to support the design, construction and evaluation of fusion engines for sure (safe, usable, reliable and evolvable) multimodal interfaces
ICMI-MLMI '09: Proceedings of the 2009 international conference on Multimodal interfaces

Representing the behaviour of multimodal interactive systems in a complete, concise and non-ambiguous way is still a challenge for formal description techniques (FDT). Depending on the FDT, multimodal interactive systems feature specific characteristics ...
Time-Constrained Failure Diagnosis in Distributed Embedded Systems: Application to Actuator Diagnosis

Advanced automotive control applications such as steer-by-wire are typically implemented as distributed systems comprising many embedded processors, sensors, and actuators interacting via a communication bus. They have severe cost constraints, but ...
The Performance and Energy Consumption of Embedded Real-Time Operating Systems

This paper presents the modeling of embedded systems with SimBed, an execution-driven simulation testbed that measures the execution behavior and power consumption of embedded applications and RTOSs by executing them on an accurate architectural model ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

ICMI '04: Proceedings of the 6th international conference on Multimodal interfaces

October 2004

368 pages

ISBN:1581139950

DOI:10.1145/1027933

General Chairs:
Rajeev Sharma
Advanced Interfaces
,
Trevor Darrell
Massachusetts Institute of Technology
,
Program Chairs:
Mary Harper
Purdue University, West Lafayette, IN
,
Gianni Lazzari
ITC-IRST
,
Matthew Turk
University of California, Santa Barbara, CA

Copyright © 2004 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 13 October 2004

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

ICMI04

Sponsor:

ICMI04: Sixth International Conference on Multimodal Interfaces 2004

October 13 - 15, 2004

PA, State College, USA

Acceptance Rates

Overall Acceptance Rate 453 of 1,080 submissions, 42%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

44
Total Citations
View Citations
579
Total Downloads

Downloads (Last 12 months)2
Downloads (Last 6 weeks)1

Reflects downloads up to 06 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Korsun OPirozhkov AGlukhova ESkryabikov N(2023)System Methodologies for the Design of Human–Machine Interfaces for Advanced AircraftRecent Developments in High-Speed Transport10.1007/978-981-19-9010-6_3(23-31)Online publication date: 11-Apr-2023
https://doi.org/10.1007/978-981-19-9010-6_3
Palanque PNavarre D(2021)Dependability and Safety: Two Clouds in the Blue Sky of Multimodal InteractionProceedings of the 2021 International Conference on Multimodal Interaction10.1145/3462244.3479881(781-787)Online publication date: 18-Oct-2021
https://dl.acm.org/doi/10.1145/3462244.3479881
Canny AMartinie CNavarre DPalanque PBarboni EGris C(2021)Engineering Model-Based Software Testing of WIMP Interactive ApplicationsProceedings of the ACM on Human-Computer Interaction10.1145/34617295:EICS(1-30)Online publication date: 29-May-2021
https://dl.acm.org/doi/10.1145/3461729
Navarre DPalanque PCoppers SLuyten KVanacken D(2021)Model-based Engineering of Feedforward Usability Function for GUI WidgetsInteracting with Computers10.1093/iwcomp/iwab01433:1(73-91)Online publication date: 18-May-2021
https://doi.org/10.1093/iwcomp/iwab014
Mentler TPalanque PBoll SJohnson CVan Laerhoven K(2021)Control Rooms in Safety Critical Contexts: Design, Engineering and Evaluation IssuesHuman-Computer-Interaction – INTERACT 202110.1007/978-3-030-85607-6_72(530-535)Online publication date: 27-Aug-2021
https://doi.org/10.1007/978-3-030-85607-6_72
Canny APalanque PNavarre D(2020)Model-Based Testing of GUI Applications Featuring Dynamic Instanciation of Widgets2020 IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW)10.1109/ICSTW50294.2020.00029(95-104)Online publication date: Oct-2020
https://doi.org/10.1109/ICSTW50294.2020.00029
Navarre DPalanque PCoppers SLuyten KVanacken D(2020)Fortune Nets for Fortunettes: Formal, Petri Nets-Based, Engineering of Feedforward for GUI WidgetsFormal Methods. FM 2019 International Workshops10.1007/978-3-030-54994-7_36(503-519)Online publication date: 13-Aug-2020
https://doi.org/10.1007/978-3-030-54994-7_36
Canny ANavarre DCampos JPalanque P(2020)Model-Based Testing of Post-WIMP Interactions Using Object Oriented Petri-NetsFormal Methods. FM 2019 International Workshops10.1007/978-3-030-54994-7_35(486-502)Online publication date: 13-Aug-2020
https://doi.org/10.1007/978-3-030-54994-7_35
Giakoumis AVolos CStouboulos IPolatoglou HKyprianidis I(2018)Chaos generator device based on a 32 bit microcontroller embedded system2018 7th International Conference on Modern Circuits and Systems Technologies (MOCAST)10.1109/MOCAST.2018.8376598(1-4)Online publication date: May-2018
https://doi.org/10.1109/MOCAST.2018.8376598
Cronel MDumas BPalanque PCanny A(2018)MIODMIT: A Generic Architecture for Dynamic Multimodal Interactive SystemsHuman-Centered Software Engineering10.1007/978-3-030-05909-5_7(109-129)Online publication date: 31-Dec-2018
https://doi.org/10.1007/978-3-030-05909-5_7
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents