Article

ICARE software components for rapidly developing multimodal interfaces

Authors:

Jullien Bouchet,

Laurence Nigay,

Thierry GanilleAuthors Info & Claims

ICMI '04: Proceedings of the 6th international conference on Multimodal interfaces

Pages 251 - 258

https://doi.org/10.1145/1027933.1027975

Published: 13 October 2004 Publication History

Abstract

Although several real multimodal systems have been built, their development still remains a difficult task. In this paper we address this problem of development of multimodal interfaces by describing a component-based approach, called ICARE, for rapidly developing multimodal interfaces. ICARE stands for Interaction-CARE (Complementarity Assignment Redundancy Equivalence). Our component-based approach relies on two types of software components. Firstly ICARE elementary components include Device components and Interaction Language components that enable us to develop pure modalities. The second type of components, called Composition components, define combined usages of modalities. Reusing and assembling ICARE components enable rapid development of multimodal interfaces. We have developed several multimodal systems using ICARE and we illustrate the discussion using one of them: the FACET simulator of the Rafale French military plane cockpit.

References

[1]

Bass, L. et al. market Assessment of Component-Based Software Engineering. SEI Technical Report (2000).

[2]

Bass, L. et al. A Metamodel for Runtime Architecture of an Interactive System. The UIMS Workshop Tool Developers, SIGCHI Bulletin, 24 (1) (1992), 32--37.

Digital Library

[3]

Bernsen, N. Modality Theory in support of multimodal interface design. Proceedings of Intelligent Multi-Media Multi-Modal Systems (1994), 37--44.

[4]

Bolt, R. A. "Put-that-there": Voice and gesture at the graphics interface. Proceedings of SIGGRAPH'80, 14, 3 (1980), 262--270.

Digital Library

[5]

Bouchet, J., Nigay, L. ICARE: A Component-Based Approach for the Design and Development of Multimodal Interfaces, Extended Abstracts CHI'04 (2004), 1325--1328

Digital Library

[6]

Dragevic, P., Fekete, J.-D. ICON: Input Device Selection and Interaction Configuration, Demonstration, UIST 2002 Companion (2002), 47--48.

[7]

Dubois, E., Nigay, L., Troccaz, J. Assessing Continuity and Compatibility in Augmented Reality Systems. UAIS Journal, 4 (2002), 263--273.

[8]

Elting, C. et al. Architecture and implementation of multimodal plug and play. Proceedings of ICMI'03 (2003), 93--100.

Digital Library

[9]

Flippo, F., Krebs, A., Marsic, I. A Framework for Rapid Development of Multimodal Interfaces. Proceedings of ICMI'03 (2003), 109--116.

Digital Library

[10]

Glass et al. A Framework for Developing Conversational User Interfaces, Proceedings of CADUI'2004 (2004), 354--365.

[11]

Ishii, H., Ullmer, B. Tangible Bits: Towards Seamless Interfaces between People, Bits and Atoms. Proceedings of CHI'97 (1997), 234--241.

Digital Library

[12]

JavaBeans 1.01 specification, Sun Microsystems (1997), <http://java.sun.com/products/javabeans/docs/>

[13]

Krahnstoever et al. A real-time framework for natural multimodal interaction with large screen displays. Proceedings of ICMI'02 (2002).

Digital Library

[14]

Nigay, L., Coutaz, J. A Generic Platform for Addressing the Multimodal Challenge. Proceedings of CHI'95 (1995), 98--105.

Digital Library

[15]

Nigay, L., Coutaz, J. The CARE Properties and Their Impact on Software Design. Intelligence and Multimodality in Multimedia Interfaces, (1997).

[16]

Oviatt, S. et al. Designing the user interface for multimodal speech and gesture applications: State-of-the-art systems and research directions. HCI, 15, 4 (2000), 263--322.

Digital Library

[17]

Oviatt, S. Taming recognition errors with a multimodal interface. Communications of the ACM, 43, 9 (2000), 45--51.

Digital Library

[18]

Oviatt, S. Ten Myths of Multimodal Interaction. Communications of ACM, 42, 11 (1999), 74--81.

Digital Library

[19]

Westeyn, T. et al. Georgia Tech Gesture Toolkit: Supporting Experiments in Gesture Recognition. Proceedings of ICMI'03 (2003), 85--92.

Digital Library

Cited By

Septon TVillarreal-Narvaez SDevroey XDumas B(2024)Exploiting Semantic Search and Object-Oriented Programming to Ease Multimodal Interface DevelopmentCompanion Proceedings of the 16th ACM SIGCHI Symposium on Engineering Interactive Computing Systems10.1145/3660515.3664244(74-80)Online publication date: 24-Jun-2024
https://dl.acm.org/doi/10.1145/3660515.3664244
Ortegat GGrolaux DRiviere EVanderdonckt J(2022)Engineering the Transition of Interactive Collaborative Software from Cloud Computing to Edge ComputingProceedings of the ACM on Human-Computer Interaction10.1145/35322106:EICS(1-31)Online publication date: 17-Jun-2022
https://dl.acm.org/doi/10.1145/3532210
Pruszko LLaurillau YPiranda BBourgeois JCoutrix C(2021)Impact of the Size of Modules on Target Acquisition and Pursuit for Future Modular Shape-changing Physical User InterfacesProceedings of the 2021 International Conference on Multimodal Interaction10.1145/3462244.3479936(297-307)Online publication date: 18-Oct-2021
https://dl.acm.org/doi/10.1145/3462244.3479936
Show More Cited By

Index Terms

ICARE software components for rapidly developing multimodal interfaces
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Touch screens
    2. Interaction paradigms
  2. Interaction design
    1. Interaction design process and methods
      1. Interface design prototyping
2. Software and its engineering
  1. Software notations and tools
    1. Development frameworks and environments
      1. Integrated and visual development environments

Recommendations

ICARE: a component-based approach for the design and development of multimodal interfaces
CHI EA '04: CHI '04 Extended Abstracts on Human Factors in Computing Systems

Multimodal interactive systems support multiple interaction techniques such as the synergistic use of speech, gesture and eye gaze tracking. The flexibility they offer results in an increased complexity that current software development tools do not ...
ICARE: a component-based approach for multimodal interaction
UbiMob '04: Proceedings of the 1st French-speaking conference on Mobility and ubiquity computing

Mobile and ubiquitous systems support multiple interaction techniques such as the synergistic use of active modalities (speech, gesture, etc.) and passive modalities (gaze, localization of a user, etc.). The flexibility they offer results in an ...
A three-dimensional characterization space of software components for rapidly developing multimodal interfaces
ICMI '08: Proceedings of the 10th international conference on Multimodal interfaces

In this paper we address the problem of the development of multimodal interfaces. We describe a three-dimensional characterization space for software components along with its implementation in a component-based platform for rapidly developing ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

ICMI '04: Proceedings of the 6th international conference on Multimodal interfaces

October 2004

368 pages

ISBN:1581139950

DOI:10.1145/1027933

General Chairs:
Rajeev Sharma
Advanced Interfaces
,
Trevor Darrell
Massachusetts Institute of Technology
,
Program Chairs:
Mary Harper
Purdue University, West Lafayette, IN
,
Gianni Lazzari
ITC-IRST
,
Matthew Turk
University of California, Santa Barbara, CA

Copyright © 2004 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 13 October 2004

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

ICMI04

Sponsor:

ICMI04: Sixth International Conference on Multimodal Interfaces 2004

October 13 - 15, 2004

PA, State College, USA

Acceptance Rates

Overall Acceptance Rate 453 of 1,080 submissions, 42%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

65
Total Citations
View Citations
651
Total Downloads

Downloads (Last 12 months)11
Downloads (Last 6 weeks)2

Reflects downloads up to 14 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Septon TVillarreal-Narvaez SDevroey XDumas B(2024)Exploiting Semantic Search and Object-Oriented Programming to Ease Multimodal Interface DevelopmentCompanion Proceedings of the 16th ACM SIGCHI Symposium on Engineering Interactive Computing Systems10.1145/3660515.3664244(74-80)Online publication date: 24-Jun-2024
https://dl.acm.org/doi/10.1145/3660515.3664244
Ortegat GGrolaux DRiviere EVanderdonckt J(2022)Engineering the Transition of Interactive Collaborative Software from Cloud Computing to Edge ComputingProceedings of the ACM on Human-Computer Interaction10.1145/35322106:EICS(1-31)Online publication date: 17-Jun-2022
https://dl.acm.org/doi/10.1145/3532210
Pruszko LLaurillau YPiranda BBourgeois JCoutrix C(2021)Impact of the Size of Modules on Target Acquisition and Pursuit for Future Modular Shape-changing Physical User InterfacesProceedings of the 2021 International Conference on Multimodal Interaction10.1145/3462244.3479936(297-307)Online publication date: 18-Oct-2021
https://dl.acm.org/doi/10.1145/3462244.3479936
Caffiau SNigay L(2021)Teaching Human-Computer Interaction in the Software Engineering Master’s Degree Program of the University Grenoble AlpesSense, Feel, Design10.1007/978-3-030-98388-8_24(270-278)Online publication date: 30-Aug-2021
https://dl.acm.org/doi/10.1007/978-3-030-98388-8_24
Zimmerer CFischbach MLatoschik M(2018)Semantic Fusion for Natural Multimodal Interfaces using Concurrent Augmented Transition NetworksMultimodal Technologies and Interaction10.3390/mti20400812:4(81)Online publication date: 6-Dec-2018
https://doi.org/10.3390/mti2040081
Bellal ZBenslimane SElouali N(2017)Using programming by demonstration for multimodality in mobile-human interactionsProceedings of the 29th Conference on l'Interaction Homme-Machine10.1145/3132129.3132154(243-251)Online publication date: 29-Aug-2017
https://dl.acm.org/doi/10.1145/3132129.3132154
Fischbach MWiebusch DLatoschik M(2017)Semantic Entity-Component State Management Techniques to Enhance Software Quality for Multimodal VR-SystemsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2017.265709823:4(1342-1351)Online publication date: 1-Apr-2017
https://dl.acm.org/doi/10.1109/TVCG.2017.2657098
Cuenca FVan den Bergh JLuyten KConinx K(2016)HasseltInternational Journal of People-Oriented Programming10.4018/IJPOP.20160101025:1(19-38)Online publication date: 1-Jan-2016
https://dl.acm.org/doi/10.4018/IJPOP.2016010102
Schüssel FHonold FBubalo NWeber MBöck RBonin FCampbell NPoppe R(2016)Increasing robustness of multimodal interaction via individual interaction historiesProceedings of the Workshop on Multimodal Analyses enabling Artificial Agents in Human-Machine Interaction10.1145/3011263.3011273(56-63)Online publication date: 12-Nov-2016
https://dl.acm.org/doi/10.1145/3011263.3011273
Zimmerer CFischbach MLatoschik MKranzlmüller DKlinker G(2016)Maintainable management and access of lexical knowledge for multimodal virtual reality interfacesProceedings of the 22nd ACM Conference on Virtual Reality Software and Technology10.1145/2993369.2996310(347-348)Online publication date: 2-Nov-2016
https://dl.acm.org/doi/10.1145/2993369.2996310
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents