skip to main content
10.1145/192426.192500acmconferencesArticle/Chapter ViewAbstractPublication PagesuistConference Proceedingsconference-collections
Article
Free access

Extending a graphical toolkit for two-handed interaction

Published: 02 November 1994 Publication History

Abstract

Multimodal interaction combines input from multiple sensors such as pointing devices or speech recognition systems, in order to achieve more fluid and natural interaction. Two-handed interaction has been used recently to enrich graphical interaction. Building applications that use such combined interaction requires new software techniques and frameworks. Using additional devices means that user interface toolkits must be more flexible with regard to input devices and event types. The possibility of parallel interactions must also be taken into account, with consequences on the structure of toolkits. Finally, frameworks must be provided for the combination of events and status of several devices. This paper reports on the extensions we made to the direct manipulation interface toolkit Whizz in order to experiment two-handed interaction. These extensions range from structural adaptations of the toolkit to new techniques for specifying the time-dependent fusion of events.

References

[1]
M. Beaudouin-Lafon, Y. Berteaud, and S. Chatty. Creating direct manipulation interfaces with XTV. In Proceedings of EX'90, London, pages 148-155, 1990.
[2]
M. Beaudouin-Lafon and M. Thiellement. A tour through AVIS. ACM SIGCHI Bulletin, 23(4), Oct. 1991.
[3]
E. Bier and S. Freeman. MMM: a user interface architecture for shared editors on a single screen. In Proceedings of the A CM UIST, pages 79-86. Addison-Wesley, 1991.
[4]
E. Bier, M. Stone, K. Pier, W. Buxton, and T. DeRose. Toolglass and magic lenses: the see-through interface. In Proceedings of the A CM SIGGRAPH, pages 73-80. Addison-Wesley, 1993.
[5]
M. M. Blattner and R. B. Dannenberg. Multimedia interface design. ACM Press, 1992.
[6]
R. A. Bolt. Put-That-There: voice and gesture at the graphics interfaces. A CM Computer Graphics, 14(3):262-270, 1980.
[7]
W. Buxton and B. Myers. A study in two-handed input. In Proceedings of the A CM CHI, pages 321-326. Addison-Wesley, 1986.
[8]
S. Chatty. Defining the behaviour of animated interfaces. In Proceedings of the IFIP WG 2.7 working conference, pages 95-109. North-Holland, Aug. 1992.
[9]
P. Cointe and X. Rodet. Formes: an object and time oriented system for music composition and synthesis. In Proceedings of the A CM Conference on Lisp and Functional Languages, 1984.
[10]
A. Gourdol, L. Nlgay, D. Salber, and J. Coutaz. Two case studies of software architecture for multimodal inter'active systems: VoicePaint and voice-enabled graphical notebook. In Proceedings of the iFIP WG 2.7 working conference, pages 271-284. North-Holland, Aug. 1992.
[11]
R. D. Hill. Supporting concurrency, communication and synchronization in human-computer interaction - the Sassafras UiMS. A CM Transactions on Graphics, 5(2): 179-210, Apr. 1986.
[12]
Groupe multimodalitd. In Actes d'IHM'91 - Troisi~mes journdes sur l'ingdnidrie des interfaces hommemachine. 1991.
[13]
P. Kabbash, W. Buxton, and A. Sellen. Two-handed input in a compound task. In Proceedings of the A CM CHI, pages 417-423. Addison-Wesley, 1994.
[14]
G. Kurtenbach and T. Baudel. Hypermarks: issuing commands by drawing marks in Hypercard. In CHI'92 Posters and Short Talks, page 64, 1992.
[15]
M.A. Limon, J. M. Vlissides, and P. R. Calder. Composing user interfaces with InterViews. IEEE Computer, pages 8-22, Feb. 1989.
[16]
B. A. Myers. A new model for handling input. A CM Transactions on Office Information Systems, pages 289- 320, July 1990.
[17]
L. Nigay and J. Coutaz. A design space for multimodal systems: concurrent processing and data fusion. In Proceedings of the A CM CHI, pages 172-178. Addison- Wesley, 1993.
[18]
D. A. Norman. The Design of Everyday Things. Doubleday, New York, 1990.
[19]
D. H. Rubine. The automatic recognition of gestures. PhD thesls, Carnegie Mellon University, 1991.
[20]
D. Weimer and S. Ganapathy. Interaction techniques using hand tracking and speech recognition, pages 109- 126. In Multimedia Interface Design {5}, 1992.

Cited By

View all

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
UIST '94: Proceedings of the 7th annual ACM symposium on User interface software and technology
November 1994
226 pages
ISBN:0897916573
DOI:10.1145/192426
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 02 November 1994

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. direct manipulation
  2. graphical toolkit
  3. interaction styles
  4. multimodal interaction
  5. two-handed interaction

Qualifiers

  • Article

Conference

7UIST94
7UIST94: 7th ACM Symposium on User Interface and Software Technology
November 2 - 4, 1994
California, Marina del Rey, USA

Acceptance Rates

Overall Acceptance Rate 561 of 2,567 submissions, 22%

Upcoming Conference

UIST '25
The 38th Annual ACM Symposium on User Interface Software and Technology
September 28 - October 1, 2025
Busan , Republic of Korea

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)33
  • Downloads (Last 6 weeks)3
Reflects downloads up to 24 Dec 2024

Other Metrics

Citations

Cited By

View all

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Login options

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media