article

Physically interactive story environments

Authors:

C. S. Pinhanez,

B. BlumbergAuthors Info & Claims

IBM Systems Journal, Volume 39, Issue 3-4

Pages 438 - 455

https://doi.org/10.1147/sj.393.0438

Published: 01 July 2000 Publication History

Abstract

Most interactive stories, such as hypertext narratives and interactive movies achieve an interactive "feel" by allowing the user to choose among multiple story paths. In this paper we discuss physically interactive environments with narrative structure in which the ability to choose among multiple story lines is replaced with having users, first, interact with the story characters in small, local "windows" of the narrative and, second, actively engage their bodies in movement, In particular, we found that compelling interactive narrative story systems can be perceived as highly responsive, engaging, and interactive even when the overall story has a single-path structure, in what we call a "less-choice, more-responsiveness" approach to the design of story-based interactive environments. We have also observed that unencumbering, rich sensor technology can facilitate user immersion in the experience as the story progresses--users can act as they typically would without worrying about manipulating a computer interface. To support these arguments, the paper describes the physical setup, the interactive story, the technology, and the user experience of four projects developed at the MIT Media Laboratory: KidsRoom, It/I, Personal Aerobics Trainer, and Swamped!

References

[1]

1. M. W. Krueger, Artificial Reality II, Addison-Wesley Publishing Co., Reading, MA (1990).

[2]

2. P. Maes, T. Darrell, B. Blumberg, and A. Pentland, "The ALIVE System: Full-Body Interaction with Autonomous Agents," Proceedings of the Computer Animation'95 Conference, Geneva, Switzerland, IEEE, New York (1995).

Digital Library

[3]

3. C. Sommerer and L. Mignonneau, "Art as a Living System," Leonardo30, No. 5 (1997).

[4]

4. N. Tosa, H. Hashimoto, K. Sezaki, Y. Kunii, T. Yamada, K. Sabe, R. Nishino, H. Harashima, and F. Harashima, "Network-Based Neuro-Baby with Robotic Hand," Proceedings of IJCAI'95 Workshop on Entertainment and AI/Alife, Montreal, Canada (August 1995).

[5]

5. A. Bobick, S. Intille, J. Davis, F. Baird, C. Pinhanez, L. Campbell, Y. Ivanov, A. Schutte, and A. Wilson, "The KidsRoom: A Perceptually-Based Interactive Immersive Story Environment," PRESENCE: Teleoperators and Virtual Environments8, No. 4, 367-391 (1999).

Digital Library

[6]

6. C. S. Pinhanez and A. F. Bobick, "'It/I': A Theater Play Featuring an Autonomous Computer Graphics Character," Proceedings of the ACM Multimedia'98 Workshop on Technologies for Interactive Movies, Bristol, England, ACM, New York (1998), pp. 22-29.

Digital Library

[7]

7. J. W. Davis and A. F. Bobick, "Virtual PAT: A Virtual Personal Aerobics Trainer," Proceedings of Workshop on Perceptual User Interfaces (PUI'98), San Francisco, CA, IEEE, New York (1998), pp. 13-18.

[8]

8. M. Johnson, A. Wilson, C. Kline, B. Blumberg, and A. Bobick, "Sympathetic Interfaces: Using a Plush Toy to Direct Synthetic Characters," Proceedings of the CHI'99 Conference on Human Factors in Computing Systems, Pittsburgh, PA, ACM, New York (1999), pp. 152-158.

Digital Library

[9]

9. J. Murray, Hamlet on the Holodeck: The Future of Narrative in Cyberspace, The Free Press, Simon & Schuster, New York (1997).

Digital Library

[10]

10. R. Scheehner, Performance Theory, Routledge, London, England (1988).

[11]

11. S. Oettermann, The Panorama: History of a Mass Medium, Zone Books, New York (1997).

[12]

12. See http://www.konami.co.jp/am/AM_English/DDR_E/index. html.

[13]

13. R. Pauseh, J. Snoddy, R. Taylor, S. Watson, and E. Haseltine, "Disney's Aladdin: First Steps Toward Storytelling in Virtual Reality," Proceedings of SIGGRAPH 96, ACM, New York (1996), pp. 193-203.

Digital Library

[14]

14. Mr. Payback, Interfilm Technologies (1995).

[15]

15. T.A. Galyean, Narrative Guidance of Interactivity, Ph.D. thesis, MIT, Cambridge, MA (1995).

Digital Library

[16]

16. B. M. Blumberg and T. A. Galyean, "Multi-Level Direction of Autonomous Agents for Real-Time Virtual Environments," Proceedings of SIGGRAPH 95, ACM, New York (1995), pp. 47-54.

Digital Library

[17]

17. D. Marinelli, "Synthetic Interviews: The Art of Creating a Dyad Between Humans and Machine-Based Characters," ACM Multimedia '98 Workshop on Technologies for Interactive Movies, Bristol, England, ACM, New York (1998).

Digital Library

[18]

18. J. W. Davis and A. Bobick, "The Representation and Recognition of Human Movement Using Temporal Templates," Proceedings of 1997 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 97), IEEE, New York (1997).

Digital Library

[19]

19. C.S. Pinhanez, "Computer Theater," Proceedings of the Eighth International Symposium on Electronic Arts (ISEA'97), Chicago, IL (September 1997).

[20]

20. C. S. Pinhanez, Representation and Recognition of Action in Interactive Spaces, Ph.D. thesis, MIT, Cambridge, MA (1999).

Digital Library

[21]

21. Y. Ivanov, A. Bobick, and J. Liu, "Fast Lighting Independent Background Subtraction," Proceedings of the IEEE Workshop on Visual Surveillance (VS'98), Bombay, India, IEEE, New York (1998), pp. 49-55.

Digital Library

[22]

22. C. S. Pinhanez, K. Mase, and A. F. Bobick, "Interval Scripts: A Design Paradigm for Story-Based Interactive Systems," Proceedings of CHI'97, Atlanta, GA, ACM, New York (1997), pp. 287-294.

Digital Library

[23]

23. A. Wilson, A. F. Bobick, and J. Cassell, "Temporal Classification of Natural Gesture and Application to Video Coding," Proceedings of 1997 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 97), Puerto Rico, IEEE, New York (1997), pp. 948-954.

Digital Library

[24]

24. B. Blumberg, Old Tricks, New Dogs: Ethology and Interactive Creatures, Ph.D. thesis, MIT, Cambridge, MA (1996).

Digital Library

[25]

25. B. Blau, M. Butler, and A. Goldberg, "M.C. Leon," SIGGRAPH 99 Catalog on Electronic Art and Animation, ACM, New York (1999), p. 108.

Digital Library

[26]

26. Reference 9, p. 140.

Cited By

Cheng LChen YPeng YHolz C(2023)Reality Rifts: Wonder-ful Interfaces by Disrupting Perceptual CausalityProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581454(1-15)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581454
Yilmaz RGoktas Y(2017)Using augmented reality technology in storytelling activitiesVirtual Reality10.1007/s10055-016-0300-121:2(75-89)Online publication date: 1-Jun-2017
https://dl.acm.org/doi/10.1007/s10055-016-0300-1
Behm-Morawitz E(2013)Mirrored selvesComputers in Human Behavior10.1016/j.chb.2012.07.02329:1(119-128)Online publication date: 1-Jan-2013
https://dl.acm.org/doi/10.1016/j.chb.2012.07.023
Show More Cited By

Index Terms

Physically interactive story environments
1. Computing methodologies
  1. Artificial intelligence
    1. Philosophical/theoretical foundations of artificial intelligence
      1. Cognitive science
  2. Computer graphics
    1. Graphics systems and interfaces
      1. Virtual reality
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms
      1. Mixed / augmented reality
      2. Virtual reality

Recommendations

A framework for narrative adaptation in interactive story-based learning environments
INT3 '10: Proceedings of the Intelligent Narrative Technologies III Workshop

A key functionality provided by interactive narrative systems is narrative adaptation: augmenting story experiences in response to users' actions, and tailoring story elements to individual users' preferences and needs. However, the task of interactive ...
From Linear Story Generation to Branching Story Graphs

Interactive narrative systems are storytelling systems in which the user can influence the content or ordering of story world events. Conceptually, an interactive narrative can be represented as a branching graph of narrative elements, implying points ...
An Interactive Narrative Platform for Story Understanding Experiments
AAMAS '17: Proceedings of the 16th Conference on Autonomous Agents and MultiAgent Systems

Interactive Narratives are systems that use automated narrative generation techniques to create multiple story variants which can be shown to an audience, as virtual narratives, using cinematic staging techniques. The focus of previous research has ...

Comments

Information & Contributors

Information

Published In

cover image IBM Systems Journal

IBM Systems Journal Volume 39, Issue 3-4

July 2000

517 pages

ISSN:0018-8670

Issue’s Table of Contents

Publisher

IBM Corp.

United States

Publication History

Published: 01 July 2000

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

8
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 16 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Cheng LChen YPeng YHolz C(2023)Reality Rifts: Wonder-ful Interfaces by Disrupting Perceptual CausalityProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581454(1-15)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581454
Yilmaz RGoktas Y(2017)Using augmented reality technology in storytelling activitiesVirtual Reality10.1007/s10055-016-0300-121:2(75-89)Online publication date: 1-Jun-2017
https://dl.acm.org/doi/10.1007/s10055-016-0300-1
Behm-Morawitz E(2013)Mirrored selvesComputers in Human Behavior10.1016/j.chb.2012.07.02329:1(119-128)Online publication date: 1-Jan-2013
https://dl.acm.org/doi/10.1016/j.chb.2012.07.023
Montemayor JDruin AChipman GFarber AGuha M(2004)Tools for children to create physical interactive storyroomsComputers in Entertainment10.1145/973801.9738212:1(12-12)Online publication date: 1-Jan-2004
https://dl.acm.org/doi/10.1145/973801.973821
Höysniemi JHämäläinen PTurkki LDruin A(2004)Wizard of Oz prototyping of computer vision based action games for childrenProceedings of the 2004 conference on Interaction design and children: building a community10.1145/1017833.1017837(27-34)Online publication date: 1-Jun-2004
https://dl.acm.org/doi/10.1145/1017833.1017837
Pinhanez CBobick A(2003)Interval scripts: a programming paradigm for interactive environments and agentsPersonal and Ubiquitous Computing10.1007/s00779-002-0209-47:1(1-21)Online publication date: 1-May-2003
https://dl.acm.org/doi/10.1007/s00779-002-0209-4
Hämäläinen PHöysniemi J(2002)A computer vision and hearing based user interface for a computer game for childrenProceedings of the User interfaces for all 7th international conference on Universal access: theoretical perspectives, practice, and experience10.5555/1765426.1765454(299-318)Online publication date: 24-Oct-2002
https://dl.acm.org/doi/10.5555/1765426.1765454
Pinhanez CBobick A(2002)"It/I"Presence: Teleoperators and Virtual Environments10.1162/10547460232093586511:5(536-548)Online publication date: 1-Oct-2002
https://dl.acm.org/doi/10.1162/105474602320935865

View Options

View options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Issue’s Table of Contents