extended-abstract

Shape your body: control a virtual silhouette using body motion

Authors:

Luís Leite,

Veronica OrvalhoAuthors Info & Claims

CHI EA '12: CHI '12 Extended Abstracts on Human Factors in Computing Systems

Pages 1913 - 1918

https://doi.org/10.1145/2212776.2223728

Published: 05 May 2012 Publication History

Get Access

Abstract

In this paper we propose to use our body as a puppetry controller, giving life to a virtual silhouette through acting. A framework was deployed based on Microsoft Kinect using OpenNI and Unity to animate in real-time a silhouette. This was used to perform a set of experiments related to the user's interaction with human and non-human like puppets. We believe that a performance-driven silhouette can be just as expressive as a traditional shadow puppet with a high degree of freedom, making use of our entire body as an input. We describe our solution that allows real-time interactive control of virtual shadow puppets for performance animation based on body motion. We show through our experiment, performed by non-expert artists, that using our body to control puppets is like mixing the performance of an actor with the manipulation of a puppeteer.

Supplementary Material

suppl.mov (wpfile252-3.mov)

Supplemental video

Download
17.40 MB

References

[1]

Currell, D. Shadow Puppets & Shadow Play, Crowood Press (2008).

Google Scholar

[2]

Currell, D. The Complete Book of Puppet Theatre, A & C Black, London, UK (1985).

Google Scholar

[3]

Graham, W. The Story of Waldo C. Graphic. In Course Notes: 3D Character Animation by Computer, ACM SIGGRAPH (1989), 6--79.

Google Scholar

[4]

Hsu W. S., Ye T. Planning Character Motions for Shadow Play Animations. In Proc. CASA'05 (2005), 184--190.

Google Scholar

[5]

Lu, F., Tian, F., Jiang, Y., Cao, X., Luo, W., Li, G., Zhang, X., Dai, G., Wang, H. ShadowStory: creative and collaborative digital storytelling inspired by cultural heritage. In Proc. of CHI 2011 (2011), 1919--1928.

Digital Library

Google Scholar

[6]

Pan, J., Zhang, J. Sketch-based Skeleton-driven 2D Animation and Motion Capture. In Transaction of Entertainment, LNCS, Springer (2011).

Digital Library

Google Scholar

[7]

Shin, H., Lee, J., Shin, S., Gleicher, M. Computer puppetry: An importance-based approach. In ACM Trans. Graph. (2001), 67--94.

Digital Library

Google Scholar

[8]

Sturman, D. Computer puppetry. In Computer Graphics and Applications, IEEE, vol.18, no.1 (1998), 38--45.

Digital Library

Google Scholar

[9]

Sturman, D. The State of Computer Animation. In ACM SIGGRAPH Comput. Graph. ACM Press (1998), 5761.

Digital Library

Google Scholar

[10]

Tan K. L., Talib A. Z., Osman M. A. Real-Time Simulation and Interactive Animation of Shadow Play Puppets Using OpenGL. In International Journal of IJCIE Vol. 4 (2010), 1--8.

Google Scholar

[11]

Tardif, H. Character animation in real time. In Panel Proceedings: Applications of Virtual Reality I, ACM SIGGRAPH (1991).

Google Scholar

Cited By

View all

Frijns HStoeva DSchürer OGelautz M(2024)Programming Robot Animation Through Human Body Movement2024 IEEE International Conference on Advanced Robotics and Its Social Impacts (ARSO)10.1109/ARSO60199.2024.10557907(273-279)Online publication date: 20-May-2024
https://doi.org/10.1109/ARSO60199.2024.10557907
Hung CChang RChen HLiang CChan LChen B(2022)Puppeteer: Exploring Intuitive Hand Gestures and Upper-Body Postures for Manipulating Human Avatar ActionsProceedings of the 28th ACM Symposium on Virtual Reality Software and Technology10.1145/3562939.3565609(1-11)Online publication date: 29-Nov-2022
https://dl.acm.org/doi/10.1145/3562939.3565609
Lin SChen MChen NShao MMaiden NSas C(2022)Interactive Cartoon Animation through Collaborative Storytelling: A Field StudyProceedings of the 14th Conference on Creativity and Cognition10.1145/3527927.3535204(505-509)Online publication date: 20-Jun-2022
https://dl.acm.org/doi/10.1145/3527927.3535204
Show More Cited By

Index Terms

Shape your body: control a virtual silhouette using body motion
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Mani-Pull-Action: Hand-based Digital Puppetry

The human hand dexterity provides a natural and rich interface for computer interaction. Technologies for tracking hand and finger motion are now accessible and can be used with a minimum computation power for the manipulation of virtual puppets in real-...
Virtual marionette
IUI '12: Proceedings of the 2012 ACM international conference on Intelligent User Interfaces

Virtual Marionette is a research on digital puppetry, an interdisciplinary approach that brings the art of puppetry into the world of digital animation. Inspired in the traditional marionette technology our intention is to study novel interfaces as an ...
Anim-actor: understanding interaction with digital puppetry using low-cost motion capture
ACE '11: Proceedings of the 8th International Conference on Advances in Computer Entertainment Technology

Character animation has traditionally relied on complex and time-consuming key frame animation or expensive motion capture techniques. These methods are out of reach for low budget animation productions. We present a low-cost performance-driven ...

Comments

Information & Contributors

Information

Published In

CHI EA '12: CHI '12 Extended Abstracts on Human Factors in Computing Systems

May 2012

2864 pages

ISBN:9781450310161

DOI:10.1145/2212776

General Chair:
Joseph A. Konstan
University of Minnesota
,
Program Chairs:
Ed H. Chi
Google
,
Kristina Höök
Mobile Life at KTH

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 05 May 2012

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Extended-abstract

Conference

CHI '12

Sponsor:

SIGCHI

CHI '12: CHI Conference on Human Factors in Computing Systems

May 5 - 10, 2012

Texas, Austin, USA

Acceptance Rates

Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

17
Total Citations
View Citations
600
Total Downloads

Downloads (Last 12 months)25
Downloads (Last 6 weeks)6

Reflects downloads up to 01 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Frijns HStoeva DSchürer OGelautz M(2024)Programming Robot Animation Through Human Body Movement2024 IEEE International Conference on Advanced Robotics and Its Social Impacts (ARSO)10.1109/ARSO60199.2024.10557907(273-279)Online publication date: 20-May-2024
https://doi.org/10.1109/ARSO60199.2024.10557907
Hung CChang RChen HLiang CChan LChen B(2022)Puppeteer: Exploring Intuitive Hand Gestures and Upper-Body Postures for Manipulating Human Avatar ActionsProceedings of the 28th ACM Symposium on Virtual Reality Software and Technology10.1145/3562939.3565609(1-11)Online publication date: 29-Nov-2022
https://dl.acm.org/doi/10.1145/3562939.3565609
Lin SChen MChen NShao MMaiden NSas C(2022)Interactive Cartoon Animation through Collaborative Storytelling: A Field StudyProceedings of the 14th Conference on Creativity and Cognition10.1145/3527927.3535204(505-509)Online publication date: 20-Jun-2022
https://dl.acm.org/doi/10.1145/3527927.3535204
Krekhov ACmentowski SEmmerich KKrüger JArnedo JNacke LVanden Abeele VToups Dugas P(2019)Beyond HumanProceedings of the Annual Symposium on Computer-Human Interaction in Play10.1145/3311350.3347172(439-451)Online publication date: 17-Oct-2019
https://dl.acm.org/doi/10.1145/3311350.3347172
Krekhov ACmentowski SKrüger JMueller FJohnson DSchouten BToups ZWyeth P(2018)VR AnimalsProceedings of the 2018 Annual Symposium on Computer-Human Interaction in Play Companion Extended Abstracts10.1145/3270316.3271531(503-511)Online publication date: 23-Oct-2018
https://dl.acm.org/doi/10.1145/3270316.3271531
Mishra SCafaro FFernaeus YMcMillan DJonsson MGirouard ATholander J(2018)Full Body Interaction beyond FunProceedings of the Twelfth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3173225.3173291(313-319)Online publication date: 18-Mar-2018
https://dl.acm.org/doi/10.1145/3173225.3173291
Sakashita MMinagawa TKoike ASuzuki IKawahara KOchiai YGajos KMankoff JHarrison C(2017)You as a PuppetProceedings of the 30th Annual ACM Symposium on User Interface Software and Technology10.1145/3126594.3126608(217-228)Online publication date: 20-Oct-2017
https://dl.acm.org/doi/10.1145/3126594.3126608
Huang ZMadaram VAlbadrani SNguyen TLiu QLienhart RWang HChen SBoll SChen PFriedland GLi JYan S(2017)Shadow Puppetry with Robotic ArmsProceedings of the 25th ACM international conference on Multimedia10.1145/3123266.3127925(1251-1252)Online publication date: 23-Oct-2017
https://dl.acm.org/doi/10.1145/3123266.3127925
LEite LOrvalho V(2017)Mani-Pull-ActionProceedings of the ACM on Human-Computer Interaction10.1145/30958041:EICS(1-16)Online publication date: 30-Jun-2017
https://dl.acm.org/doi/10.1145/3095804
Yan ZJia ZChen YDing H(2016)The Interactive Narration of Chinese Shadow Play2016 International Conference on Virtual Reality and Visualization (ICVRV)10.1109/ICVRV.2016.63(341-345)Online publication date: Sep-2016
https://doi.org/10.1109/ICVRV.2016.63
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Mani-Pull-Action: Hand-based Digital Puppetry

Virtual marionette

Anim-actor: understanding interaction with digital puppetry using low-cost motion capture