skip to main content
10.1145/3641519.3657457acmconferencesArticle/Chapter ViewAbstractPublication PagessiggraphConference Proceedingsconference-collections
research-article
Open access

SMEAR: Stylized Motion Exaggeration with ARt-direction

Published: 13 July 2024 Publication History

Abstract

Smear frames are routinely used by artists for the expressive depiction of motion in animations. In this paper, we present an automatic, yet art-directable method for the generation of smear frames in 3D, with a focus on elongated in-betweens where an object is stretched along its trajectory. It takes as input a key-framed animation of a 3D mesh, and outputs a deformed version of this mesh for each frame of the animation, while providing for artistic refinement at the end of the animation process and prior to rendering.
Our approach works in two steps. We first compute spatially and temporally coherent motion offsets that describe to which extent parts of the input mesh should be leading in front or trailing behind. We then describe a framework to stylize these motion offsets in order to produce elongated in-betweens at interactive rates, which we extend to the other two common smear frame effects: multiple in-betweens and motion lines. Novice users may rely on preset stylization functions for fast and easy prototyping, while more complex custom-made stylization functions may be designed by experienced artists through our geometry node implementation in Blender.

Supplemental Material

MP4 File - presentation
presentation
MP4 File
- supplemental material.pdf: Appendix of the main paper - supplemental video.mp4: Presentation video containing a demonstration of the proposed tool and showing the animation videos of the results presented in the paper. - supplemental material.zip: Blender add-on and Blender files used to create the results presented in the paper and video
ZIP File - Repository for "SMEAR: Stylized Motion Exaggeration with ARt-direction"
This software is an implementation of the motion stylization technique described in the paper, as an add-on for the open source software Blender. Instructions are available in the README of the code repository. More information can be found on GitHub, at https://github.com/MoStyle/SMEAR
CeCILL FREE SOFTWARE LICENSE AGREEMENT
PDF File
- supplemental material.pdf: Appendix of the main paper - supplemental video.mp4: Presentation video containing a demonstration of the proposed tool and showing the animation videos of the results presented in the paper. - supplemental material.zip: Blender add-on and Blender files used to create the results presented in the paper and video
ZIP File
- supplemental material.pdf: Appendix of the main paper - supplemental video.mp4: Presentation video containing a demonstration of the proposed tool and showing the animation videos of the results presented in the paper. - supplemental material.zip: Blender add-on and Blender files used to create the results presented in the paper and video

References

[1]
Adobe. 2024. Mixamo. https://www.mixamo.com/ Accessed: 16-01-2024.
[2]
Otman Benchekroun, Jiayi Eris Zhang, Siddartha Chaudhuri, Eitan Grinspun, Yi Zhou, and Alec Jacobson. 2023. Fast Complementary Dynamics via Skinning Eigenmodes. ACM Trans. Graph. 42, 4, Article 106 (2023). https://doi.org/10.1145/3592404
[3]
David C Burr and John Ross. 2002. Direct evidence that "speedlines" influence motion mechanisms. Journal of Neuroscience 22, 19 (2002), 8661–8664. https://doi.org/10.1523/JNEUROSCI.22-19-08661.2002
[4]
Edwin Catmull and Raphael Rom. 1974. A class of local interpolating splines. In Computer aided geometric design. Elsevier, 317–326. https://doi.org/10.1016/B978-0-12-079050-0.50020-5
[5]
Stephen Chenney, Mark Pingel, Rob Iverson, and Marcin Szymanski. 2002. Simulating cartoon style animation. In Proceedings of the 2nd International Symposium on Non-photorealistic Animation and Rendering. 133–138. https://doi.org/10.1145/508530.508553
[6]
Stelian Coros, Sebastian Martin, Bernhard Thomaszewski, Christian Schumacher, Robert Sumner, and Markus Gross. 2012. Deformable objects alive!ACM Trans. Graph. 31, 4 (2012), 1–9. https://doi.org/10.1145/2185520.2185565
[7]
Keenan Crane, Ulrich Pinkall, and Peter Schröder. 2013. Robust fairing via conformal curvature flow. ACM Transactions on Graphics (TOG) 32, 4 (2013), 1–10. https://doi.org/10.1145/2461912.2461986
[8]
Credomo. 2016. https://blendswap.com/blend/17808
[9]
James E Cutting. 2002. Representing motion in a static image: constraints and parallels in art, science, and popular culture. Perception 31, 10 (2002), 1165–1193.
[10]
Downdate. 2012. https://opengameart.org/content/basket-ball-texture
[11]
Marek Dvorožňák, Pierre Bénard, Pascal Barla, Oliver Wang, and Daniel Sýkora. 2017. Example-Based Expressive Animation of 2D Rigid Bodies. ACM Trans. Graph. 36, 4, Article 127 (2017). https://doi.org/10.1145/3072959.3073611
[12]
Marcos Garcia, John Dingliana, and Carol O’Sullivan. 2007. A Physically Based Deformation Model for Interactive Cartoon Animation. In VRIPHYS. 27–34. https://doi.org/10.2312/PE/vriphys/vriphys07/027-034
[13]
Marcos Garcia, John Dingliana, and Carol O’Sullivan. 2008. Perceptual evaluation of cartoon physics: accuracy, attention, appeal. In Proceedings of the 5th Symposium on Applied Perception in Graphics and Visualization. 107–114. https://doi.org/10.1145/1394281.1394301
[14]
Wilson S Geisler. 1999. Motion streaks provide a spatial code for motion direction. Nature 400, 6739 (1999), 65–69. https://doi.org/10.1038/21886
[15]
Jason Hise. 2020. https://www.desmos.com/calculator/3zhzwbfrxd
[16]
Naoya Iwamoto, Hubert PH Shum, Longzhi Yang, and Shigeo Morishima. 2015. Multi-layer Lattice Model for Real-Time Dynamic Character Deformation. In Computer Graphics Forum, Vol. 34. Wiley, 99–109. https://doi.org/10.1111/cgf.12749
[17]
N. Jones and J. Keyser. 2005. Real-time geometric motion blur for a deforming polygonal mesh. In International 2005 Computer Graphics. 26–31. https://doi.org/10.1109/CGI.2005.1500362
[18]
JuanG3D. 2017. https://sketchfab.com/3d-models/day31-spinning-top-d090504b2d994d7c812c14bc963afe90
[19]
Niranjan Kalyanasundaram, Damien Rohmer, and Victor Zordan. 2022. Acceleration Skinning: Kinematics-Driven Cartoon Effects for Articulated Characters. In Graphics Interface.
[20]
Rubaiat Habib Kazi, Tovi Grossman, Cory Mogk, Ryan Schmidt, and George Fitzmaurice. 2016. ChronoFab: Fabricating Motion. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, 908–918. https://doi.org/10.1145/2858036.2858138
[21]
Ji-yong Kwon and In-Kwon Lee. 2012. The Squash-and-Stretch Stylization for Character Motions. IEEE Transactions on Visualization and Computer Graphics 18, 3 (2012), 488–500. https://doi.org/10.1109/TVCG.2011.48
[22]
John Lasseter. 1987. Principles of traditional animation applied to 3D computer animation. In Proceedings of the 14th annual conference on Computer graphics and interactive techniques. 35–44. https://doi.org/10.1145/37402.37407
[23]
Jiaju Ma, Li-Yi Wei, and Rubaiat Habib Kazi. 2022. A Layered Authoring Tool for Stylized 3D animations. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems. Article 383, 14 pages. https://doi.org/10.1145/3491102.3501894
[24]
Matthias Müller, Bruno Heidelberger, Matthias Teschner, and Markus Gross. 2005. Meshless deformations based on shape matching. ACM Trans. Graph. 24, 3 (2005), 471–478. https://doi.org/10.1145/1073204.1073216
[25]
Paul Noble and Wen Tang. 2007. Automatic expressive deformations for implying and stylizing motion. The Visual Computer 23 (2007), 523–533. https://doi.org/0.1007/s00371-007-0125-8
[26]
Richard Roberts and Byron Mallett. 2013. A pose space for squash and stretch deformation. In 2013 28th International Conference on Image and Vision Computing New Zealand (IVCNZ 2013). IEEE, 166–171. https://doi.org/10.1109/IVCNZ.2013.6727010
[27]
Damien Rohmer, Marco Tarini, Niranjan Kalyanasundaram, Faezeh Moshfeghifar, Marie-Paule Cani, and Victor Zordan. 2021. Velocity Skinning for Real-time Stylized Skeletal Animation. Computer Graphics Forum (2021). https://doi.org/10.1111/cgf.142654
[28]
Nadine Abu Rumman and Marco Fratarcangeli. 2014. Position based skinning of skeleton-driven deformable characters. In Proceedings of the 30th Spring Conference on Computer Graphics. 83–90. https://doi.org/10.1145/2643188.2643194
[29]
Johannes Schmid, Robert W Sumner, Huw Bowles, and Markus H Gross. 2010. Programmable motion effects.ACM Trans. Graph. 29, 4 (2010), 57–1.
[30]
Silvia Sellán, Noam Aigerman, and Alec Jacobson. 2021. Swept volumes via spacetime numerical continuation. ACM Trans. Graph. 40, 4 (2021), 1–11. https://doi.org/10.1145/3450626.3459780
[31]
Ken Shoemake. 1985. Animating rotation with quaternion curves. In Proceedings of the 12th annual conference on Computer graphics and interactive techniques. 245–254. https://doi.org/10.1145/325334.325242
[32]
SteveTheDragon. 2019. https://sketchfab.com/3d-models/daffy-duck-57b3d5631e4649da907977353aece0c8
[33]
Frank Thomas and Ollie Johnston. 1981. Disney animation: The illusion of life. (1981).
[34]
Jue Wang, Steven M Drucker, Maneesh Agrawala, and Michael F Cohen. 2006. The cartoon animation filter. ACM Trans. Graph. 25, 3 (2006), 1169–1173. https://doi.org/10.1145/1141911.1142010
[35]
Richard Williams. 2001. The Animator’s Survival Kit. Faber & Faber.
[36]
Steven Worley. 1996. A cellular texture basis function. In Proceedings of the 23rd annual conference on Computer graphics and interactive techniques. 291–294. https://doi.org/10.1145/237170.237267
[37]
Jiayi Eris Zhang, Seungbae Bang, David I.W. Levin, and Alec Jacobson. 2020. Complementary Dynamics. ACM Transactions on Graphics (2020). https://doi.org/10.1145/3414685.3417819
[38]
Xiuming Zhang, Tali Dekel, Tianfan Xue, Andrew Owens, Qiurui He, Jiajun Wu, Stefanie Mueller, and William T Freeman. 2018. Mosculp: Interactive visualization of shape and time. In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology. 275–285. https://doi.org/10.1145/3242587.3242592

Index Terms

  1. SMEAR: Stylized Motion Exaggeration with ARt-direction

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Conferences
      SIGGRAPH '24: ACM SIGGRAPH 2024 Conference Papers
      July 2024
      1106 pages
      ISBN:9798400705250
      DOI:10.1145/3641519
      This work is licensed under a Creative Commons Attribution International 4.0 License.

      Sponsors

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 13 July 2024

      Check for updates

      Author Tags

      1. Smear Frames
      2. Stylized Animation

      Qualifiers

      • Research-article
      • Research
      • Refereed limited

      Funding Sources

      Conference

      SIGGRAPH '24
      Sponsor:

      Acceptance Rates

      Overall Acceptance Rate 1,822 of 8,601 submissions, 21%

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • 0
        Total Citations
      • 708
        Total Downloads
      • Downloads (Last 12 months)708
      • Downloads (Last 6 weeks)221
      Reflects downloads up to 24 Dec 2024

      Other Metrics

      Citations

      View Options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      HTML Format

      View this article in HTML Format.

      HTML Format

      Login options

      Media

      Figures

      Other

      Tables

      Share

      Share

      Share this Publication link

      Share on social media