skip to main content
10.1145/3623264.3624444acmconferencesArticle/Chapter ViewAbstractPublication PagesmigConference Proceedingsconference-collections
research-article

Avatar Tracking Control with Featherstone's Algorithm and Newton-Euler Formulation for Inverse Dynamics

Published: 15 November 2023 Publication History

Abstract

With a spread of inexpensive and easy-to-use motion tracking methods such as cameras and trackers for virtual realities (VRs), real-time motion-tracked avatars are becoming increasingly common in virtual environments, particularly social VRs, virtual performers (e.g., virtual YouTubers), and VR games. These applications frequently involve interactions among multiple avatars or between avatars and objects for communication or gameplay. However, at present, most applications do not sufficiently consider the effects of contact for avatars, thus leading to penetration or unnatural behavior. To achieve natural avatar motion in such scenarios, the player must perform as if contact has occurred, even though, in reality, there is no contact with the player’s body. While physics simulation can solve the contact issue, the basic use of physics simulation causes tracking delay. We therefore solve this tracking delay problem by employing Featherstone’s algorithm, a reduced-coordinate method for forward dynamics, and by utilizing the Newton-Euler formulation for inverse dynamics to compute tracking forces and torques. To evaluate the delay, we measured the difference between the joint rotations of the simulated model and the input joint rotations. The evaluation with our method indicates the difference is less than 1.4 micro radians for all joints in real time with a small computational cost. Moreover, accurate tracking enables the fixation of both feet. The proposed method provides accurate tracking and soft reactions to contact.

Supplementary Material

MP4 File (AvatarTrackingControlwithFeatherstone.mp4)
Video of proposed method and evaluation

References

[1]
Mihai Anitescu and Florian A. Potra. 2002. A time-stepping method for stiff multibody dynamics with contact and friction. Internat. J. Numer. Methods Engrg. 55, 7 (2002), 753–784. https://doi.org/10.1002/nme.512 arXiv:https://onlinelibrary.wiley.com/doi/pdf/10.1002/nme.512
[2]
J-R. Chardonnet, S. Miossec, A. Kheddar, H. Arisumi, H. Hirukawa, F. Pierrot, and K. Yokoi. 2006. Dynamic simulator for humanoids using constraint-based method with static friction. In 2006 IEEE International Conference on Robotics and Biomimetics. 1366–1371. https://doi.org/10.1109/ROBIO.2006.340128
[3]
Roy Featherstone. 1987. Robot Dynamics Algorithm. Kluwer Academic Publishers, USA.
[4]
Shoichi Hasegawa, Naoki Okada, Jiro Baba, Yuuichi Tazaki, Hiroshi Ichikawa, Akihiko Shirai, Yasuharu Koike, and Makoto Sato. 2004. Springhead: Open source haptic software for virtual worlds with dynamics simulations. In Proceedings of the 4th International Conference EuroHaptics 2004. 385–386.
[5]
John M. Hollerbach. 1980. A Recursive Lagrangian Formulation of Maniputator Dynamics and a Comparative Study of Dynamics Formulation Complexity. IEEE Transactions on Systems, Man, and Cybernetics 10, 11 (1980), 730–736. https://doi.org/10.1109/TSMC.1980.4308393
[6]
Satoru Ishigaki, Timothy White, Victor B. Zordan, and C. Karen Liu. 2009. Performance-Based Control Interface for Character Animation. ACM Trans. Graph. 28, 3, Article 61 (July 2009), 8 pages. https://doi.org/10.1145/1531326.1531367
[7]
Seunghwan Lee, Phil Sik Chang, and Jehee Lee. 2022. Deep Compliant Control. In ACM SIGGRAPH 2022 Conference Proceedings (Vancouver, BC, Canada) (SIGGRAPH ’22). Association for Computing Machinery, New York, NY, USA, Article 23, 9 pages. https://doi.org/10.1145/3528233.3530719
[8]
Xiubo Liang, Ludovic Hoyet, Weidong Geng, and Franck Multon. 2010. Responsive Action Generation by Physically-Based Motion Retrieval and Adaptation. In Motion in Games, Ronan Boulic, Yiorgos Chrysanthou, and Taku Komura (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 313–324.
[9]
J. Y. S. Luh, M. W. Walker, and R. P. C. Paul. 1980. On-Line Computational Scheme for Mechanical Manipulators. Journal of Dynamic Systems, Measurement, and Control 102, 2 (06 1980), 69–76. https://doi.org/10.1115/1.3149599 arXiv:https://asmedigitalcollection.asme.org/dynamicsystems/article-pdf/102/2/69/5696694/69_1.pdf
[10]
Y. Nakamura and K. Yamane. 2000. Dynamics computation of structure-varying kinematic chains and its application to human figures. IEEE Transactions on Robotics and Automation 16, 2 (2000), 124–134. https://doi.org/10.1109/70.843167
[11]
Nam Nguyen, Nkenge Wheatland, David Brown, Brian Parise, C. Karen Liu, and Victor Zordan. 2010. Performance Capture with Physical Interaction. In Proceedings of the 2010 ACM SIGGRAPH/Eurographics Symposium on Computer Animation (Madrid, Spain) (SCA ’10). Eurographics Association, Goslar, DEU, 189–195.
[12]
Nam H. Nguyen, Raul Arista, C. Karen Liu, and Victor Zordan. 2012. Adaptive Dynamics with Hybrid Response. In SIGGRAPH Asia 2012 Technical Briefs (Singapore, Singapore) (SA ’12). Association for Computing Machinery, New York, NY, USA, Article 5, 4 pages. https://doi.org/10.1145/2407746.2407751
[13]
Rubens F. Nunes, Creto A. Vidal, Joaquim B. Cavalcante-Neto, and Victor B. Zordan. 2008. Simple Feedforward Control for Responsive Motion Capture-Driven Simulations. In Advances in Visual Computing, George Bebis, Richard Boyle, Bahram Parvin, Darko Koracin, Paolo Remagnino, Fatih Porikli, Jörg Peters, James Klosowski, Laura Arns, Yu Ka Chun, Theresa-Marie Rhyne, and Laura Monroe (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 488–497.
[14]
D.E. Orin, R.B. McGhee, M. Vukobratović, and G. Hartoch. 1979. Kinematic and kinetic analysis of open-chain linkages utilizing Newton-Euler methods. Mathematical Biosciences 43, 1 (1979), 107–130. https://doi.org/10.1016/0025-5564(79)90104-4
[15]
Masaki Oshita and Akifumi Makinouchi. 2001. A Dynamic Motion Control Technique for Human-like Articulated Figures. Computer Graphics Forum 20, 3 (2001), 192–203. https://doi.org/10.1111/1467-8659.00512 arXiv:https://onlinelibrary.wiley.com/doi/pdf/10.1111/1467-8659.00512
[16]
Xue Bin Peng, Pieter Abbeel, Sergey Levine, and Michiel van de Panne. 2018. DeepMimic: Example-Guided Deep Reinforcement Learning of Physics-Based Character Skills. ACM Trans. Graph. 37, 4, Article 143 (jul 2018), 14 pages. https://doi.org/10.1145/3197517.3201311
[17]
Xue Bin Peng, Ze Ma, Pieter Abbeel, Sergey Levine, and Angjoo Kanazawa. 2021. AMP: Adversarial Motion Priors for Stylized Physics-Based Character Control. ACM Trans. Graph. 40, 4, Article 144 (jul 2021), 20 pages. https://doi.org/10.1145/3450626.3459670
[18]
photon. 2015. photon. https://www.photonengine.com/ja-jp/pun 2023/9/22 browsed.
[19]
Stanley Plagenhoef, F. Gaynor Evans, and Thomas Abdelnour. 1983. Anatomical Data for Analyzing Human Motion. Research Quarterly for Exercise and Sport 54, 2 (1983), 169–178. https://doi.org/10.1080/02701367.1983.10605290 arXiv:https://doi.org/10.1080/02701367.1983.10605290
[20]
RootMotion. 2014. Final IK. https://assetstore.unity.com/packages/tools/animation/final-ik-14290 2020/1/25 browsed.
[21]
Ari Shapiro, Fred Pighin, and Petros Faloutsos. 2003. Hybrid Control for Interactive Character Animation. In Proceedings of the 11th Pacific Conference on Computer Graphics and Applications(PG ’03). IEEE Computer Society, USA, 455.
[22]
D. E. STEWART and J. C. TRINKLE. 1996. AN IMPLICIT TIME-STEPPING SCHEME FOR RIGID BODY DYNAMICS WITH INELASTIC COLLISIONS AND COULOMB FRICTION. Internat. J. Numer. Methods Engrg. 39, 15 (1996), 2673–2691. https://doi.org/10.1002/(SICI)1097-0207(19960815)39:15<2673::AID-NME972>3.0.CO;2-I
[23]
Ken Sugimori, Hironori Mitake, Hirohito Sato, Kensho Oguri, and Shoichi Hasegawa. 2021. Avatar Tracking Control with Generations of Physically Natural Responses on Contact to Reduce Performers’ Loads. In Proceedings of the 27th ACM Symposium on Virtual Reality Software and Technology (Osaka, Japan) (VRST ’21). Association for Computing Machinery, New York, NY, USA, Article 1, 5 pages. https://doi.org/10.1145/3489849.3489859
[24]
Takashi Tokizaki, Yuuichi Tazaki, Hironori Mitake, and Shoichi Hasegawa. 2009. Pliant Motion: Integration of Virtual Trajectory Control into LCP Based Physics Engines. In SIGGRAPH ’09: Posters (New Orleans, Louisiana) (SIGGRAPH ’09). Association for Computing Machinery, New York, NY, USA, Article 10, 1 pages. https://doi.org/10.1145/1599301.1599311
[25]
J.J. Uicker. 1965. On the Dynamic Analysis of Spatial Linkages Using 4x4 Matrices. University Microfilms. https://books.google.co.jp/books?id=8oysnQEACAAJ
[26]
Pawel Wrotek, Odest Chadwicke Jenkins, and Morgan McGuire. 2006. Dynamo: Dynamic, Data-Driven Character Control with Adjustable Balance. In Proceedings of the 2006 ACM SIGGRAPH Symposium on Videogames (Boston, Massachusetts) (Sandbox ’06). Association for Computing Machinery, New York, NY, USA, 61–70. https://doi.org/10.1145/1183316.1183325
[27]
KangKang Yin, Michael B. Cline, and Dinesh K. Pai. 2003. Motion Perturbation Based on Simple Neuromotor Control Models. In Proceedings of the 11th Pacific Conference on Computer Graphics and Applications(PG ’03). IEEE Computer Society, USA, 445.
[28]
Victor Brian Zordan and Jessica K. Hodgins. 2002. Motion Capture-Driven Simulations That Hit and React. In Proceedings of the 2002 ACM SIGGRAPH/Eurographics Symposium on Computer Animation (San Antonio, Texas) (SCA ’02). Association for Computing Machinery, New York, NY, USA, 89–96. https://doi.org/10.1145/545261.545276
[29]
Victor Brian Zordan, Anna Majkowska, Bill Chiu, and Matthew Fast. 2005. Dynamic Response for Motion Capture Animation. ACM Trans. Graph. 24, 3 (July 2005), 697–701. https://doi.org/10.1145/1073204.1073249

Cited By

View all

Index Terms

  1. Avatar Tracking Control with Featherstone's Algorithm and Newton-Euler Formulation for Inverse Dynamics

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    MIG '23: Proceedings of the 16th ACM SIGGRAPH Conference on Motion, Interaction and Games
    November 2023
    224 pages
    ISBN:9798400703935
    DOI:10.1145/3623264
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 15 November 2023

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. avatar
    2. character
    3. inverse dynamics
    4. motion capture
    5. physics simulation

    Qualifiers

    • Research-article
    • Research
    • Refereed limited

    Funding Sources

    • JST

    Conference

    MIG '23
    Sponsor:

    Acceptance Rates

    Overall Acceptance Rate -9 of -9 submissions, 100%

    Upcoming Conference

    MIG '24

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • 0
      Total Citations
    • 70
      Total Downloads
    • Downloads (Last 12 months)70
    • Downloads (Last 6 weeks)3
    Reflects downloads up to 14 Sep 2024

    Other Metrics

    Citations

    Cited By

    View all

    View Options

    Get Access

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format.

    HTML Format

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media