Motion Part-Level Interpolation and Manipulation over Automatic Symbolic Labanotation Annotation

Junkun Jiang, Ho Yin Au, Jie Chen*, Jingyu Xiang, Mingyuan Chen

*Corresponding author for this work

Research output: Chapter in book/report/conference proceedingConference proceedingpeer-review

Abstract

Motion sequencing is a crucial process in creating smooth and natural animations by arranging individual motion sequences based on desired action scripts. Existing methods either rely on carefully engineered key-frame libraries or implicitly encoded latent phase manifolds for sequential interpolation and manipulation. However, ensuring smooth and natural transitions becomes challenging when dealing with complex and diverse actions, and the manipulation flexibility is limited to the frame level. In this study, we introduce a novel motion sequencing framework centered around Labanotation. The framework leverages automatically annotated Labanotation for explicit representation of motion elements to the body-part level. The proposed Laban Masked Autoencoder (LBN-MAE) is able to directly complete, interpolate and translate Laban symbols into natural 3D trajectories. Our framework offers a compact and descriptive representation of motion, enabling precise motion control and reediting. Comparative evaluations against both conventional and state-of-the-art learning-based methods validate the effectiveness of our proposed framework.
Original languageEnglish
Title of host publicationProceedings - 2024 International Joint Conference on Neural Networks (IJCNN)
PublisherIEEE
Pages1-8
Number of pages8
ISBN (Electronic)9798350359312
ISBN (Print)9798350359329
DOIs
Publication statusPublished - 30 Jun 2024
Event2024 International Joint Conference on Neural Networks, IJCNN 2024 - Yokohama, Japan
Duration: 30 Jun 20245 Jul 2024
https://2024.ieeewcci.org/ (Conference website)
https://ieeexplore.ieee.org/xpl/conhome/10649807/proceeding (Conference proceeding)

Publication series

NameProceedings - International Joint Conference on Neural Networks (IJCNN)
ISSN (Print)2161-4393
ISSN (Electronic)2161-4407

Conference

Conference2024 International Joint Conference on Neural Networks, IJCNN 2024
Country/TerritoryJapan
CityYokohama
Period30/06/245/07/24
Internet address

Scopus Subject Areas

  • Software
  • Artificial Intelligence

User-Defined Keywords

  • Labanotation
  • masked auto-encoder
  • motion interpolation
  • motion in-betweening

Cite this