Skip to main navigation Skip to search Skip to main content

LaMoGen: Language to Motion Generation Through LLM-Guided Symbolic Inference

  • Junkun Jiang
  • , Ho Yin Au
  • , Jingyu Xiang
  • , Jie Chen*
  • *Corresponding author for this work

Research output: Chapter in book/report/conference proceedingConference proceedingpeer-review

Abstract

Human motion is highly expressive and naturally aligned with language, yet prevailing methods relying heavily on joint text-motion embeddings struggle to synthesize temporally accurate, detailed motions and often lack explainability. To address these limitations, we introduce LabanLite, a motion representation developed by adapting and extending the Labanotation system. Unlike black-box text–motion embeddings, LabanLite encodes each atomic body-part action (e.g., a single left-foot step) as a discrete Laban symbol paired with a textual template. This abstraction decomposes complex motions into interpretable symbol sequences and body-part instructions, establishing a symbolic link between high-level language and low-level motion trajectories. Building on LabanLite, we present LaMoGen, a Text-to-LabanLite-to-Motion Generation framework that enables large language models (LLMs) to compose motion sequences through symbolic reasoning. The LLM interprets motion patterns, relates them to textual descriptions, and recombines symbols into executable plans, producing motions that are both interpretable and linguistically grounded. To support rigorous evaluation, we introduce a Labanotation-based benchmark with structured description–motion pairs and three metrics that jointly measure text–motion alignment across symbolic, temporal, and harmony dimensions. Experiments demonstrate that LaMoGen establishes a new baseline for both interpretability and controllability, outperforming prior methods on our benchmark and two public datasets. These results highlight the advantages of symbolic reasoning and agent-based design for language-driven motion synthesis. All code and data are available at https://github.com/xxx/xxx.
Original languageEnglish
Title of host publicationProceedings of IEEE/CVF Conference on Computer Vision and Pattern Recognition 2026
PublisherIEEE
Pages9364-9373
Number of pages10
Publication statusPublished - 3 Jun 2026
Event2026 IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2026 - Denver, United States
Duration: 3 Jun 20267 Jun 2026
https://cvpr.thecvf.com/Conferences/2026
https://cvpr.thecvf.com/virtual/2026/index.html
https://cvpr.thecvf.com/virtual/2026/papers.html
https://media.eventhosts.cc/Conferences/CVPR2026/CVPR_main_conf_2026_15.pdf
https://openaccess.thecvf.com/CVPR2026

Publication series

NameProceedings of IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
ISSN (Print)1063-6919
ISSN (Electronic)2575-7075

Conference

Conference2026 IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2026
Country/TerritoryUnited States
CityDenver
Period3/06/267/06/26
Internet address

Fingerprint

Dive into the research topics of 'LaMoGen: Language to Motion Generation Through LLM-Guided Symbolic Inference'. Together they form a unique fingerprint.

Cite this