Real-time physical modelling of character movements with microsoft kinect

Hubert P.H. Shum*, Shu Lim HO

*Corresponding author for this work

Research output: Chapter in book/report/conference proceedingConference contributionpeer-review

36 Citations (Scopus)

Abstract

With the advancement of motion tracking hardware such as the Microsoft Kinect, synthesizing human-like characters with real-time captured movements becomes increasingly important. Traditional kinematics and dynamics approaches perform sub-optimally when the captured motion is noisy or even incomplete. In this paper, we proposed a unified framework to control physically simulated characters with live captured motion from Kinect. Our framework can synthesize any posture in a physical environment using external forces and torques computed by a PD controller. The major problem of Kinect is the incompleteness of the captured posture, with some degree of freedom (DOF) missing due to occlusions and noises. We propose to search for a best matched posture from a motion database constructed in a dimensionality reduced space, and substitute the missing DOF to the live captured data. Experimental results show that our method can synthesize realistic character movements from noisy captured motion. The proposed algorithm is computationally efficient and can be applied to a wide variety of interactive virtual reality applications such as motion-based gaming, rehabilitation and sport training.

Original languageEnglish
Title of host publicationVRST 2012 - Proceedings of the 18th ACM Symposium on Virtual Reality Software and Technology
PublisherAssociation for Computing Machinery
Pages17-24
Number of pages8
ISBN (Print)9781450314695
DOIs
Publication statusPublished - 2012
Event18th ACM Symposium on Virtual Reality Software and Technology, VRST 2012 - Toronto, ON, Canada
Duration: 10 Dec 201212 Dec 2012

Publication series

NameProceedings of the ACM Symposium on Virtual Reality Software and Technology, VRST

Conference

Conference18th ACM Symposium on Virtual Reality Software and Technology, VRST 2012
Country/TerritoryCanada
CityToronto, ON
Period10/12/1212/12/12

Scopus Subject Areas

  • Software

User-Defined Keywords

  • Microsoft Kinect
  • Physical simulation
  • Real-time motion synthesis
  • Virtual reality

Fingerprint

Dive into the research topics of 'Real-time physical modelling of character movements with microsoft kinect'. Together they form a unique fingerprint.

Cite this