Motion Feature Extraction and Stylization for Character Animation using Hilbert-Huang Transform

Ran Dong, Yangfei Lin (Corresponding Author), Qiong Chang, Junpei Zhong, Dongsheng Cai, Soichiro Ikuno

Research output: Chapter in book / Conference proceedingConference article published in proceeding or bookAcademic researchpeer-review

1 Citation (Scopus)

Abstract

This paper presents novel insights to feature extraction and stylization of character motion in the instantaneous frequency domain by proposing a method using the Hilbert-Huang transform (HHT). HHT decomposes human motion capture data in the frequency domain into several pseudo monochromatic signals, so-called intrinsic mode functions (IMFs). We propose an algorithm to reconstruct these IMFs and extract motion features automatically using the Fibonacci sequence in the link-dynamical structure of the human body. Our research revealed that these reconstructed motions could be mainly divided into three parts, a primary motion and a secondary motion, corresponding to the animation principles, and a basic motion consisting of posture and position. Our method help animators edit target motions by extracting and blending the primary or secondary motions extracted from a source motion. To demonstrate results, we applied our proposed method to general motions (jumping, punching, and walking motions) to achieve different stylizations.

Original languageEnglish
Title of host publicationProceedings of 2021 ACM International Conference on Intelligent Computing and its Emerging Applications, ICEA 2021
PublisherAssociation for Computing Machinery
Pages16-21
Number of pages6
ISBN (Electronic)9781450391603
DOIs
Publication statusPublished - 28 Dec 2021
Event2021 ACM International Conference on Intelligent Computing and its Emerging Applications, ICEA 2021 - Virtual, Online, China
Duration: 28 Dec 202129 Dec 2021

Publication series

NameACM International Conference Proceeding Series

Conference

Conference2021 ACM International Conference on Intelligent Computing and its Emerging Applications, ICEA 2021
Country/TerritoryChina
CityVirtual, Online
Period28/12/2129/12/21

Keywords

  • biomechanics
  • deep learning
  • feature extraction
  • Hilbert-Huang transform
  • motion stylization

ASJC Scopus subject areas

  • Software
  • Human-Computer Interaction
  • Computer Vision and Pattern Recognition
  • Computer Networks and Communications

Cite this