Unbiased feature position alignment for human pose estimation

Chen Wang, Yanghong Zhou, Feng Zhang, P. Y. Mok

Research output: Journal article publicationJournal articleAcademic researchpeer-review

1 Citation (Scopus)

Abstract

Multi-scale feature fusion is a commonly-used module in existing deep-learning models, and feature misalignment occurs in the process of feature fusion. The spatial misalignment hinders the learning of semantic representation with multi-scale levels, but which has not received much attention. This misalignment problem is caused by the feature position shift after using the convolution and interpolation operation in feature fusion. To solve the misalignment problem, this paper formulates the shift error mathematically and proposes a plug-and-play unbiased feature position alignment strategy to align convolution with interpolation. As a model-agnostic approach, unbiased feature position alignment can boost the performance of different models without introducing extra parameters. Furthermore, the unbiased feature position alignment is applied to build an unbiased human pose estimation method. Experimental results have demonstrated the effectiveness of the proposed unbiased pose model in comparison to the state-of-the-arts, especially in the low-resolution field. The codes are shared at https://github.com/WangChen100/Unbiased-Feature-Position-Alignment-for-Human-Pose-Estimation.

Original languageEnglish
Pages (from-to)152-163
Number of pages12
JournalNeurocomputing
Volume537
DOIs
Publication statusPublished - 7 Jun 2023

Keywords

  • Human pose estimation
  • Multi-scale fusion
  • Position misalignment
  • Unbiased feature position alignment
  • Unbiased human pose model

ASJC Scopus subject areas

  • Computer Science Applications
  • Cognitive Neuroscience
  • Artificial Intelligence

Fingerprint

Dive into the research topics of 'Unbiased feature position alignment for human pose estimation'. Together they form a unique fingerprint.

Cite this