Describing clothing in human images: A parsing-pose integrated approach

Yanghong Zhou, Runze Li, Yangping Zhou, Pik Yin Mok

Research output: Chapter in book / Conference proceedingConference article published in proceeding or bookAcademic researchpeer-review

Abstract

With the advent of information technology, digital product information grows exponentially. People are exposed to far too much information, and information overload can slow down, instead of speeding up, a simple decision-making process like searching for suitable clothing online. Traditional semantic-based product retrieval may not be effective due to human subjectivity and cognitive differences. In this paper, we propose a method by integrating the state-of-the-arts deep neural models in pose estimation, human parsing and category classification to recognise from human images all clothing items and their fine-grained product category information. The proposed fine-grained clothing classification model can facilitate a wide range of applications such as the automatic annotation of clothing images. The effectiveness of the proposed method is validated through experiment on a real-world dataset.

Original languageEnglish
Title of host publicationMCCSIS 2018 - Multi Conference on Computer Science and Information Systems; Proceedings of the International Conferences on Interfaces and Human Computer Interaction 2018, Game and Entertainment Technologies 2018 and Computer Graphics, Visualization, Computer Vision and Image Processing 2018
EditorsKatherine Blashki, Luis Rodrigues, Yingcai Xiao
PublisherInternational Association for Development of the Information Society (IADIS)
Pages205-213
Number of pages9
ISBN (Print)9789898533791
Publication statusPublished - 1 Jan 2018
Event12th International Conference on Interfaces and Human Computer Interaction 2018, 11th International Conference on Game and Entertainment Technologies 2018 and 12th International Conference on Computer Graphics, Visualization, Computer Vision and Image Processing 2018, part of the Multi Conference on Computer Science and Information Systems 2018, MCCSIS 2018 - Madrid, Spain
Duration: 18 Jul 201820 Jul 2018

Publication series

NameMCCSIS 2018 - Multi Conference on Computer Science and Information Systems; Proceedings of the International Conferences on Interfaces and Human Computer Interaction 2018, Game and Entertainment Technologies 2018 and Computer Graphics, Visualization, Computer Vision and Image Processing 2018
Volume2018-July

Conference

Conference12th International Conference on Interfaces and Human Computer Interaction 2018, 11th International Conference on Game and Entertainment Technologies 2018 and 12th International Conference on Computer Graphics, Visualization, Computer Vision and Image Processing 2018, part of the Multi Conference on Computer Science and Information Systems 2018, MCCSIS 2018
CountrySpain
CityMadrid
Period18/07/1820/07/18

Keywords

  • Clothing recognition
  • Clothing retrieval
  • Deep learning
  • Fine-grained classification
  • Human parsing
  • Pose estimation

ASJC Scopus subject areas

  • Computer Science(all)

Cite this