Fast scene labeling via structural inference

Huaidong Zhang, Chu Han, Xiaodan Zhang, Yong Du, Xuemiao Xu, Guoqiang Han, Jing Qin, Shengfeng He

Research output: Journal article publicationJournal articleAcademic researchpeer-review

1 Citation (Scopus)


Scene labeling or parsing aims to assign pixelwise semantic labels for an input image. Existing CNN-based models cannot leverage the label dependencies, while RNN-based models predict labels within the local context. In this paper, we propose a fast LSTM scene labeling network via structural inference. A minimum spanning tree is used to build the image structure for constructing semantic relationships. This structure allows efficient generation of direct parent–child dependencies for arbitrary levels of superpixels, and thus structural relationships can be learned with LSTM. In particular, we propose a bi-directional recurrent network to model the information flow along the parent–child path. In this way, the recurrent units in both coarse and fine levels can mutually transfer the global and local context information in the entire image structure. The proposed network is extremely fast, and it is 2.5× faster than the state-of-the-art RNN-based models. Extensive expseriments demonstrate that the proposed method provides a significant improvement in learning the label dependencies, and it outperforms state-of-the-art methods on different benchmarks.

Original languageEnglish
Pages (from-to)317-326
Number of pages10
Publication statusPublished - 28 Jun 2021


  • LSTM
  • Scene labeling
  • Structural inference

ASJC Scopus subject areas

  • Computer Science Applications
  • Cognitive Neuroscience
  • Artificial Intelligence


Dive into the research topics of 'Fast scene labeling via structural inference'. Together they form a unique fingerprint.

Cite this