Learning Fine-Grained Information with Capsule-Wise Attention for Salient Object Detection

Sanyuan Zhao, Zongzheng Wen, Qi Qi, Kin Man Lam, Jianbing Shen

Research output: Journal article publicationJournal articleAcademic researchpeer-review

2 Citations (Scopus)


With the popularity of convolutional neural networks being used for salient object detection (SOD), the performance has been significantly improved. However, how to integrate crucial features for modeling salient objects needs further exploration. In this work, we propose an effective feature selection scheme to solve this task. Firstly, we provide a Simplified Atrous Spatial Pyramid Pooling (SASPP) module to lightweight the multi-scale features. Dealing with the SASSP features, we design a pixel-level local feature selection scheme named Multi-Scale Capsule-wise Attention (MSCA). It aggregates features from multi-scales by dynamic routing and helps the network to generate fine-grained prediction maps. In addition, we exploit holistic features by the Spatial-wise Attention and Channel-wise Attention (SA/CA) mechanisms, which adaptively extracts spatial or channel information. We also propose a Multi-crossed Layer Connections (MLC) structure in the upsampling stage, to fuse features from not only different levels but also different scales. The salient object prediction is performed in a coarse-to-fine manner. By conducting comprehensive experiments on five benchmark datasets, our method achieves the best performance when compared to existing state-of-the-art approaches.

Original languageEnglish
Pages (from-to)1-14
Number of pages14
JournalIEEE Transactions on Multimedia
Publication statusAccepted/In press - 2023


  • Capsule-wise attention
  • Context modeling
  • feature attention
  • Feature extraction
  • Fuses
  • Object detection
  • Predictive models
  • salient object detection
  • Task analysis
  • Visualization

ASJC Scopus subject areas

  • Signal Processing
  • Media Technology
  • Computer Science Applications
  • Electrical and Electronic Engineering


Dive into the research topics of 'Learning Fine-Grained Information with Capsule-Wise Attention for Salient Object Detection'. Together they form a unique fingerprint.

Cite this