Combining weighted category-aware contextual information in convolutional neural networks for text classification

Xin Wu, Yi Cai, Qing Li, Jingyun Xu, Ho fung Leung

Research output: Journal article publicationJournal articleAcademic researchpeer-review

Abstract

Convolutional neural networks (CNNs) are widely used in many natural language processing tasks, which employ some convolutional filters to capture useful semantic features of a text. However, a small window size convolutional filter is short of the ability to capture contextual information, simply increasing the window size may bring the problems of data sparsity and enormous parameters. To capture the contextual information, we propose to use the weighted sum operation to obtain contextual word representation. We present one implicit weighting method and two explicit category-aware weighting methods to assign the weights of the contextual information. Experimental results on five text classification datasets show the effectiveness of our proposed methods.

Original languageEnglish
Pages (from-to)2815-2834
Number of pages20
JournalWorld Wide Web
Volume23
Issue number5
DOIs
Publication statusPublished - 1 Sep 2020

Keywords

  • Contextual information
  • Convolutional neural networks
  • Text classification
  • Word representation

ASJC Scopus subject areas

  • Software
  • Hardware and Architecture
  • Computer Networks and Communications

Cite this