Abstract
Deep parsing of Chinese sentences is a very challenging task due to their complexity such as ambiguous word boundaries and meanings. An alternative mode of Chinese language processing is to perform shallow parsing of Chinese sentences in which chunk segmentation plays an important role. In this paper, we present a chunk segmentation algorithm using a combined statistical and rule-based approach (CSRA). The decision rules for refining chunk segmentation are generated from incorrectly segmented chunks from a statistical model which is built on a training corpus. Experimental results show that the CSRA works well and produces satisfactory chunk segmentation results for subsequent processes such as chunk tagging and chunk collocation extraction.
Original language | English |
---|---|
Pages (from-to) | 197-218 |
Number of pages | 22 |
Journal | International journal of computer processing of languages |
Volume | 20 |
Issue number | 2 |
DOIs | |
Publication status | Published - 2007 |
Keywords
- Chinese language processing
- Chinese chunk segmentation
- Machine translation
- Language modeling
- Decision rules