Entropy-based syntactic tree analysis for text classification: a novel approach to distinguishing between original and translated Chinese texts

Zhongliang Wang, Andrew K.F. Cheung, Kanglong Liu (Corresponding Author)

Research output: Journal article publicationJournal articleAcademic researchpeer-review

1 Citation (Scopus)

Abstract

This research focuses on classifying translated and non-translated Chinese texts by analyzing syntactic rule features, using an integrated approach of machine learning and entropy analysis. The methodology employs information entropy to gauge the complexity of syntactic rules in both text types. The methodology is based on the concept of information entropy, which serves as a quantitative measure for the complexity inherent in syntactic rules as manifested from tree-based annotations. The goal of the study is to explore whether translated Chinese texts demonstrate syntactic characteristics that are significantly different from those of non-translated texts, thereby permitting a reliable classification between the two. To do this, the research calculates information entropy values for syntactic rules in two comparable corpora, one of translated and the other of non-translated Chinese texts. Then, various machine learning models are applied to these entropy metrics to identify any significant differences between the two groups. The results show significant differences in the syntactic structures. Translated texts have a higher degree of entropy, indicating more complex syntactic constructs compared to non-translated texts. These findings contribute to our understanding of the effect of translation on language syntax, with implications for text classification and translation studies.

Original languageEnglish
Article numberfqae030
Pages (from-to)984-1000
Number of pages17
JournalDigital Scholarship in the Humanities
Volume39
Issue number3
Early online date5 Jun 2024
DOIs
Publication statusPublished - 1 Sept 2024

Keywords

  • entropy
  • machine learning
  • syntactic rules
  • text classification
  • translation studies

ASJC Scopus subject areas

  • Information Systems
  • Language and Linguistics
  • Linguistics and Language
  • Computer Science Applications

Fingerprint

Dive into the research topics of 'Entropy-based syntactic tree analysis for text classification: a novel approach to distinguishing between original and translated Chinese texts'. Together they form a unique fingerprint.

Cite this