Uniform and effective tagging of a heterogeneous giga-word corpus

Wei Yun Ma; Chu Ren Huang

Uniform and effective tagging of a heterogeneous giga-word corpus

Research output: Unpublished conference presentation (presented paper, abstract, poster) › Conference presentation (not published in journal/proceeding/book) › Academic research › peer-review

23 Citations (Scopus)

Abstract

Tagging as the most crucial annotation of language resources can still be challenging when the corpus size is big and when the corpus data is not homogeneous. The Chinese Gigaword Corpus is confounded by both challenges. The corpus contains roughly 1.12 billion Chinese characters from two heterogeneous sources: respective news in Taiwan and in Mainland China. In other words, in addition to its size, the data also contains two variants of Chinese that are known to exhibit substantial linguistic differences. We utilize Chinese Sketch Engine as the corpus query tool, by which grammar behaviours of the two heterogeneous resources could be captured and displayed in a unified web interface. In this paper, we report our answer to the two challenges to effectively tag this large-scale corpus. The evaluation result shows our mechanism of tagging maintains high annotation quality.

Original language	English
Pages	2182-2185
Number of pages	4
Publication status	Published - 1 Jan 2006
Externally published	Yes
Event	5th International Conference on Language Resources and Evaluation, LREC 2006 - Genoa, Italy Duration: 22 May 2006 → 28 May 2006

Conference

Conference	5th International Conference on Language Resources and Evaluation, LREC 2006
Country/Territory	Italy
City	Genoa
Period	22/05/06 → 28/05/06

ASJC Scopus subject areas

Education
Library and Information Sciences
Linguistics and Language
Language and Linguistics

Cite this

@conference{18f33d92e1b74a1b807d33364aa824b7,

title = "Uniform and effective tagging of a heterogeneous giga-word corpus",

abstract = "Tagging as the most crucial annotation of language resources can still be challenging when the corpus size is big and when the corpus data is not homogeneous. The Chinese Gigaword Corpus is confounded by both challenges. The corpus contains roughly 1.12 billion Chinese characters from two heterogeneous sources: respective news in Taiwan and in Mainland China. In other words, in addition to its size, the data also contains two variants of Chinese that are known to exhibit substantial linguistic differences. We utilize Chinese Sketch Engine as the corpus query tool, by which grammar behaviours of the two heterogeneous resources could be captured and displayed in a unified web interface. In this paper, we report our answer to the two challenges to effectively tag this large-scale corpus. The evaluation result shows our mechanism of tagging maintains high annotation quality.",

author = "Ma, {Wei Yun} and Huang, {Chu Ren}",

year = "2006",

month = jan,

day = "1",

language = "English",

pages = "2182--2185",

note = "5th International Conference on Language Resources and Evaluation, LREC 2006 ; Conference date: 22-05-2006 Through 28-05-2006",

}

Uniform and effective tagging of a heterogeneous giga-word corpus. / Ma, Wei Yun; Huang, Chu Ren.
2006. 2182-2185 Paper presented at 5th International Conference on Language Resources and Evaluation, LREC 2006, Genoa, Italy.

Research output: Unpublished conference presentation (presented paper, abstract, poster) › Conference presentation (not published in journal/proceeding/book) › Academic research › peer-review

TY - CONF

T1 - Uniform and effective tagging of a heterogeneous giga-word corpus

AU - Ma, Wei Yun

AU - Huang, Chu Ren

PY - 2006/1/1

Y1 - 2006/1/1

N2 - Tagging as the most crucial annotation of language resources can still be challenging when the corpus size is big and when the corpus data is not homogeneous. The Chinese Gigaword Corpus is confounded by both challenges. The corpus contains roughly 1.12 billion Chinese characters from two heterogeneous sources: respective news in Taiwan and in Mainland China. In other words, in addition to its size, the data also contains two variants of Chinese that are known to exhibit substantial linguistic differences. We utilize Chinese Sketch Engine as the corpus query tool, by which grammar behaviours of the two heterogeneous resources could be captured and displayed in a unified web interface. In this paper, we report our answer to the two challenges to effectively tag this large-scale corpus. The evaluation result shows our mechanism of tagging maintains high annotation quality.

AB - Tagging as the most crucial annotation of language resources can still be challenging when the corpus size is big and when the corpus data is not homogeneous. The Chinese Gigaword Corpus is confounded by both challenges. The corpus contains roughly 1.12 billion Chinese characters from two heterogeneous sources: respective news in Taiwan and in Mainland China. In other words, in addition to its size, the data also contains two variants of Chinese that are known to exhibit substantial linguistic differences. We utilize Chinese Sketch Engine as the corpus query tool, by which grammar behaviours of the two heterogeneous resources could be captured and displayed in a unified web interface. In this paper, we report our answer to the two challenges to effectively tag this large-scale corpus. The evaluation result shows our mechanism of tagging maintains high annotation quality.

UR - http://www.scopus.com/inward/record.url?scp=85037083616&partnerID=8YFLogxK

M3 - Conference presentation (not published in journal/proceeding/book)

AN - SCOPUS:85037083616

SP - 2182

EP - 2185

T2 - 5th International Conference on Language Resources and Evaluation, LREC 2006

Y2 - 22 May 2006 through 28 May 2006

ER -

Uniform and effective tagging of a heterogeneous giga-word corpus

Abstract

Conference

ASJC Scopus subject areas

Other files and links

Fingerprint

Cite this