Representation learning of multiword expressions with compositionality constraint

Minglei Li, Qin Lu, Yunfei Long

Research output: Chapter in book / Conference proceedingConference article published in proceeding or bookAcademic researchpeer-review

4 Citations (Scopus)

Abstract

Representations of multiword expressions (MWE) are currently learned either from context external to MWEs based on the distributional hypothesis or from the representations of component words based on some composition functions using the compositional hypothesis. However, a distributional method treats MWEs as a non-divisible unit without consideration of component words. Distributional methods also have the data sparseness problem, especially for MWEs. On the other hand, a compositional method can fail if a MWE is non-compositional. In this paper, we propose a hybrid method to learn the representation of MWEs from their external context and component words with a compositionality constraint. This method can make use of both the external context and component words. Instead of simply combining the two kinds of information, we use compositionality measure from lexical semantics to serve as the constraint. The main idea is to learn MWE representations based on a weighted linear combination of both external context and component words, where the weight is based on the compositionality of MWEs. Evaluation on three datasets shows that the performance of this hybrid method is more robust and can improve the representation.
Original languageEnglish
Title of host publicationKnowledge Science, Engineering and Management - 10th International Conference, KSEM 2017, Proceedings
PublisherSpringer Verlag
Pages507-519
Number of pages13
ISBN (Print)9783319635576
DOIs
Publication statusPublished - 1 Jan 2017
Event10th International Conference on Knowledge Science, Engineering and Management, KSEM 2017 - Melbourne, Australia
Duration: 19 Aug 201720 Aug 2017

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume10412 LNAI
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference10th International Conference on Knowledge Science, Engineering and Management, KSEM 2017
Country/TerritoryAustralia
CityMelbourne
Period19/08/1720/08/17

ASJC Scopus subject areas

  • Theoretical Computer Science
  • Computer Science(all)

Cite this