iRANK: A rank-learn-combine framework for unsupervised ensemble ranking

Furu Wei, Wenjie Li, Shixia Liu

Research output: Journal article publicationJournal articleAcademic researchpeer-review

26 Citations (Scopus)

Abstract

The authors address the problem of unsupervised ensemble ranking. Traditional approaches either combine multiple ranking criteria into a unified representation to obtain an overall ranking score orto utilize certain rank fusion or aggregation techniques to combine the ranking results. Beyond the aforementioned "combine-thenrank" and "rank-then-combine" approaches, the authors propose a novel "rank-learn-combine" ranking framework, called Interactive Ranking (iRANK), which allows two base rankers to "teach" each other before combination during the ranking process by providing their own ranking results as feedback to the others to boost the ranking performance. This mutual ranking refinement process continues until the two base rankers cannot learn from each other any more. The overall performance is improved by the enhancement of the base rankers through the mutual learning mechanism. The authors further design two ranking refinement strategies to efficiently and effectively use the feedback based on reasonable assumptions and rational analysis. Although iRANK is applicable to many applications, as a case study, they apply this framework to the sentence ranking problem in query-focused summarization and evaluate its effectiveness on the DUC 2005 and 2006 data sets. The results are encouraging with consistent and promising improvements.
Original languageEnglish
Pages (from-to)1232-1243
Number of pages12
JournalJournal of the American Society for Information Science and Technology
Volume61
Issue number6
DOIs
Publication statusPublished - 1 Jun 2010

ASJC Scopus subject areas

  • Software
  • Information Systems
  • Human-Computer Interaction
  • Computer Networks and Communications
  • Artificial Intelligence

Cite this