Skip to main navigation Skip to search Skip to main content

Difficulty-Controllable Visual Question Generation

  • Feng Chen
  • , Jiayuan Xie
  • , Yi Cai
  • , Tao Wang
  • , Qing Li

Research output: Chapter in book / Conference proceeding › Conference article published in proceeding or book › Academic research › peer-review

Abstract

Visual Question Generation (VQG) aims to generate questions from images. Existing studies on this topic focus on generating questions solely based on images while neglecting the difficulty of questions. However, to engage users, an automated question generator should produce questions with a level of difficulty that are tailored to a user’s capabilities and experience. In this paper, we propose a Difficulty-controllable Generation Network (DGN) to alleviate this limitation. We borrow difficulty index from education area to define a difficulty variable for representing the difficulty of questions, and fuse it into our model to guide the difficulty-controllable question generation. Experimental results demonstrate that our proposed model not only achieves significant improvements on several automatic evaluation metrics, but also can generate difficulty-controllable questions.

Original languageEnglish
Title of host publicationWeb and Big Data - 5th International Joint Conference, APWeb-WAIM 2021, Proceedings
EditorsLeong Hou U, Marc Spaniol, Yasushi Sakurai, Junying Chen
PublisherSpringer Science and Business Media Deutschland GmbH
Pages332-347
Number of pages16
ISBN (Print)9783030858957
DOIs
Publication statusPublished - Aug 2021
Event5th International Joint Conference on Asia-Pacific Web and Web-Age Information Management, APWeb-WAIM 2021 - Guangzhou, China
Duration: 23 Aug 2021 → 25 Aug 2021

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume12858 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference5th International Joint Conference on Asia-Pacific Web and Web-Age Information Management, APWeb-WAIM 2021
Country/TerritoryChina
CityGuangzhou
Period23/08/21 → 25/08/21

Keywords

  • Difficulty controllable
  • Multimodal
  • Visual question generation

ASJC Scopus subject areas

  • Theoretical Computer Science
  • General Computer Science

Fingerprint

Dive into the research topics of 'Difficulty-Controllable Visual Question Generation'. Together they form a unique fingerprint.

Cite this