Slake: A semantically-labeled knowledge-enhanced dataset for medical visual question answering

Bo Liu, Li Ming Zhan, Li Xu, Lin Ma, Yan Yang, Xiao Ming Wu

Research output: Chapter in book / Conference proceedingConference article published in proceeding or bookAcademic researchpeer-review

109 Citations (Scopus)

Abstract

Medical visual question answering (Med-VQA) has tremendous potential in healthcare. However, the development of this technology is hindered by the lacking of publicly-available and high-quality labeled datasets for training and evaluation. In this paper, we present a large bilingual dataset, SLAKE, with comprehensive semantic labels annotated by experienced physicians and a new structural medical knowledge base for Med-VQA. Besides, SLAKE includes richer modalities and covers more human body parts than the currently available dataset. We show that SLAKE can be used to facilitate the development and evaluation of Med-VQA systems. The dataset can be downloaded from http://www.med-vqa.com/slake.

Original languageEnglish
Title of host publication2021 IEEE 18th International Symposium on Biomedical Imaging, ISBI 2021
PublisherIEEE Computer Society
Pages1650-1654
Number of pages5
ISBN (Electronic)9781665412469
DOIs
Publication statusPublished - 13 Apr 2021
Event18th IEEE International Symposium on Biomedical Imaging, ISBI 2021 - Nice, France
Duration: 13 Apr 202116 Apr 2021

Publication series

NameProceedings - International Symposium on Biomedical Imaging
Volume2021-April
ISSN (Print)1945-7928
ISSN (Electronic)1945-8452

Conference

Conference18th IEEE International Symposium on Biomedical Imaging, ISBI 2021
Country/TerritoryFrance
CityNice
Period13/04/2116/04/21

Keywords

  • Dataset
  • Medical visual question answering
  • Multi-modality fusion.

ASJC Scopus subject areas

  • Biomedical Engineering
  • Radiology Nuclear Medicine and imaging

Fingerprint

Dive into the research topics of 'Slake: A semantically-labeled knowledge-enhanced dataset for medical visual question answering'. Together they form a unique fingerprint.

Cite this