Evaluating the Diagnostic Performance of Large Language Models on Complex Multimodal Medical Cases

Wan Hang Keith Chiu; Wei Sum Koel Ko; William Chi Shing Cho; Sin Yu Joanne Hui; Wing Chi Lawrence Chan; Michael D. Kuo

doi:10.2196/53724

Evaluating the Diagnostic Performance of Large Language Models on Complex Multimodal Medical Cases

Wan Hang Keith Chiu
, Wei Sum Koel Ko
, William Chi Shing Cho
, Sin Yu Joanne Hui
, Wing Chi Lawrence Chan
, Michael D. Kuo

Department of Health Technology and Informatics

Research output: Journal article publication › Journal article › Academic research › peer-review

10 Citations (Scopus)

Abstract

Large language models showed interpretative reasoning in solving diagnostically challenging medical cases.

Original language	English
Article number	e53724
Journal	Journal of Medical Internet Research
Volume	26
DOIs	https://doi.org/10.2196/53724
Publication status	Published - 13 May 2024

Keywords

ANOVA
chi-square
clinician
disease etiology
health center
hospital
large language model
Massachusetts
performance
physician
proficiency
statistical analysis

ASJC Scopus subject areas

Health Informatics

More information

10.2196/53724

Cite this

@article{cf5f9c4b3d78477bbc4c561ecf96fb60,

title = "Evaluating the Diagnostic Performance of Large Language Models on Complex Multimodal Medical Cases",

abstract = "Large language models showed interpretative reasoning in solving diagnostically challenging medical cases.",

keywords = "ANOVA, chi-square, clinician, disease etiology, health center, hospital, large language model, Massachusetts, performance, physician, proficiency, statistical analysis",

author = "Chiu, \{Wan Hang Keith\} and Ko, \{Wei Sum Koel\} and Cho, \{William Chi Shing\} and Hui, \{Sin Yu Joanne\} and Chan, \{Wing Chi Lawrence\} and Kuo, \{Michael D.\}",

year = "2024",

month = may,

day = "13",

doi = "10.2196/53724",

language = "English",

volume = "26",

journal = "Journal of Medical Internet Research",

issn = "1439-4456",

publisher = "JMIR Publications Inc.",

}

TY - JOUR

T1 - Evaluating the Diagnostic Performance of Large Language Models on Complex Multimodal Medical Cases

AU - Chiu, Wan Hang Keith

AU - Ko, Wei Sum Koel

AU - Cho, William Chi Shing

AU - Hui, Sin Yu Joanne

AU - Chan, Wing Chi Lawrence

AU - Kuo, Michael D.

PY - 2024/5/13

Y1 - 2024/5/13

N2 - Large language models showed interpretative reasoning in solving diagnostically challenging medical cases.

AB - Large language models showed interpretative reasoning in solving diagnostically challenging medical cases.

KW - ANOVA

KW - chi-square

KW - clinician

KW - disease etiology

KW - health center

KW - hospital

KW - large language model

KW - Massachusetts

KW - performance

KW - physician

KW - proficiency

KW - statistical analysis

UR - https://www.scopus.com/pages/publications/85192923470

U2 - 10.2196/53724

DO - 10.2196/53724

M3 - Journal article

C2 - 38739441

AN - SCOPUS:85192923470

SN - 1439-4456

VL - 26

JO - Journal of Medical Internet Research

JF - Journal of Medical Internet Research

M1 - e53724

ER -

Evaluating the Diagnostic Performance of Large Language Models on Complex Multimodal Medical Cases

Abstract

Keywords

ASJC Scopus subject areas

More information

Other files and links

Fingerprint

Cite this