Color-appearance-model based fusion of gray and pseudo-color images for medical applications

Tianjie Li, Yuanyuan Wang, Cai Chang, Na Hu, Yongping Zheng

Research output: Journal article publicationJournal articleAcademic researchpeer-review

12 Citations (Scopus)

Abstract

Fusion of gray and pseudo-color images presents more information of biological tissues in a single image and facilitates the interpretation of multimodalities in medical practice. However, fused results are hampered by the problems of blurred details, faded color and artifact contours. This paper reports a method to solve the problems by precisely predicting the attributes of color perception using the color appearance model of International Commission on Illumination published in 2002 (CIECAM02). First, a rainbow palette is generated from the color attributes. It is uniform in lightness, and thus the valuable information of pseudo-color image can be totally sealed in its chromatic properties. Then the fusion process is carried out with the adjustment of gray image in lightness. Here, the predicted hue and saturation of pseudo-color image is merged with the predicted lightness of gray one. Therefore, information of two original images exists separately in achromatic and chromatic properties of the resulting image. Based on different color spaces (CSs) and color appearance models (CAMs), the color aggregations available for displaying fused images are presented and compared. The aggregation based on the CIECAM02 exhibited more uniform variation in lightness and hue. Fused results of simulated lesion and breast phantom manifested the compromise between the scope of gray and the perception of color. Furthermore, in the quantitative experiment on 49 sets of simulated ultrasound and strain images, the visual information fidelity (VIF) was applied to assess the similarity between the result and its sources. It revealed the superiority of the proposed method over the traditional ones including CSs-based methods, transparency technique, alternating display technique, frequency encoding methods, and maximum-selection-rule based rules. The results of two clinical cases demonstrated its practicality in medical applications. Besides, its feasibility in fusing two high-resolution structural images was preliminarily approved based on the simulated MRI data.
Original languageEnglish
Pages (from-to)103-114
Number of pages12
JournalInformation Fusion
Volume19
Issue number1
DOIs
Publication statusPublished - 1 Jan 2014

Keywords

  • Biomedical image fusion
  • CIECAM02
  • Color appearance model (CAM)
  • Magnetic resonance imaging (MRI)
  • Rainbow palette
  • Ultrasound

ASJC Scopus subject areas

  • Software
  • Signal Processing
  • Information Systems
  • Hardware and Architecture

Cite this