TY - JOUR
T1 - OFF-eNET: An optimally fused fully end-to-end network for automatic dense volumetric 3D intracranial blood vessels segmentation
AU - Nazir, Anam
AU - Cheema, Muhammad Nadeem
AU - Sheng, Bin
AU - Li, Huating
AU - Li, Ping
AU - Yang, Po
AU - Jung, Younhyun
AU - Qin, Jing
AU - Kim, Jinman
AU - Feng, David Dagan
N1 - Funding Information:
Manuscript received September 25, 2019; revised March 7, 2020 and April 30, 2020; accepted June 1, 2020. Date of publication June 9, 2020; date of current version July 8, 2020. This work was supported in part by the National Natural Science Foundation of China under Grant 61872241 and Grant 61572316, in part by the Science and Technology Commission of Shanghai Municipality under Grant 18410750700, Grant 17411952600, and Grant 16DZ0501100, in part by the Hong Kong Research Grants Council under Grant PolyU 152035/17E, and in part by The Hong Kong Polytechnic University under Grant P0030419 and Grant P0030929. The associate editor coordinating the review of this manuscript and approving it for publication was Prof. Xudong Jiang. (Corresponding authors: Bin Sheng; Huating Li.) Anam Nazir, Muhammad Nadeem Cheema, and Bin Sheng are with the Department of Computer Science and Engineering, Shanghai Jiao Tong University, Shanghai 200240, China (e-mail: [email protected]).
Publisher Copyright:
© 1992-2012 IEEE.
PY - 2020/7
Y1 - 2020/7
N2 - Intracranial blood vessels segmentation from computed tomography angiography (CTA) volumes is a promising biomarker for diagnosis and therapeutic treatment in cerebrovascular diseases. These segmentation outputs are a fundamental requirement in the development of automated decision support systems for preoperative assessment or intraoperative guidance in neuropathology. The state-of-the-art in medical image segmentation methods are reliant on deep learning architectures based on convolutional neural networks. However, despite their popularity, there is a research gap in the current deep learning architectures optimized to address the technical challenges in blood vessel segmentation. These challenges include: (i) the extraction of concrete brain vessels close to the skull; and (ii) the precise marking of the vessel locations. We propose an Optimally Fused Fully end-to-end Network (OFF-eNET) for automatic segmentation of the volumetric 3D intracranial vascular structures. OFF-eNET comprises of three modules. In the first module, we exploit the up-skip connections to enhance information flow, and dilated convolution for detailed preservation of spatial feature map that are designed for thin blood vessels. In the second module, we employ residual mapping along with inception module for speedy network convergence and richer visual representation. For the third module, we make use of the transferred knowledge in the form of cascaded training strategy to gradually optimize the three segmentation stages (basic, complete, and enhanced) to segment thin vessels located close to the skull. All these modules are designed to be computationally efficient. Our OFF-eNET, evaluated using 70 CTA image volumes, resulted in 90.75% performance in the segmentation of intracranial blood vessels and outperformed the state-of-the-art counterparts.
AB - Intracranial blood vessels segmentation from computed tomography angiography (CTA) volumes is a promising biomarker for diagnosis and therapeutic treatment in cerebrovascular diseases. These segmentation outputs are a fundamental requirement in the development of automated decision support systems for preoperative assessment or intraoperative guidance in neuropathology. The state-of-the-art in medical image segmentation methods are reliant on deep learning architectures based on convolutional neural networks. However, despite their popularity, there is a research gap in the current deep learning architectures optimized to address the technical challenges in blood vessel segmentation. These challenges include: (i) the extraction of concrete brain vessels close to the skull; and (ii) the precise marking of the vessel locations. We propose an Optimally Fused Fully end-to-end Network (OFF-eNET) for automatic segmentation of the volumetric 3D intracranial vascular structures. OFF-eNET comprises of three modules. In the first module, we exploit the up-skip connections to enhance information flow, and dilated convolution for detailed preservation of spatial feature map that are designed for thin blood vessels. In the second module, we employ residual mapping along with inception module for speedy network convergence and richer visual representation. For the third module, we make use of the transferred knowledge in the form of cascaded training strategy to gradually optimize the three segmentation stages (basic, complete, and enhanced) to segment thin vessels located close to the skull. All these modules are designed to be computationally efficient. Our OFF-eNET, evaluated using 70 CTA image volumes, resulted in 90.75% performance in the segmentation of intracranial blood vessels and outperformed the state-of-the-art counterparts.
KW - computed tomography angiography
KW - Convolution neural network
KW - dilated convolution
KW - inception module
KW - intracranial vessels segmentation
KW - up-skip connection
UR - http://www.scopus.com/inward/record.url?scp=85088140648&partnerID=8YFLogxK
U2 - 10.1109/TIP.2020.2999854
DO - 10.1109/TIP.2020.2999854
M3 - Journal article
AN - SCOPUS:85088140648
SN - 1057-7149
VL - 29
SP - 7192
EP - 7202
JO - IEEE Transactions on Image Processing
JF - IEEE Transactions on Image Processing
ER -