一种用于脑肿瘤分割的改进U形网络

An improved U-shaped network for brain tumor segmentation

  • 摘要: 近年来卷积神经网络在生物医学图像处理中得到了广泛应用,例如从磁共振图像中准确分割脑肿瘤是临床诊断和治疗脑部肿瘤疾病的关键环节。3D U-Net因其分割效果优异受到追捧,但其跳跃连接补充的特征图为编码器特征提取后的输出特征图,并未进一步考虑到此过程中的原始细节信息丢失问题。针对这一问题,本文提出前置跳跃连接,并在此基础上设计了一种前置跳跃连接倒残差U形网络(FS Inv-Res U-Net)。首先,将前置跳跃连接用于改进DMF Net、HDC Net和3D U-Net 3个典型网络以验证其有效性和泛化性;其次,采用前置跳跃连接和倒残差结构改进3D U-Net,进而提出FS Inv-Res U-Net,最后在BraTS公开验证集上对所提网络进行验证。BraTS2018的验证结果在增强型肿瘤、全肿瘤和肿瘤核心的Dice值分别是80.23%、90.30%和85.45%,豪斯多夫距离分别是2.35、4.77和5.50 mm;BraTS2019的验证结果在增强型肿瘤、全肿瘤和肿瘤核心的Dice值分别是78.38%、89.78%和83.01%,豪斯多夫距离分别是4、5.57和6.37 mm。结果表明,FS Inv-Res U-Net取得了不输于先进网络的评价指标,能够实现脑肿瘤精确分割。

     

    Abstract: Accurate segmentation of brain tumors from magnetic resonance images is the key to the clinical diagnosis and rational treatment of brain tumor diseases. Recently, convolutional neural networks have been widely used in biomedical image processing. 3D U-Net is sought after because of its excellent segmentation effect; however, the feature map supplemented by the skip connection is the output feature map after the encoder feature extraction, and the loss of original detail information in this process is ignored. In the 3D U-Net design, after each layer of convolution, regularization, and activation function processing, the detailed information contained in the feature map will deviate from the original detailed information. For skip connections, the essence of this design is to supplement the detailed information of the original features to the decoder; that is, in the decoder stage, the more original the skip connection-supplemented feature maps are, the more easily the decoder can achieve a better segmentation effect. To address this problem, this paper proposes the concept of a front-skip connection. That is, the starting point of the skip connection is adjusted to the front to improve the network performance. On the basis of this idea, we design a front-skip connection inverted residual U-shaped network (FS Inv-Res U-Net). First, the front-skip connections are applied to three typical networks, DMF Net, HDC Net, and 3D U-Net, to verify their effectiveness and generalization. Applying our proposed front-skip connection concept on these three networks improves the network performance, indicating that the idea of a front-skip connection is simple but powerful and has out-of-the-box characteristics. Second, 3D U-Net is enhanced using the front-skip connection concept and the inverted residual structure of MobileNet, and then FS Inv-Res U-Net is proposed based on these two ideas. Additionally, ablation experiments are conducted on FS Inv-Res U-Net. After adding the front-skip connection and the inverted residual module to the backbone network 3D U-Net, the segmentation performance of the proposed network is greatly improved, indicating that the front-skip connection and the inverted residual module help our brain tumor segmentation network. Finally, the proposed network is validated on the validation dataset of the public datasets BraTS 2018 and BraTS 2019. The Dice scores of the validation results on the enhanced tumor, whole tumor, and tumor core were 80.23%, 90.30%, and 85.45% and 78.38%, 89.78%, and 83.01%, respectively; the hausdorff95 distances were 2.35, 4.77, and 5.50 mm and 4, 5.57, and 6.37 mm, respectively. The above results show that the FS Inv-Res U-Net proposed in this paper achieves the same evaluation indicators as advanced networks and provides accurate brain tumor segmentations.

     

/

返回文章
返回