中文核心期刊华东师范大学学报(自然科学版) ›› 2026, Vol. 2026 ›› Issue (4): 154-164.doi: 10.3969/j.issn.1000-5641.2026.04.016
• • 上一篇
收稿日期:2025-03-10
出版日期:2026-07-25
发布日期:2026-07-18
通讯作者:
方发明
E-mail:fmfang@cs.ecnu.edu.cn
基金资助:
Yuqi LI, Jiaming FAN, Faming FANG*(
), Guixu ZHANG
Received:2025-03-10
Online:2026-07-25
Published:2026-07-18
Contact:
Faming FANG
E-mail:fmfang@cs.ecnu.edu.cn
摘要:
受扫描条件限制, 临床实践中高分辨率 (High-resolution, HR) 磁共振 (Magnetic Resonance, MR) 图像的获取面临显著挑战. 超分辨率 (Super-resolution, SR)作为能够有效提升图像分辨率的后处理方法, 在提升MR图像空间分辨率、辅助临床诊断上有重要意义. 当前的MR图像SR方法主要通过深度神经网络直接建立低分辨率 (Low-resolution, LR) 图像与HR图像间的映射关系, 然而, LR图像在退化过程中丢失了大量高频信息, 仅依赖其有限信息难以实现高质量细节纹理重建. 为提升细节纹理重建精度, 本文首次将码本学习引入MR图像SR领域, 通过码本模块从HR图像学习先验信息, 进而指导LR图像的SR过程. 具体而言, 本文设计了一个含有两阶段的高质量码本先验网络模型 (Codebook Prior Network, CPNet). 在第一阶段, 采用HR图像预训练编码器-解码器网络以提取高质量码本先验; 在第二阶段, 设计了交叉通道注意力融合模块, 以便将第一阶段获得的码本先验融入SR网络. 此外, 为增强网络的特征提取能力, 设计了一个新型门控卷积Transformer块作为网络的基础层. 实验证明了所提SR方法的有效性, 达到了当前先进水平. 尤其是码本先验的引入, 显著提高了网络对细节纹理的恢复能力.
中图分类号:
李宇琦, 范家铭, 方发明, 张桂戌. 基于高质量码本先验的磁共振图像超分辨率方法[J]. 华东师范大学学报(自然科学版), 2026, 2026(4): 154-164.
Yuqi LI, Jiaming FAN, Faming FANG, Guixu ZHANG. High-quality codebook priors for magnetic resonance image super-resolution[J]. J* E* C* N* U* N* S*, 2026, 2026(4): 154-164.
表1
不同方法的定量比较结果"
| 方法 | PSNR (×2)/dB | SSIM (×2) | PSNR (×4)/dB | SSIM (×4) | |||||||
| IXI-T2 | BraTS-T1 | IXI-T2 | BraTS-T1 | IXI-T2 | BraTS-T1 | IXI-T2 | BraTS-T1 | ||||
| 双三次插值 | 29.88 | 34.84 | 24.16 | 28.85 | |||||||
| CSN[ | 38.92 | 40.81 | 30.68 | 35.63 | |||||||
| SwinIR[ | 39.06 | 43.13 | 31.36 | 36.82 | |||||||
| MHCA[ | 38.99 | 42.67 | 30.59 | 37.03 | |||||||
| HAT[ | 39.27 | 43.35 | 0.979 0 | 31.40 | 37.22 | 0.915 5 | 0.962 3 | ||||
| DRCT[ | 38.16 | 43.76 | 0.989 4 | 30.96 | 36.65 | ||||||
| CPNet | 39.69 | 44.58 | 32.26 | 37.84 | |||||||
| 1 | Brown R W, Cheng Y N, Haacke E M, et al. Magnetic resonance imaging: physical principles and sequence design [M]. Hoboken, NJ: John Wiley & Sons, 2014. |
| 2 | Chen W X, Wu S R, Wang S, et al.. Multi-contrast image super-resolution with deformable attention and neighborhood-based feature aggregation (DANCE): applications in anatomic and metabolic MRI. Medical Image Analysis, 2025, 99, 103359. |
| 3 | Muhammad A, Aramvith S, Duangchaemkarn K, et al.. Brain MRI image super-resolution reconstruction: a systematic review. IEEE Access, 2024, 12, 156347- 156362. |
| 4 | Zhao X L, Zhang Y L, Zhang T, et al.. Channel splitting network for single MR image super-resolution. IEEE Transactions on Image Processing, 2019, 28 (11): 5649- 5662. |
| 5 | Wang H Q, Hu X W, Zhao X L, et al.. Wide weighted attention multi-scale network for accurate MR image super-resolution. IEEE Transactions on Circuits and Systems for Video Technology, 2022, 32 (3): 962- 975. |
| 6 | Du X F, He Y F.. Gradient-guided convolutional neural network for MRI image super-resolution. Applied Sciences, 2019, 9 (22): 4874. |
| 7 | Georgescu M I, Ionescu R T, Miron A I, et al. Multimodal multi-head convolutional attention with various kernel sizes for medical image super-resolution [C]// 2023 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV). Piscataway: IEEE, 2023: 2195-2205. |
| 8 | Chen X Y, Wang X T, Zhou J T, et al. Activating more pixels in image super-resolution transformer [C]// 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). Piscataway: IEEE, 2023: 22367-22377. |
| 9 | Dong C, Loy C C, He K M, et al. Learning a deep convolutional network for image super-resolution [M]// Computer Vision – ECCV 2014. Cham: Springer International Publishing, 2014: 184-199. |
| 10 | Liang J Y, Cao J Z, Sun G L, et al. SwinIR: image restoration using Swin Transformer [C]// 2021 IEEE/CVF International Conference on Computer Vision Workshops (ICCVW). Piscataway: IEEE, 2021: 1833-1844. |
| 11 | Zhang Y L, Li K P, Li K, et al. Image super-resolution using very deep residual channel attention networks [C]// Computer Vision – ECCV 2018. Cham: Springer International Publishing, 2018: 294-310. |
| 12 | Hsu C C, Lee C M, Chou Y S. DRCT: saving image super-resolution away from information bottleneck [C]// 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW). Piscataway: IEEE, 2024: 6133-6142. |
| 13 | van den Oord A, Vinyals O, Kavukcuoglu K. Neural discrete representation learning [C]// Proceedings of the 31st International Conference on Neural Information Processing Systems (NIPS). Red Hook, NY: Curran Associates Inc., 2017: 6309-6318. |
| 14 | Chen C F, Shi X Y, Qin Y P, et al. Real-world blind super-resolution via feature matching with implicit high-resolution priors [C]// Proceedings of the 30th ACM International Conference on Multimedia (MM '22). New York: Association for Computing Machinery, 2022: 1329-1338. |
| 15 | Esser P, Rombach R, Ommer B. Taming Transformers for high-resolution image synthesis [C]// Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). Piscataway: IEEE, 2021: 12873-12883. |
| 16 | Liu Y L, Huang T, Dong W S, et al. Low-light image enhancement with multi-stage residue quantization and brightness-aware attention [C]// 2023 IEEE/CVF International Conference on Computer Vision (ICCV). Piscataway: IEEE, 2023: 12140-12149. |
| 17 | Wu R Q, Duan Z P, Guo C L, et al. RIDCP: revitalizing real image dehazing via high-quality codebook priors [C]// 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). Piscataway: IEEE, 2023: 22282-22291. |
| 18 | Yang J C, Wright J, Huang T, et al. Image super-resolution as sparse representation of raw image patches [C]// 2008 IEEE Conference on Computer Vision and Pattern Recognition. Piscataway: IEEE, 2008: 1-8. |
| 19 | Niu B, Wen W, Ren W, et al. Single image super resolution via a holistic attention network [C]// Computer Vision – ECCV 2020. Cham: Springer, 2020. |
| 20 | Dong C, Loy C C, He K M, et al.. Image super-resolution using deep convolutional networks. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2016, 38 (2): 295- 307. |
| 21 | Chen Y H, Xie Y B, Zhou Z W, et al. Brain MRI super resolution using 3D deep densely connected neural networks [C]// 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018). Piscataway: IEEE, 2018: 739-742. |
| 22 | Wang Z W, Liu D, Yang J C, et al. Deep networks for image super-resolution with sparse prior [C]// 2015 IEEE International Conference on Computer Vision (ICCV). Piscataway: IEEE, 2015: 370-378. |
| 23 | Lai W S, Huang J B, Ahuja N, et al. Deep Laplacian pyramid networks for fast and accurate super-resolution [C]// 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Piscataway: IEEE, 2017: 5835-5843. |
| 24 | Zhang Y L, Li K, Li K P, et al. MR image super-resolution with squeeze and excitation reasoning attention network [C]// 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). Piscataway: IEEE, 2021: 13420-13429. |
| 25 | Hua X, Du Z J, Ma J X, et al.. Multi kernel cross sparse graph attention convolutional neural network for brain magnetic resonance imaging super-resolution. Biomedical Signal Processing and Control, 2024, 96, 106444. |
| 26 | Gu Y C, Wang X T, Xie L B, et al. VQFR: blind face restoration with vector-quantized dictionary and parallel decoder [M]// Computer Vision – ECCV 2022. Cham: Springer Nature Switzerland, 2022: 126-143. |
| 27 | Hinton G E, Zemel R. Autoencoders, minimum description length and Helmholtz free energy [C]// Advances in Neural Information Processing Systems (NeurIPS). Cambridge: MIT Press, 1993. |
| 28 | Tang H, Zhou Y B, Chen Y B, et al.. Two-stage image colorization via color codebook. Expert Systems with Applications, 2024, 250, 123943. |
| 29 | Chan K C K, Wang X T, Xu X Y, et al. GLEAN: generative latent bank for large-factor image super-resolution [C]// 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). Piscataway: IEEE, 2021: 14240-14249. |
| 30 | Li A, Zhang L, Liu Y, et al. Feature modulation Transformer: cross-refinement of global representation via high-frequency prior for image super-resolution [C]// 2023 IEEE/CVF International Conference on Computer Vision (ICCV). Piscataway: IEEE, 2023: 12480-12490. |
| 31 | Chen L Y, Chu X J, Zhang X Y, et al. Simple baselines for image restoration [M]// Computer Vision – ECCV 2022. Cham: Springer Nature Switzerland, 2022: 17-33. |
| 32 | Zamir S W, Arora A, Khan S, et al. Restormer: efficient Transformer for high-resolution image restoration [C]// 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). Piscataway: IEEE, 2022: 5718-5729. |
| 33 | Menze B H, Jakab A, Bauer S, et al.. The multimodal brain tumor image segmentation benchmark (BRATS). IEEE Transactions on Medical Imaging, 2015, 34 (10): 1993- 2024. |
| [1] | 宫泽正, 沈富可, 魏同权. 基于大语言模型的测试用例图谱生成研究[J]. 华东师范大学学报(自然科学版), 2026, 2026(4): 143-153. |
| [2] | 殷炜, 俞黎阳. 基于语言相似度的低资源机器翻译迁移学习框架[J]. 华东师范大学学报(自然科学版), 2026, 2026(4): 134-142. |
| [3] | 龚子豪, 陈志云. FusionSeg: 基于语义特征融合的主题分割模型[J]. 华东师范大学学报(自然科学版), 2026, 2026(4): 123-133. |
| [4] | 谢子阳, 高岩. 结合空间特征融合与特征增强的遥感道路提取[J]. 华东师范大学学报(自然科学版), 2026, 2026(4): 112-122. |
| [5] | 马毅鸣, 林欣, 倪琴, 余杨泽, 邓赐平, 贺樑. 针对大语言模型的社会认知评测框架和问答基准[J]. 华东师范大学学报(自然科学版), 2026, 2026(4): 102-111. |
| [6] | 吕欣樾, 黄新力. 基于条件变分自编码器的联邦推荐系统冷启动问题研究[J]. 华东师范大学学报(自然科学版), 2025, 2025(6): 53-62. |
| [7] | 赵思嘉, 韩凡宇, 王伟. 基于多维特征融合的GitHub开发者地理位置预测[J]. 华东师范大学学报(自然科学版), 2025, 2025(5): 1-13. |
| [8] | 赵普, 彭庆喜, 张雨昂, 金协杰, 赵德洲. 开源协同结构建模与多层网络链路预测方法[J]. 华东师范大学学报(自然科学版), 2025, 2025(5): 109-124. |
| [9] | 王锐, 吕秋月, 廖佳. 开源创新的现状、热点及趋势分析——基于2005—2024年知网文献的计量研究[J]. 华东师范大学学报(自然科学版), 2025, 2025(5): 125-139. |
| [10] | 何德鑫, 韩凡宇, 王伟. 大语言模型在开源项目主题标注中的应用与评估研究[J]. 华东师范大学学报(自然科学版), 2025, 2025(5): 14-24. |
| [11] | 游明东, 彭佳恒, 韩凡宇, 王伟. 基于DTA的GitHub高星仓库活跃度评估方法[J]. 华东师范大学学报(自然科学版), 2025, 2025(5): 140-150. |
| [12] | 赵生宇, 王伟, 韩凡宇, 彭佳恒, 游兰. 开源评价学: 基于评价学理论的开源生态系统评价框架与方法[J]. 华东师范大学学报(自然科学版), 2025, 2025(5): 151-161. |
| [13] | 陈小伟, 王伟, 韩凡宇, 包光磊, 董菲, 霍昊, 刘辰. OSS Insight: 开源生态时空数据分析和智能洞察平台[J]. 华东师范大学学报(自然科学版), 2025, 2025(5): 170-182. |
| [14] | 赵云虎, 杨宇宙, 秦琳. 略论开源大模型数据集分发的合理使用[J]. 华东师范大学学报(自然科学版), 2025, 2025(5): 183-190. |
| [15] | 庄表伟, 刘润涛. 开源伦理的历史嬗变与未来展望[J]. 华东师范大学学报(自然科学版), 2025, 2025(5): 202-208. |
| 阅读次数 | ||||||
|
全文 |
|
|||||
|
摘要 |
|
|||||