一种基于先验标记特征的精准图像配准算法

doi:10.3969/j.issn.1000-5641.2021.03.008

华东师范大学学报（自然科学版） ›› 2021, Vol. 2021 ›› Issue (3): 65-77.doi: 10.3969/j.issn.1000-5641.2021.03.008

一种基于先验标记特征的精准图像配准算法

刘天弼(), 冯瑞*()

复旦大学计算机科学技术学院, 上海　201203

收稿日期:2020-04-28 出版日期:2021-05-25 发布日期:2021-05-26
通讯作者: 冯瑞 E-mail:allenlew@163.com;fengrui@fudan.edu.cn
作者简介:刘天弼, 男, 博士研究生, 研究方向为计算机视觉及人工智能. E-mail: allenlew@163.com
基金资助:
国家重点研发计划（2017YFC0803702）

An algorithm for precise image registration based on priori mark features

Tianbi LIU(), Rui FENG*()

School of Computer Science and Technology, Fudan University, Shanghai　201203, China

Received:2020-04-28 Online:2021-05-25 Published:2021-05-26
Contact: Rui FENG E-mail:allenlew@163.com;fengrui@fudan.edu.cn

摘要/Abstract

摘要：

基因测序仪在读取基因序列之前需要将镜头与基因芯片精准对齐, 提出了一种能够精确地计算视场（Field of View, FOV）与理想位置偏差的算法. 预先在基因芯片上的特定位置设置标记, 通过拍摄的图像分析视场与基因芯片的位置误差: 首先, 提取图像灰度特征捕捉标记位置以初步对齐视场中心位置; 其次, 捕捉标记上的多个关键点的坐标; 最后, 对关键点的坐标映射关系进行拟合, 即可计算出精确的坐标和角度偏差. 实践和实验分析表明, 使用设计的图像配准算法能够实现对视场与基因芯片间位置偏差计算的高精度估计.

关键词: 图像配准, 位置校准, 基因芯片

Abstract:

The use of a gene sequencer requires that the lens and gene chip are aligned accurately before base-calling. We propose an algorithm to calculate the deviation of the field of view (FOV) from the ideal position. Marks are set at locations on the gene chip in advance, so that the deviation in position of the lens relative to the gene chip can be analyzed. Firstly, the marked locations are captured by extracting grayscale features of the image to initially align the center of the FOV; secondly, the coordinates for multiple key points on the marks are captured; and finally, the location and angle deviations are calculated by mapping coordinates for the key points. Practical and experimental analysis show that the image registration algorithm designed in this paper can achieve a high-precision estimate for the position deviation between the FOV and the gene chip.

Key words: image registration, position calibration, gene chip

中图分类号:

TP391.7

刘天弼, 冯瑞. 一种基于先验标记特征的精准图像配准算法[J]. 华东师范大学学报（自然科学版）, 2021, 2021(3): 65-77.

Tianbi LIU, Rui FENG. An algorithm for precise image registration based on priori mark features[J]. Journal of East China Normal University(Natural Science), 2021, 2021(3): 65-77.

图/表 13

图1

图2

图3

图4

表1

图5

图6

图7

图8

图9

图10

图11

图12

参考文献 25

1	滕晓坤, 肖华胜. 基因芯片与高通量测序技术前景分析. 中国科学 C 辑: 生命科学, 2008, 38 (10): 891- 899.
2	赵晨晖. 基于相位相关的亚像素图像配准. 现代计算机, 2014, 20, (3): 50- 53.
3	BROWN L G. A survey of image registration techniques. ACM Computing Surveys, 1992, 24 (4): 325- 376. doi: 10.1145/146370.146374
4	ZITOVA B, FLUSSER J. Image registration methods: A survey. Image and Vision Computing, 2003, 21 (11): 977- 1000. doi: 10.1016/S0262-8856(03)00137-9
5	PLUIM J P W, MAINTZ J B A, VIERGEVER M A. Image registration by maximization of combined mutual information and gradient information. IEEE Transactions on Medical Imaging, 2000, 19 (8): 809- 814. doi: 10.1109/42.876307
6	AMAURY D, MARCHAND E. Second-order optimization of mutual information for real-time image registration. IEEE Transactions on Image Processing, 2012, 21 (9): 4190- 4203. doi: 10.1109/TIP.2012.2199124
7	闫小超, 魏生民, 汪焰恩, 等. 基于序贯相似度的AGV图像配准方法. 科学技术与工程, 2010, 10 (3): 696- 699. doi: 10.3969/j.issn.1671-1815.2010.03.023
8	WEI X X, STOCKER A A. Mutual information, fisher information, and efficient coding. Neural Computation, 2016, 28 (2): 305- 326. doi: 10.1162/NECO_a_00804
9	LOWE D G. Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision, 2004, 60 (2): 91- 110. doi: 10.1023/B:VISI.0000029664.99615.94
10	BAY H, TUYTELAARS T, VAN GOOL L. SURF: Speeded up robust features [C]//European Conference on Computer Vision, Computer Vision – ECCV 2006. Berlin: Springer, 2006: 404-417. DOI: 10.1007/11744023_32.
11	SMITH S M, BRADY J M. SUSAN—A new approach to low level image processing. International Journal of Computer Vision, 1997, 23 (1): 45- 78. doi: 10.1023/A:1007963824710
12	TRAJKOVIE M, HEDLEY M. Fast corner detection. Image and Vision Computing, 1998, 16 (2): 75- 87. doi: 10.1016/S0262-8856(97)00056-5
13	LEUTENEGGER S, CHLI M, SIEGWART R Y. BRISK: Binary robust invariant scalable keypoints [C]//2011 International Conference on Computer Vision. IEEE, 2011: 2548-2555. DOI: 10.1109/ICCV.2011.6126542.
14	SHARK L K, KUREKIN A A, MATUSZEWSKI B J. Development and evaluation of fast branch-and-bound algorithm for feature matching based on line segments. Pattern Recognition, 2007, 40 (5): 1432- 1450. doi: 10.1016/j.patcog.2006.10.022
15	DAI X L, KHORRAM S. Development of a feature-based approach to automated image registration for multitemporal and multisensor remotely sensed imagery [C]//1997 IEEE International Geoscience and Remote Sensing Symposium Proceedings. Remote Sensing - A Scientific Vision for Sustainable Development. IEEE, 1997: 243-245.DOI: 10.1109/IGARSS.1997.61585.
16	GOVINDU V, SHEKHAR C, CHELLAPPA R. Using geometric properties for correspondence-less image alignment [C]//Proceedings of the 14th International Conference on Pattern Recognition (Cat. No.98EX170). IEEE, 1998: 37-41. DOI: 10.1109/ICPR.1998.711074.
17	HOLM M. Toward automatic rectification of satellite images using feature based matching [C]//Proceedings of the IGARSS’91 Remote Sensing: Global Monitoring for Earth Management. IEEE, 1991: 2439-2442. DOI: 10.1109/IGARSS.1991.575537.
18	HSIEH Y C, MCKEOWN D M, PERLANT F P. Performance evaluation of scene registration and stereo matching for cartographic feature extraction. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1992, 14 (2): 214- 238. doi: 10.1109/34.121790
19	LITJENS G, KOOI T, BEJNORDI B E, et al. A survey on deep learning in medical image analysis. Medical Image Analysis, 2017, 2017, 42, 60- 88. doi: 10.1016/j.media.2017.07.005
20	SOKOOTI H, DE VOS B, BERENDSEN F, et al. Nonrigid image registration using multi-scale 3D convolutional neural networks [C]//Medical Image Computing and Computer Assisted Intervention Society, MICCAI(2017), Part I, LNCS 10433. Berlin: Springer, 2017: 232-239. DOI: 10.1007/978-3-319-66182-7_27.
21	CAO X H, YANG J H, ZHANG J, et al. Deformable image registration using a cue-aware deep regression network. IEEE Transactions on Biomedical Engineering, 2018, 65 (9): 1900- 1911. doi: 10.1109/TBME.2018.2822826
22	MIAO S, WANG Z J, LIAO R. A CNN regression approach for real-time 2D/3D registration. IEEE Transactions on Medical Imaging, 2016, 35 (5): 1352- 1363. doi: 10.1109/TMI.2016.2521800
23	DALCA A V, BALAKRISHNAN G, GUTTAG J, et al. Unsupervised learning for fast probabilistic diffeomorphic registration[C]//International Conference on Medical Image Computing and Computer-Assisted Intervention–MICCAI 2018: Medical Image Computing and Computer Assisted Intervention. Cham: Springer, 2018: 729-738. DOI: 10.1007/978-3-030-00928-1_82.
24	DE VOS B D, BERENDSEN F F, VIERGEVER M A, et al. End-to-end unsupervised deformable image registration with a convolutional neural network [C]//International Workshop on Deep Learning in Medical Image Analysis–2017, International Workshop on Multimodal Learning for Clinical Decision Suppor–2017: Deep Learning in Medical Image Analysis and Multimodal Learning for Clinical Decision Support. Cham: Springer, 2017: 204-212. DOI: 10.1007/978-3-319-67558-9_24.
25	KREBS J, MANSI T, MAILHÉ B, et al. Learning structured deformations using diffeomorphic registration [EB/OL]. (2018-07-20)[2020-02-28]. https://arxiv.org/pdf/1804.07172v2.pdf.

仪器分辨率/像素	cell大小/像素	亮度串扰/%	track宽度/像素	track数量/个		位置误差/像素	角度误差/(°)
仪器分辨率/像素	cell大小/像素	亮度串扰/%	track宽度/像素	横向	竖向	位置误差/像素	角度误差/(°)
2 560 × 2 160	9 × 9	15	9	8	8	0.243 1	0.010 882
2 560 × 2 160	6 × 6	10	6	8	8	0.274 6	0.012 292
5 012 × 5 012	9 × 9	20	9	9	9	0.284 9	0.006 376
5 012 × 5 012	6 × 6	15	6	9	9	0.330 5	0.007 397

[1]	方雷;张华鑫;姚申君. 一种基于面积修改简单多边形的算法[J]. 华东师范大学学报(自然科学版), 2011, 2011(2): 77-88.
[2]	许文韬. 网页数据库动态同步技术研究[J]. 华东师范大学学报(自然科学版), 2006, 2006(1): 108-115.

一种基于先验标记特征的精准图像配准算法

An algorithm for precise image registration based on priori mark features

RichHTML

PDF

可视化

摘要/Abstract

引用本文

使用本文

图/表 13

参考文献 25

相关文章 2

编辑推荐

Metrics

本文评价