Parallax image mosaic based on matching points and thin plate splines function model optimization

doi:10.3969/j.issn.1000-5641.2025.04.002

Abstract

Abstract:

To solve the redundancy of matching points and local distortion of image after mosaic in intelligent driving, a parallax image mosaic algorithm based on optimization of matching points and improvement of thin plate spline function model is proposed. First, a sparse matrix is constructed according to the distribution positions of image matching points. Second, the number of mesh constrained matching points is used to eliminate redundant matching points, which reduces the time of calculating thin plate spline function model. Finally, an improved thin plate spline function model is used for image registration. The experimental results indicate that the proposed algorithm eliminates the redundancy of matching points and improves the image distortion problem, which has certain superiority and effectiveness.

Key words: intelligent driving, parallax image stitching, improved thin plate splines function model, sparse matrix, matching points

CLC Number:

TP391

Jiefang CHEN, Chang HUANG. Parallax image mosaic based on matching points and thin plate splines function model optimization[J]. J* E* C* N* U* N* S*, 2025, 2025(4): 15-27.

Figures/Tables 13

Fig.1

Fig.2

Fig.3

Fig.4

Fig.5

Fig.6

Table 1

Fig.7

Fig.8

Table 2

Fig.9

Fig.10

Fig.11

References 20

1	蒋敏, 蒋品群, 宋树祥, 等.. 基于点线配准和超像素分割的图像拼接算法. 计算机应用与软件, 2023, 40 (10): 250- 254.
2	FANG Y M, HUANG L P, YAN J B, et al. Perceptual quality assessment of omnidirectional images [C]// Proceedings of the AAAI Conference on Artificial Intelligence. 2022: 580-588.
3	王怀, 王展青.. 非线性约束下的准单应变换图像拼接算法. 计算机应用, 2021, 41 (8): 2318- 2323.
4	夏丹, 周睿.. 视差图像配准技术研究综述. 计算机工程与应用, 2021, 57 (2): 18- 27.
5	《中国公路学报》编辑部. 中国汽车工程学术研究综述·2023[J]. 中国公路学报, 2023, 36(11): 1-192.
6	GUO D H, CHEN J, LUO L B, et al.. UAV image stitching using shape-preserving warp combined with global alignment. IEEE Geoscience and Remote Sensing Letters, 2021, 19, 8016005.
7	BROWN M, LOWE D G.. Automatic panoramic image stitching using invariant features. International Journal of Computer Vision, 2007, 74 (1): 59- 73.
8	RUBLEE E, RABAUD V, KONOLIGE K, et al. ORB: An efficient alternative to SIFT or SURF [C]// 2011 International Conference on Computer Vision. 2011: 2564-2571.
9	ZARAGOZA J, CHIN T J, BROWN M S, et al. As-projective-as-possible images stitching with moving DLT [C]// Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2013: 2339-2346.
10	FU M Y, LIANG H, ZHU C H, et al. Image stitching techniques applied to plane or 3-D models: A review [J]. IEEE Sensors Journal, 2023, 23(8): 8060-8079.
11	GAO J, LI Y, CHIN T J, et al. Seam-driven image stitching [C]// Proceedings of the Eurographics. 2013: 45-48.
12	LIN C C, PANKANTI S U, RAMAMURTHY K N, et al. Adaptive as-natural-as-possible image stitching [C]// Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2015: 1155-1163.
13	LI J, WANG Z M, LAI S M, et al.. Parallax-tolerant image stitching based on robust elastic warping. IEEE Transactions on Multimedia, 2018, 20 (7): 1672- 1687.
14	WU Z M.. Compactly supported positive definite radial functions. Advances in Computational Mathematics, 1995, (4): 283- 292.
15	XIANG T Z, XIA G S, BAI X, et al.. Image stitching by line-guided local warping with global similarity constraint. Pattern Recognition, 2018, 83, 481- 497.
16	LEE H, LEE S, CHOI O. Improved method on image stitching based on optical flow algorithm[J]. International Journal of Engineering Business Management, 2020, 12: 184797902098092.
17	高炯笠, 吴军, 刘祺昌, 等.. 统筹图像变换与缝合线生成的无参数影像拼接. 中国图象图形学报, 2020, 25 (5): 1007- 1018.
18	刘杰, 游品鸿, 田明, 等.. 基于局部投影的视差图像拼接平滑优化. 电子学报, 2022, 50 (6): 1451- 1456.
19	HOSSEIN-NEJAD Z, NASRI M.. Clustered redundant keypoint elimination method for image mosaicing using a new Gaussian-weighted blending algorithm. The Visual Computer, 2022, 38 (6): 1991- 2007.
20	SONG B.. Optimization of the progressive image mosaicing algorithm in fine art image fusion for virtual reality. IEEE Access, 2020, (9): 69559- 69572.

实验	匹配点数/个			耗时/s
实验	SIFT + RANSAC	ORB + RANSAC	本文方法	SIFT + RANSAC	ORB + RANSAC	本文方法
实验 1	605	171	258	1.568	1.375	1.697
实验 2	398	155	215	1.262	1.042	1.448
实验 3	482	267	329	1.328	1.098	1.503
实验 4	594	369	387	1.706	1.262	1.812
实验 5	919	405	548	1.942	1.548	2.173
实验 6	862	422	476	1.834	1.603	1.988
实验 7	524	287	395	1.626	1.412	1.739
实验 8	691	325	401	1.593	1.329	1.751
实验 9	893	402	495	1.919	1.655	2.014
实验 10	589	234	307	1.472	1.297	1.615

图像	SSIM值
图像	APAP	AANAP	REW	本文方法
图像 1	0.944	0.967	0.969	0.981
图像 2	0.843	0.879	0.882	0.896
图像 3	0.892	0.905	0.917	0.931
图像 4	0.798	0.853	0.824	0.833
图像 5	0.916	0.905	0.879	0.957
图像 6	0.964	0.968	0.937	0.972
图像 7	0.922	0.913	0.945	0.964
图像 8	0.825	0.857	0.866	0.917
图像 9	0.879	0.863	0.882	0.905
图像 10	0.906	0.914	0.928	0.953

[1]	Jimi HU, Weibing WAN, Feng CHENG, Yuming ZHAO. Rule extraction and reasoning for fusing relation and structure encoding [J]. J* E* C* N* U* N* S*, 2025, 2025(1): 97-110.
[2]	Houlong FAN, Ailian FANG, Xin LIN. Knowledge graph completion by integrating textual information and graph structure information [J]. J* E* C* N* U* N* S*, 2025, 2025(1): 111-123.
[3]	Yiping LIANG, Luwei XIAO, Linlin WANG. Label-perception augmented causal analysis of mental health over social media [J]. J* E* C* N* U* N* S*, 2025, 2025(1): 124-137.
[4]	Ping WU, Xin LIN. Purging diffusion models through CLIP based fine-tuning [J]. J* E* C* N* U* N* S*, 2025, 2025(1): 138-150.
[5]	Xiaoxue FU, Chang HUANG. Infrared small target detection algorithm deployed on HiSilicon Hi3531 [J]. J* E* C* N* U* N* S*, 2025, 2025(1): 151-164.
[6]	Chaojie MEN, Jing ZHAO, Nan ZHANG. Time series uncertainty forecasting based on graph augmentation and attention mechanism [J]. J* E* C* N* U* N* S*, 2025, 2025(1): 82-96.
[7]	Jie WANG, Wenrui HUANG, Shengyu ZHAO, Xiaoya XIA, Fanyu HAN, Wei WANG, Yanbin ZHANG. OpenRank contribution evaluation method and empirical study in open-source course [J]. Journal of East China Normal University(Natural Science), 2024, 2024(5): 11-19.
[8]	Jiarui ZHANG, Qiming ZHANG, Fenglin BI, Yanbin ZHANG, Wei WANG, Erjin REN, Haili ZHANG. Locally lightweight course teaching-assistant system based on IPEX-LLM [J]. Journal of East China Normal University(Natural Science), 2024, 2024(5): 162-172.
[9]	Yanli FENG, Yu ZHOU, Fuxing HUANG, Junling WAN, Peisen YUAN. Study on short-term electricity load forecasting based on SF-Transformer for intelligent education platform [J]. Journal of East China Normal University(Natural Science), 2024, 2024(5): 173-182.
[10]	Junlin REN, Huan WANG, Xiaodi HUANG, Yanting LI, Shenggen JU. Sequence-aware and multi-type behavioral data driven knowledge concept recommendation for massive open online courses [J]. Journal of East China Normal University(Natural Science), 2024, 2024(5): 45-56.
[11]	Zhirui CHEN, Xuesong LU. Prompting open-source code large language models for student program repair [J]. Journal of East China Normal University(Natural Science), 2024, 2024(5): 93-103.
[12]	Linding XIE, Yuan ZHANG, Yihong CAI. Bioinformatics-based construction of immune prognostic gene model for hepatocellular carcinoma and preliminary model validation [J]. Journal of East China Normal University(Natural Science), 2024, 2024(4): 100-110.
[13]	Sijing RAO, Ying XIN, Junjun PAN. Skinning in character animation based on implicit surface [J]. Journal of East China Normal University(Natural Science), 2024, 2024(2): 143-156.
[14]	Luping FENG, Liye SHI, Wen WU, Jun ZHENG, Wenxin HU, Wei ZHENG. Collaborative stranger review-based recommendation [J]. Journal of East China Normal University(Natural Science), 2024, 2024(2): 53-64.
[15]	Yongzhuo ZHANG, Qingfeng ZHUGE, Edwin Hsing-Mean SHA, Yuhong SONG. Parallel block-based stochastic computing with adapted quantization [J]. Journal of East China Normal University(Natural Science), 2024, 2024(2): 76-85.