非规则圆柱面壁画的高分辨率全景图像生成法

doi:10.3969/j.issn.1000-5641.2022.06.011

摘要/Abstract

摘要：

如何将洞窟甬道顶部的非规则柱面壁画展开成全景图像, 在古壁画保护和二次开发领域是一个比较有挑战性的课题. 提出了将柱面壁画先划分成众多有重叠的小区域进行采样, 然后再把这些采样图像拼接成一幅全景图像的方法. 该方法的主要处理内容: ① 依据采样图像集重构三维模型; ② 把图像纹理映射到三维模型上; ③ 将重构得到的非规则三维圆柱面拟合到最接近于原形状的理想圆柱面上; ④ 最后将理想圆柱面的壁画投影成全景图像. 所提出的方法在实际洞窟图像集上进行了验证实验. 实验结果显示, 所提方法能较完整地生成全景图像, 并且从全景图像上看不出有拼接痕迹和纹理变形的现象, 具有一定的实用价值.

关键词: 全景图, 洞窟壁画, 三维重建, 图像拼接

Abstract:

The issue of how to unfold an irregular cylindrical mural from the top surface of a cave corridor into a panorama is a challenge for researchers involved with ancient mural protection and secondary development. This paper presents a method of dividing cylindrical murals into many overlapping small areas for sampling firstly, and then stitching these sampled images into a panorama. The constituents of this method include the following key elements: ① Reconstructing the 3D model with the sampled image set; ② Mapping the image texture to the 3D model; ③ Fitting the reconstructed irregular 3D cylindrical surface to the ideal cylindrical surface which is closest to the original form; and ④ Projecting the mural of the ideal cylindrical surface to a panorama. The method proposed in this paper was verified on an actual cave image set. The experimental results showed that the proposed method can generate the panorama in full; moreover, there was no evidence of stitching traces or texture deformation on the panorama. The proposed method offers practical value for mural protection.

Key words: panorama, cave murals, 3D reconstruction, image stitching

中图分类号:

TP391.41

何伟, 童卫青. 非规则圆柱面壁画的高分辨率全景图像生成法[J]. 华东师范大学学报（自然科学版）, 2022, 2022(6): 102-122.

Wei HE, Weiqing TONG. High resolution panorama generation method for irregular cylindrical murals[J]. Journal of East China Normal University(Natural Science), 2022, 2022(6): 102-122.

图/表 36

图1

图2

图3

图4

图5

图6

图7

图8

图9

图10

图11

图12

图13

图14

图15

图16

图17

表1

图18

图19

图20

图21

图22

表2

图23

图24

图25

图26

图27

表3

图28

图29

图30

图31

图32

表4

参考文献 34

1	郑晓瑞. 林区无人机航拍图像拼接算法研究 [D]. 北京: 北京林业大学, 2020.
2	袁兴峰. 基于快速标定的车载全景影像系统设计与实现 [D]. 合肥: 合肥工业大学, 2020.
3	邹宇. 基于鱼眼相机的车载全景图像拼接技术研究 [D]. 南京: 南京航空航天大学, 2019.
4	王曼, 李涛. 视频拼接系统与我院手术示教系统的结合应用. 中国医疗设备, 2018, 33 (11): 168- 171.
5	代少升, 姚俐. 基于ROI的高精度红外全景拼接方法研究. 半导体光电, 2020, 39 (4): 306- 314.
6	ANUTA P E. Spatial registration of multispectral and multi-temporal digital imagery using fast Fourier transform techniques. IEEE Transactions on Geoscience Electronics, 1970, 8 (4): 353- 368.
7	KUGLIN C D, HINES D C. The phase correlation image alignment method [C]//Proceedings of IEEE International Conference on Cybernetics and Society. 1975: 163-165.
8	DE CASTRO E, MORANDI C. Registration of translated and rotated images using finite fourier transforms.. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1987, 9 (5): 700- 703.
9	DJAMDJI J P, BIJAOUI A, MANIERE R. Geometrical registration of images: The multiresolution approach. Photogrammetric Engineering and Emote Sensing, 1993, 59 (5): 645- 653.
10	LOWE D G. Object recognition from local scale-invariant features [C]//Proceedings of the 7th IEEE International Conference on Computer Vision. IEEE, 1999(2): 1150-1157.
11	LOWE D G. Distinctive image features from scale-invariant key-points [J]. International Journal of Computer Vision, 2004, 60(2): 91-110.
12	赵向阳, 杜利民. 一种全自动稳健的图像拼接融合算法. 中国图象图形学报, 2004, 9 (4): 417- 422.
13	BAY H, ESS A, TUYTELAARS T, et al. Speeded-up robust features (SURF). Computer Vision and Image Understanding, 2008, 110 (3): 346- 359.
14	RUBLEE E, RABAUD V, KONOLIGE K, et al. ORB: An efficient alternative to SIFT or SURF [C]//2011 International Conference on Computer Vision. IEEE, 2011: 2564-2571.
15	BROWN M, LOWE D G. Automatic panoramic image stitching using invariant features. International Journal of Computer Vision, 2007, 74 (1): 59- 73.
16	GAO J H, KIM S J, BROWN M S. Constructing image panoramas using dual-homography warping [C]//Conference on Computer Vision and Pattern Recognition (CVPR) 2011. IEEE, 2011: 49-56.
17	LIN W Y, LIU S, MATSUSHITA Y, et al. Smoothly varying affine stitching [C]//Conference on Computer Vision and Pattern Recognition (CVPR) 2011. IEEE, 2011: 345-352.
18	ZARAGOZA J, CHIN T J, BROWN M S, et al. As-projective-as-possible image stitching with moving DLT [C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. IEEE, 2013: 2339-2346.
19	CHEN Y S, CHUANG Y Y. Natural image stitching with the global similarity prior [C]//European Conference on Computer Vision. Cham : Springer, 2016: 186-201.
20	YI K M, TRULLS E, LEPETIT V, et al. Lift: Learned invariant feature transform [C]//European Conference on Computer Vision. Cham : Springer, 2016: 467-483.
21	陈小杜. 基于改进AKAZE和RANSAC的全景图像拼接算法研究 [D]. 南昌: 南昌大学, 2020.
22	MELEKHOV I, YLIOINAS J, KANNALA J, et al. Relative camera pose estimation using convolutional neural networks [C]//International Conference on Advanced Concepts for Intelligent Vision Systems. Cham: Springer, 2017: 675-687.
23	FU Y, GUO T T, ZHAO X F. Intelligent splicing method of virtual reality Lingnan cultural heritage panorama based on automatic machine learning [J]. Mobile Information Systems, 2021: 8693436. DOI: 10.1155/2021/8693436.
24	刘礼铭. 基于三维重建的超高分辨率壁画快速数字化技术研究 [D]. 杭州: 浙江大学, 2016.
25	张园林. 基于三维模型的碑刻数字拓片生成技术及应用 [D]. 杭州: 浙江大学, 2018.
26	闫冰. 基于深度图的三维重建算法的优化研究 [D]. 杭州: 浙江大学, 2019.
27	李敏. 基于非朗伯光度立体的三维重建研究 [D]. 杭州: 浙江大学, 2020.
28	李淑芬. 基于局部几何约束的自适应特征匹配技术研究 [D]. 杭州: 浙江大学, 2020.
29	ULLMAN S. The interpretation of structure from motion. Proceedings of the Royal Series B, 1979, 203 (1153): 405- 426.
30	LOURAKIS M I A, ARGYROS A A. SBA: A software package for generic sparse bundle adjustment. ACM Transactions on Mathematical Software (TOMS), 2009, 36 (1): 1- 30.
31	SHEN S. Accurate multiple view 3D reconstruction using patch-based stereo for large-scale scenes. IEEE Transactions on Image Processing, 2013, 22 (5): 1901- 1914.
32	JANCOSEK M, PAJDLA T. Exploiting visibility information in surface reconstruction to preserve weakly supported surfaces [J/OL]. International Scholarly Research Notices, 2014: 798595. (2014-08-11)[2021-08-01]. https://doi.org/10.1155/2014/798595.
33	WAECHTER M, MOEHRLE N, GOESELE M. Let there be color! Large-scale texturing of 3D reconstructions [C]//European Conference on Computer Vision. Cham: Springer, 2014: 836-850.
34	TORR P H S, ZISSERMAN A. MLESAC: A new robust estimator with application to estimating image geometry. Computer Vision and Image Understanding, 2000, 78 (1): 138- 156.

算法	复原完整性	拼接处痕迹	图像变形	图像重影	图像模糊	色差
CPG	基本还原	无	无	无	无	无
OpenCV	无法还原	×	×	×	×	×
OpenPano	局部还原	无	有	有	有	无
PhotoShop	局部还原	有	有	无	无	无

[1]	崔瑞博, 王峰. 动量更新与重构约束的限制视角下3D物品识别[J]. 华东师范大学学报（自然科学版）, 2023, 2023(6): 61-72.
[2]	申莎莎. 基于Curvelet稳定特征曲面的掌纹识别新方法[J]. 华东师范大学学报(自然科学版), 2015, 2015(3): 98-104.
[3]	刘丹, 童卫青. 基于鼻子下轮廓线的鼻尖定位法[J]. 华东师范大学学报(自然科学版), 2014, 2014(4): 54-61.
[4]	王基帆;童卫青. 基于数理形态学的近红外光图像实时人脸检测[J]. 华东师范大学学报(自然科学版), 2010, 2010(3): 39-47.
[5]	范劲松;;皮　玲;黎　芳;沈超敏. 黎曼流形上内蕴方式的图像轮廓提取[J]. 华东师范大学学报(自然科学版), 2007, 2007(5): 70-77.
[6]	黎芳. 全变分极小与二阶泛函的组合图像恢复模型(英)[J]. 华东师范大学学报(自然科学版), 2007, 2007(5): 62-69.
[7]	陈优广;张薇;黄穗. 图像区域边界抽取与链码树结构生成算法[J]. 华东师范大学学报(自然科学版), 2006, 2006(3): 77-85.
[8]	张薇;陈优广;顾国庆. 图像顶点链编码和顶点欧氏距离的计算[J]. 华东师范大学学报(自然科学版), 2005, 2005(2): 33-38.
[9]	王涤琼;张薇;顾国庆. 用顶点链编码计算图像区域密集度和体态比[J]. 华东师范大学学报(自然科学版), 2005, 2005(1): 59-62.