Journal of East China Normal University(Natural Science) >
Research on water surface glint removal and information reconstruction methods for unmanned aerial vehicle hyperspectral images
Received date: 2022-11-25
Accepted date: 2023-04-06
Online published: 2024-01-23
Suppressing water glint pollution from remote sensing images and reconstructing image information are effective ways to improve the quality of UAV (unmanned aerial vehicle) remote sensing information and increase water environment monitoring areas. It is difficult to apply traditional glint information reconstruction algorithms to UAV hyperspectral images. This study proposes an algorithm for automatic glint detection, removal, and information reconstruction. First, NDWI (normalized difference water index) was used to extract the water body, and the lowest value of the sum of grayscale images in the entire band was used as a threshold to segment the glint, and the Laplace operator was used to extract the glint texture. The difference between the two areas was calculated through multiple rounds of morphological expansion and threshold updates. The lowest difference occurrence frequency was obtained by voting, and the best threshold was obtained in reverse to remove the glint automatically. Then, we determined the matching bands based on principal component analysis and compared the minimum similarity of matching blocks of different sizes to obtain the best size of the image blocks. Finally, we used an improved Criminisi algorithm to reconstruct the flare removal region. The removal algorithm was applied to four real glint scenarios with a removal rate > 99%; the reconstruction algorithm results are superior to those of other algorithms both subjectively and objectively, and the difference between the variation coefficient of each band of the glint reconstruction for water and normal water was within 1%, indicating good spectral application capability.
Shirui WANG , Fang SHEN , Renhu LI , Peng LI . Research on water surface glint removal and information reconstruction methods for unmanned aerial vehicle hyperspectral images[J]. Journal of East China Normal University(Natural Science), 2024 , 2024(1) : 36 -49 . DOI: 10.3969/j.issn.1000-5641.2024.01.005
1 | 柳宗伟, 刘胜前, 谢佳君.. 基于无人机高光谱影像的精细地物分类的研究. 现代信息科技, 2020, 4 (10): 1- 4. |
2 | 刘梅, 马启良, 原居林, 等.. 基于无人机高光谱遥感技术对内陆养殖池塘水质监测的研究. 海洋与湖沼, 2022, 53 (1): 195- 205. |
3 | 姜妍, 王琳, 杨月, 等.. 无人机高光谱成像技术在作物生长信息监测中的应用. 东北农业大学学报, 2022, 53 (3): 88- 96. |
4 | ZHANG Y S, WU L, REN H Z, et al.. Retrieval of water quality parameters from hyperspectral images using hybrid bayesian probabilistic neural network. Remote Sensing, 2020, 12 (10): 1567- 1587. |
5 | ZHANG Y, WU L, DENG L, et al.. Retrieval of water quality parameters from hyperspectral images using a hybrid feedback deep factorization machine model. Water Research, 2021, 204, 117618. |
6 | 毛志华, 郭德方, 潘德炉.. 航空水色遥感中太阳耀光信息提取及消除方法的研究. 遥感技术与应用, 1996, (4): 16- 21. |
7 | HOCHBERG E J, ANDREFOUET S, TYLER M R.. Sea surface correction of high spatial resolution Ikonos images to improve bottom mapping in near-shore environments. IEEE Transactions on Geoscience & Remote Sensing, 2003, 41 (7): 1724- 1729. |
8 | 陈卫, 乔延利, 孙晓兵, 等.. 基于偏振辐射图融合的水面太阳耀光抑制方法. 光学学报, 2019, 39 (5): 382- 390. |
9 | 邓宇, 付强, 张肃, 等.. 基于偏振检测技术的海面太阳耀光抑制方法. 激光与光电子学进展, 2021, 58 (20): 57- 65. |
10 | HUI J, LIU C, SHEN Z, et al. Robust video denoising using Low rank matrix completion [C]// 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. San Francisco, CA, USA, 2010: 1791-1798. |
11 | 蓝章礼, 黄涛, 王庆珍, 等.. 基于 Mask R-CNN 与改进 Criminisi 的沥青路面车道线移除方法. 图学学报, 2019, 40 (3): 600- 607. |
12 | WANG S K, YU C Y, SUN Y J, et al.. Specular reflection removal of ocean surface remote sensing images from UAVs. Multimedia Tools and Applications, 2018, 77 (9): 11363- 11379. |
13 | MADOOEI A, DREW M S. Detecting specular highlights in dermatological images [C]// 2015 IEEE International Conference on Image Processing (ICIP). IEEE, 2015: 4357-4360. |
14 | YU D, HAN J, JIN X, et al.. Efficient highlight removal of metal surfaces. Signal Processing, 2014, 103, 367- 379. |
15 | 白宏阳, 马军勇, 熊凯, 等.. 图像修复中的加权矩阵补全模型设计. 系统工程与电子技术, 2016, 38 (7): 1703- 1708. |
16 | IO M B, ADVISER G S, ROBBINS T T, et al. Processing of flat and non-flat image information on arbitrary manifolds using partial differential equations [D]. Minnesota: University of Minnesota, 2001. |
17 | CRIMINISI A, PEREZ P, TOYAMA K.. Region filling and object removal by exemplar-based image inpainting. IEEE Transactions on Image Processing, 2004, 13 (9): 1200- 1212. |
18 | 周宁, 朱昭昭.. 基于粗糙数据推理的 Criminisi 图像修复算法. 激光与光电子学进展, 2019, 56 (2): 84- 91. |
19 | NAZERI K, NG E, JOSEPH T, et al. Edgeconnect: Structure guided image inpainting using edge prediction [C]// 2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW). Seoul, Republic of Korea, 2019: 3265-3274. |
20 | YOO J, LEE S H, KWAK H. Image restoration by estimating frequency distribution of local patches [C]// IEEE/CVF Conference on Computer Vision & Pattern Recognition. Salt Lake City, USA, 2018: 6684-6692. |
21 | DING D, RAM S, RODRIGUEZ J J.. Image inpainting using nonlocal texture matching and nonlinear filtering. IEEE Transactions on Image Processing, 2019, 28 (4): 1705- 1719. |
22 | 唐军武, 田国良, 汪小勇, 等.. 水体光谱测量与分析Ⅰ: 水面以上测量法. 遥感学报, 2004, 8 (1): 37- 44. |
23 | 臧传凯, 沈芳, 杨正东.. 基于无人机高光谱遥感的河湖水环境探测. 自然资源遥感, 2021, 33 (3): 45- 53. |
24 | GAO B C.. NDWI: A normalized difference water index for remote sensing of vegetation liquid water from space. Remote Sensing of Environment, 1996, 58 (3): 257- 266. |
25 | 王卜堂, 杨善林.. 基于Gauss-Laplace算子的灰度图像边缘检测. 计算机工程与应用, 2003, 39 (26): 132- 134. |
26 | 张亮.. 基于PCA和SVM的高光谱遥感图像分类研究. 光学技术, 2008, 34 (S1): 184- 187. |
27 | WANG Z, BOVIK A C, SHEIKH H R, et al.. Image quality assessment: From error visibility to structural similarity. IEEE Transactions on Image Processing, 2004, 13 (4): 600- 612. |
28 | HORE A, ZIOU D. Image quality metrics: PSNR vs. SSIM [C]// 2010 20th International Conference on Pattern Recognition. Istanbul, Turkey, 2010: 2366-2369. |
29 | 周宪英, 高成文, 曹建华.. 主成分分析法及其在数据降噪中的应用. 兵工自动化, 2014, 33 (9): 55- 58. |
30 | FENG J, BROWN D.. Spike output jitter, mean firing time and coefficient of variation. Journal of Physics A: Mathematical and General, 1999, 31, 1239. |
31 | 罗良清, 魏和清. 统计学 [M]. 北京: 中国财政经济出版社, 2011. |
/
〈 |
|
〉 |