Journal of East China Normal University(Natural Science) >

2025 , Vol. 2025 >Issue 1: 151 - 164

DOI: https://doi.org/10.3969/j.issn.1000-5641.2025.01.012

Computer Science

Infrared small target detection algorithm deployed on HiSilicon Hi3531

  • Xiaoxue FU ,
  • Chang HUANG
Expand
  • School of Communication and Electronic Engineering, East China Normal University, Shanghai　200241, China

Received date: 2024-01-15

  Online published: 2025-01-20

Copyright

, 2025, Copyright reserved © 2025.
Fold

Abstract

In response to the existing shortcomings of large computational complexity, poor real-time performance, and deployment difficulties in current algorithms, and to meet the high requirements of real-time performance and accuracy for infrared detection systems, proposes a lightweight algorithm deployed on domestically produced embedded chips, termed YOLOv5-TinyHisi. The YOLOv5-TinyHisi algorithm undertakes lightweight modifications to the backbone network structure based on the characteristics of infrared small targets. Additionally, it utilizes SIoU optimized loss function for boundary error, thereby enhancing the accuracy of infrared small target localization. The YOLOv5-TinyHisi algorithm model is deployed on Hi3531DV200, utilizing the chip-integrated neural network inference engine (NNIE) to accelerate network inference. Experimental results on public datasets demonstrate that the algorithm achieves a 1.52% improvement in average precision (mAP) compared to YOLOv5, while significantly reducing parameter count and model size. On the Hi3531DV200, the inference speed for a single image with a resolution of (1280 × 512) pixels reaches 35 frames per second (FPS), with a recall rate of 95%, meeting the real-time and accuracy requirements of the infrared detection system.

Key words： infrared small target detection; embedded system; YOLOv5; neural network inference engine

Cite this article

Xiaoxue FU , Chang HUANG . Infrared small target detection algorithm deployed on HiSilicon Hi3531[J]. Journal of East China Normal University(Natural Science), 2025 , 2025(1) : 151 -164 . DOI: 10.3969/j.issn.1000-5641.2025.01.012

References

1 张敏, 韩芳, 康键, 等.. 红外热成像技术在民用领域的应用. 红外, 2019, 40 (6): 35- 43.
2 GAO J, GUO Y, LIN Z, et al.. Robust infrared small target detection using multiscale gray and variance difference measures. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2018, 11 (12): 5039- 5052.
3 ZHANG W, CONG M Y, WANG L P. Algorithms for optical weak small targets detection and tracking: Review [C]// Proceedings of the International Conference on Neural Networks and Signal Processing. 2003: 643-647.
4 DU J, LU H, ZHANG L, et al. Infrared small target detection and tracking method suitable for different scenes [C]// Proceedings of the 2020 IEEE 9th Joint International Information Technology and Artificial Intelligence Conference. 2020: 664-668.
5 GIRSHICK R, DONAHUE J, DARRELL T, et al. Rich feature hierarchies for accurate object detection and semantic segmentation [C]// Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition. 2014: 580-587.
6 蒋昕昊, 蔡伟, 杨志勇, 等.. 基于YOLO-IDSTD算法的红外弱小目标检测. 红外与激光工程, 2022, 51 (3): 502- 511.
7 TIAN Z, SHEN C, CHEN H, et al. FCOS: Fully convolutional one-stage object detection [C]// Proceedings of the 2019 IEEE/CVF International Conference on Computer Vision. 2019: 9626-9635.
8 WANG K, LI S, NIU S, et al.. Detection of infrared small targets using feature fusion convolutional network. IEEE Access, 2019, (7): 146081- 146092.
9 HOU Q, WANG Z, TAN F, et al.. RISTDnet: Robust infrared small target detection network. IEEE Geoscience and Remote Sensing Letters, 2022, 19, 7000805.
10 高蕾, 符永铨, 李东升, 等.. 我国人工智能核心软硬件发展战略研究. 中国工程科学, 2021, 23 (3): 90- 97.
11 高昕. 基于Hi3559的智能相机系统软件研发 [D]. 杭州: 浙江大学, 2022.
12 张思雨. 基于相关方法的自适应目标跟踪算法研究与实现 [D]. 武汉: 华中科技大学, 2022.
13 LIN T Y, DOLLAR P, GIRSHICK R, et al. Feature pyramid networks for object detection [C]// Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2017: 936-944.
14 LIU S, QI L, QIN H, et al. Path aggregation network for instance segmentation [C]// Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2018: 8759-8768.
15 REN S, HE K, GIRSHICK R, et al.. Faster R-CNN: Towards real-time object detection with region proposal networks. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2017, 39 (6): 1137- 1149.
16 ZHENG Z H, WANG P, LIU W, et al. Distance-IoU loss: Faster and better learning for bounding box regression [EB/OL]. (2019-11-19)[2023-12-16]. https://arxiv.org/pdf/1911.08287.
17 GEVORGYAN Z. SIoU loss: More powerful learning for bounding box regression [EB/OL]. (2022-05-25)[2023-12-13]. https://arxiv.org/pdf/2205.12740.
18 ABADI M, BARHAM P, CHEN J, et al. TensorFlow: A system for large-scale machine learning [C]// Proceedings of the 12th USENIX Conference on Operating Systems Design and Implementation. 2016: 265-283.
19 PASZKE A, GROSS S, MASSA F, et al. PyTorch: An imperative style, high-performance deep learning library [C]// Proceedings of the 33rd International Conference on Neural Information Processing Systems. 2019: 8026-8037.
20 XIA X, LI J, WU J, et al. TRT-ViT: TensorRT-oriented vision transformer [EB/OL]. (2022-07-12)[2023-12-13]. https://arxiv.org/pdf/2205.09579.
21 AMBROSI J, ANKIT A, ANTUNES R, et al. Hardware-software co-design for an analog-digital accelerator for machine learning [C]// Proceedings of the IEEE International Conference on Rebooting Computing. DOI: 10.1109/ICRC.2018.8638612.
22 JIA Y, SHELHAMER E, DONAHUE J, et al. Caffe: Convolutional architecture for fast Feature embedding [C]// Proceedings of the 22nd ACM International Conference on Multimedia. 2014: 675-678.
23 GUO F, HUANG H, LIU Y, et al. Application of neural network based on Caffe framework for object detection in Hilens [C]// Proceedings of the Chinese Automation Congress. 2019: 4355-4359.
24 NEUBECK A, VAN GOOL L. Efficient non-maximum suppression [C]// Proceedings of the International Conference on Pattern Recognition. 2006: 850-855.
25 WANG H, ZHOU L, WANG L. Miss detection vs. false alarm: Adversarial learning for small object segmentation in infrared images [C]// Proceedings of the IEEE International Conference on Computer Vision. 2019: 8508-8517.
26 LI B, XIAO C, WANG L, et al.. Dense nested attention network for infrared small target detection. IEEE Transactions on Image Processing, 2023, 32, 1745- 1758.
27 范晨亮, 李国庆, 马长啸, 等.. 基于深度学习的风机叶片裂纹检测算法. 科学技术创新, 2020, (13): 72- 75.
Options
Outlines

/

〈 〉