留言板

尊敬的读者、作者、审稿人, 关于本刊的投稿、审稿、编辑和出版的任何问题, 您可以本页添加留言。我们将尽快给您答复。谢谢您的支持!

姓名
邮箱
手机号码
标题
留言内容
验证码

基于L1−2时空域总变分正则项的红外弱小目标检测算法

赵德民 孙扬 林再平 熊伟

赵德民, 孙扬, 林再平, 熊伟. 基于L1−2时空域总变分正则项的红外弱小目标检测算法[J]. 中国光学(中英文), 2023, 16(5): 1066-1080. doi: 10.37188/CO.2022-0229
引用本文: 赵德民, 孙扬, 林再平, 熊伟. 基于L1−2时空域总变分正则项的红外弱小目标检测算法[J]. 中国光学(中英文), 2023, 16(5): 1066-1080. doi: 10.37188/CO.2022-0229
ZHAO De-min, SUN Yang, LIN Zai-ping, XIONG Wei. Infrared small target detection via L1−2 spatial-temporal total variation regularization[J]. Chinese Optics, 2023, 16(5): 1066-1080. doi: 10.37188/CO.2022-0229
Citation: ZHAO De-min, SUN Yang, LIN Zai-ping, XIONG Wei. Infrared small target detection via L1−2 spatial-temporal total variation regularization[J]. Chinese Optics, 2023, 16(5): 1066-1080. doi: 10.37188/CO.2022-0229

基于L1−2时空域总变分正则项的红外弱小目标检测算法

基金项目: 国家自然科学基金(No. 91738302)
详细信息
    作者简介:

    赵德民(1992—),男,湖南常德人,硕士研究生,工程师,主要研究方向为控制工程、图像处理。E-mail:421071849@qq.com

    孙 扬(1992—),男,湖南岳阳人,博士,讲师,主要研究方向为图像处理、红外目标检测。E-mail:sunyang_kd@163.com

    林再平(1982—),男,湖南长沙人,博士,副研究员,主要研究方向为空间信息处理、目标检测。E-mail:linzaiping@sina.com

    熊 伟(1971—),男,山东临邑人,博士,博士生导师,研究员,主要从事信息系统建模仿真与评估等方面研究。E-mail:13331094335@163.com

  • 中图分类号: TP391.4

Infrared small target detection via L1−2 spatial-temporal total variation regularization

Funds: Supported by National Natural Science Foundation of China (No. 91738302)
More Information
  • 摘要:

    针对红外图像序列中复杂背景干扰下容易出现的高虚警问题,提出一种基于${L_{1 - 2}}$时空域总变分正则项的红外弱小目标检测算法。首先,将红外图像序列转化为时空域红外张量块,该步骤可利用张量的高维数据结构优势关联图像序列中的时空域信息。然后,利用加权Schatten $p$范数和${L_{1 - 2}}$时空域总变分正则项对低秩背景成分进行重构,以保留背景中起伏剧烈的边缘和角点,提高稀疏目标的重构精度。最后,将目标张量恢复为图像序列,利用自适应阈值分割方法得到最终的目标图像。与另外5种检测算法进行对比实验,结果显示,该方法的虚警率较Maxemeidan算法、Tophat算法、LIRDNet算法、DNANet算法以及WSNMSTIPT算法平均分别下降了71.4%、71.1%、68.5%、74.3%和20.47%;而在检测实时性方面,该算法耗时为Maxemeidan算法、DNANet算法以及WSNMSTIPT算法的42.4%、82.9%和28.7%。实验结果验证了该方法在检测性能上的优越性,表明该算法能够显著提高复杂背景干扰下的目标检测精度和效率。

     

  • 图 1  本文方法在不同典型场景下的检测结果

    Figure 1.  The detection results of the proposed algorithm in different scenes

    图 2  不同步长L下6组测试序列的ROC曲线

    Figure 2.  The ROC curves of different image sequences at different parameter $L$

    图 3  不同检测方法的红外弱小目标检测结果

    Figure 3.  The detection results of the representative frames in Sequence 1-6 by the six tested methods

    图 4  序列六的三维图像对比示意图

    Figure 4.  The 3D detection results of the representative frames in Sequence 6

    图 5  序列1-6的ROC曲线对比图

    Figure 5.  ROC curves of the detection results of Sequences 1-6

    表  1  $ {L_{1 - 2}} $STTV模型的求解

    Table  1.   The solution of $ {L_{1 - 2}} $ STTV model

    输入:红外图像序列${f_1},{f_2}, \cdots ,{f_P} \in { {\mathcal{R} }^{m \times n} }$,帧数步长$L$,正则化参数${\lambda _1},{\lambda _2},\alpha .$
    输出:背景张量${ { {\mathcal{B} } }^k}$,目标张量${ { {\mathcal{T} } }^k}$,噪声张量${ {\mathcal{N} }^k}.$
    初始化:输入图像序列转化为原始张量${ {\mathcal{F} } },$$\rho = 1.1,$
    ${ {\mathcal{B} }^0} = { {\boldsymbol{ {\mathcal{T} } } }^0} = { {\mathcal{N} }^0} = 0,{\mathcal{Y} }_1^0 = {\mathcal{Y} }_2^0 = 0,$${ {\mathcal{W} }^0} = {\mathcal{I} }$,Schattern $p$范数指数$p = 0.8,$${\mu _0} = 1\times10^{-2},{\mu _{\max } } = 1\times10^7,k = 0.$
    迭代循环: 收敛误差条件不满足时,执行
    1. 根据式(12)更新背景张量${ {\mathcal{B} }^{k + 1} }$;
    2. 根据式(22)、(23)、(24)更新${ {\mathcal{Z} }^{k + 1} }$;
    3. 根据式(27)更新目标张量${ {\mathcal{T} }^{k + 1} }$;
    4. 根据式(29)更新噪声张量${ {\mathcal{N} }^{k + 1} }$;
    5. 根据式(30)、(31)更新拉格朗日乘子和$ {\mu ^{k + 1}} $;
    6. 根据式(32)更新背景权重张量${ {\mathcal{W} }^{k + 1} }$;
    7. 判断下列收敛条件是否满足:
    ${ {\left\| { {\mathcal{F} } - {\mathcal{B} } - {\mathcal{T} } - {\mathcal{N} } } \right\|_F^2} \mathord{\left/ {\vphantom { {\left\| { {\mathcal{F} } - {\mathcal{B} } - {\mathcal{T} } - {\mathcal{N} } } \right\|_F^2} {\left\| {\mathcal{F} } \right\|_F^2} } } \right. } {\left\| {\mathcal{F} } \right\|_F^2} } \leqslant \varepsilon$
    满足则跳出循环,输出结果,否则执行步骤8;
    8. 迭代次数$k = k + 1$,返回步骤1;
    下载: 导出CSV

    表  2  实验数据特性

    Table  2.   The characteristic of the experimental data

    序号帧数尺寸背景特性目标SCR
    1120250×200天空场景,卷云层和噪声干扰2.24
    2120200×150天空场景,云层和噪声干扰4.35
    3120128×128地面场景,高亮背景干扰2.13
    4120200×158天空场景,高亮云层干扰0.94
    5120256×256地面场景,高亮杂波干扰1.76
    6120256×256地面场景,高亮杂波干扰1.01
    下载: 导出CSV

    表  3  不同方法在序列1至序列3的评价指标

    Table  3.   Quantitative evaluation results of the tested methods for the representative images of sequences 1-3

    算法序列1的第24帧序列2的第92帧序列3的第60帧
    LSNRGBSFSCRGCGLSNRGBSFSCRGCGLSNRGBSFSCRGCG
    Maxmedian0.530.731.972.721.882.526.582.610.820.713.194.48
    Tophat0.910.631.602.531.351.071.801.681.051.321.461.11
    LIRDNet1.042.4316.894.931.298.2731.853.850.941.704.682.75
    DNANet0.991.416.884.882.3712.3039.253.190.982.134.522.12
    WSNMSTIPT1.061.7213.357.75InfInfInf7.811.091.505.493.66
    本文算法1.122.9822.827.67InfInfInf8.871.102.5114.435.75
    下载: 导出CSV

    表  4  不同方法在序列4至序列6的评价指标

    Table  4.   Quantitative evaluation results of the tested methods for the representative images of sequences 4-6

    算法序列4的第76帧序列5的第72帧序列6的第117帧
    LSNRGBSFSCRGCGLSNRGBSFSCRGCGLSNRGBSFSCRGCG
    Maxmedian2.352.0512.946.301.391.2911.588.950.882.6212.594.80
    Tophat2.291.525.693.751.270.944.975.301.021.113.072.77
    LIRDNetNaNInfNaN0.00InfInfInf20.06NaNInfNaN0.00
    DNANetNaNInfNaN0.00NaNInfNaN0.00NaNInfNaN0.00
    WSNMSTIPTInfInfInf7.272.505.0273.5314.651.9314.64100.256.85
    本文算法InfInfInf15.85InfInfInf23.16InfInfInf12.33
    下载: 导出CSV

    表  5  算法运行时间比较

    Table  5.   Runtime comparison of different algorithms (s)

    算法序列1序列2序列3序列4序列5序列6
    Tophat1.931.651.152.202.162.70
    Maxmedian174.39110.1858.47114.21205.67209.48
    LIRDNet19.9239.1316.6438.4576.3683.62
    DNANet31.2665.4133.4258.24130.19126.58
    WSNMSTIPT79.8780.4166.2074.34527.15459.19
    本文算法20.8147.6924.8351.82109.69114.93
    下载: 导出CSV
  • [1] 黄乐弘, 曹立华, 李宁, 等. 深度学习的空间红外弱小目标状态感知方法[J]. 中国光学,2020,13(3):527-536.

    HUANG L H, CAO L H, LI N, et al. A state perception method for infrared dim and small targets with deep learning[J]. Chinese Optics, 2020, 13(3): 527-536. (in Chinese)
    [2] QIU Z, MA Y, FAN F, et al. Adaptive scale patch-based contrast measure for dim and small infrared target detection[J]. IEEE Geoscience and Remote Sensing Letters, 2022, 19: 1-5.
    [3] WAN M J, GU G H, XU Y K, et al. Total variation-based interframe infrared patch-image model for small target detection[J]. IEEE Geoscience and Remote Sensing Letters, 2022, 19: 7003305.
    [4] 何耀民, 何华锋, 徐永壮, 等. 基于改进小波变换的海上目标检测[J]. 系统工程与电子技术,2020,42(1):83-89. doi: 10.3969/j.issn.1001-506X.2020.01.12

    HE Y M, HE H F, XU Y ZH, et al. Marine target detection based on improved wavelet transform[J]. Systems Engineering and Electronics, 2020, 42(1): 83-89. (in Chinese) doi: 10.3969/j.issn.1001-506X.2020.01.12
    [5] DU J M, LU H ZH, ZHANG L P, et al. A spatial-temporal feature-based detection framework for infrared dim small target[J]. IEEE Transactions on Geoscience and Remote Sensing, 2022, 60: 3000412.
    [6] CHEN Y H, LI L Y, LIU X, et al. A multi-task framework for infrared small target detection and segmentation[J]. IEEE Transactions on Geoscience and Remote Sensing, 2022, 60: 5003109.
    [7] LIU X, LI L Y, LIU L Q, et al. Moving dim and small target detection in multiframe infrared sequence with low SCR based on temporal profile similarity[J]. IEEE Geoscience and Remote Sensing Letters, 2022, 19: 7507005.
    [8] WANG G H, TAO B J, KONG X, et al. Infrared small target detection using nonoverlapping patch spatial–temporal tensor factorization with capped nuclear norm regularization[J]. IEEE Transactions on Geoscience and Remote Sensing, 2022, 60: 5001417.
    [9] REED I S, GAGLIARDI R M, STOTTS L B. Optical moving target detection with 3-D matched filtering[J]. IEEE Transactions on Aerospace and Electronic Systems, 1988, 24(4): 327-336. doi: 10.1109/7.7174
    [10] LI M, ZHANG T X, YANG W D, et al. Moving weak point target detection and estimation with three-dimensional double directional filter in IR cluttered background[J]. Optical Engineering, 2005, 44(10): 107007. doi: 10.1117/1.2056586
    [11] BAI X ZH, ZHOU F G. Analysis of new top-hat transformation and the application for infrared dim small target detection[J]. Pattern Recognition, 2010, 43(6): 2145-2156. doi: 10.1016/j.patcog.2009.12.023
    [12] DESHPANDE S D, ER M H, VENKATESWARLU R, et al. Max-mean and max-median filters for detection of small targets[J]. Proceedings of SPIE, 1999, 3809: 74-83. doi: 10.1117/12.364049
    [13] LIU Y, PENG ZH M. Infrared small target detection based on resampling-guided image model[J]. IEEE Geoscience and Remote Sensing Letters, 2022, 19: 7002405.
    [14] CHEN C L P, LI H, WEI Y T, et al. A local contrast method for small infrared target detection[J]. IEEE Transactions on Geoscience and Remote Sensing, 2014, 52(1): 574-581. doi: 10.1109/TGRS.2013.2242477
    [15] WEI Y T, YOU X G, LI H. Multiscale patch-based contrast measure for small infrared target detection[J]. Pattern Recognition, 2016, 58: 216-226. doi: 10.1016/j.patcog.2016.04.002
    [16] DENG H, SUN X P, LIU M L, et al. Small infrared target detection based on weighted local difference measure[J]. IEEE Transactions on Geoscience and Remote Sensing, 2016, 54(7): 4204-4214. doi: 10.1109/TGRS.2016.2538295
    [17] MCINTOSH B, VENKATARAMANAN S, MAHALANOBIS A. Infrared target detection in cluttered environments by maximization of a target to clutter ratio (TCR) metric using a convolutional neural network[J]. IEEE Transactions on Aerospace and Electronic Systems, 2021, 57(1): 485-496.
    [18] 林再平, 李博扬, 李淼, 等. 结合跨尺度特征融合与瓶颈注意力模块的轻量型红外小目标检测网络[J]. 红外与毫米波学报,2022,41(6):1102-1112. doi: 10.11972/j.issn.1001-9014.2022.06.020

    LIN Z P, LI B Y, LI M, et al. Light-weight infrared small target detection combining cross-scale feature fusion with bottleneck attention module[J]. Journal of Infrared and Millimeter Waves, 2022, 41(6): 1102-1112. (in Chinese) doi: 10.11972/j.issn.1001-9014.2022.06.020
    [19] LI B Y, XIAO C, WANG L G, et al. Dense nested attention network for infrared small target detection[J]. IEEE Transactions on Image Processing, 2022, 32: 1745-1758.
    [20] GAO CH Q, MENG D Y, YANG Y, et al. Infrared patch-image model for small target detection in a single image[J]. IEEE Transactions on Image Processing, 2013, 22(12): 4996-5009. doi: 10.1109/TIP.2013.2281420
    [21] WANG Q Q, GAO Q X, SUN G, et al. Double robust principal component analysis[J]. Neurocomputing, 2020, 391: 119-128. doi: 10.1016/j.neucom.2020.01.097
    [22] DAI Y M, WU Y Q. Reweighted infrared patch-tensor model with both nonlocal and local priors for single-frame small target detection[J]. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2017, 10(8): 3752-3767. doi: 10.1109/JSTARS.2017.2700023
    [23] SUN Y, YANG J G, LI M, et al. Infrared small target detection via spatial–temporal infrared patch-tensor model and weighted Schatten p-norm minimization[J]. Infrared Physics &Technology, 2019, 102: 103050.
    [24] SUN Y, YANG J G, LI M, et al. Infrared small-faint target detection using non-i. i. d. mixture of Gaussians and flux density[J]. Remote Sensing, 2019, 11(23): 2831. doi: 10.3390/rs11232831
    [25] SUN Y, YANG J G, AN W. Infrared dim and small target detection via multiple subspace learning and spatial-temporal patch-tensor model[J]. IEEE Transactions on Geoscience and Remote Sensing, 2021, 59(5): 3737-3752. doi: 10.1109/TGRS.2020.3022069
    [26] BOYD S, PARIKH N, CHU E, et al. Distributed optimization and statistical learning via the alternating direction method of multipliers[J]. Foundations and Trends ® in Machine Learning, 2011, 3(1): 1-122.
    [27] LOU Y F, YIN P H, HE Q, et al. Computing sparse representation in a highly coherent dictionary based on difference of L1 and L2[J]. Journal of Scientific Computing, 2015, 64(1): 178-196. doi: 10.1007/s10915-014-9930-1
    [28] TAO P D, AN L T H. A D. C. optimization algorithm for solving the trust-region subproblem[J]. SIAM Journal on Optimization, 2017, 8(2): 476-505.
    [29] LOU Y F, ZENG T Y, OSHER S, et al. A weighted difference of anisotropic and isotropic total variation model for image processing[J]. SIAM Journal on Imaging Sciences, 2015, 8(3): 1798-1823. doi: 10.1137/14098435X
    [30] BECK A, TEBOULLE M. A fast iterative shrinkage-thresholding algorithm for linear inverse problems[J]. SIAM Journal on Imaging Sciences, 2009, 2(1): 183-202. doi: 10.1137/080716542
    [31] 赵鹏鹏, 李庶中, 李迅, 等. 融合视觉显著性和局部熵的红外弱小目标检测[J]. 中国光学,2022,15(2):267-275.

    ZHAO P P, LI SH ZH, LI X, et al. Infrared dim small target detection based on visual saliency and local entropy[J]. Chinese Optics, 2022, 15(2): 267-275. (in Chinese)
    [32] 程博阳, 李婷, 王喻林. 基于视觉显著性加权与梯度奇异值最大的红外与可见光图像融合[J]. 中国光学,2022,15(4):675-688.

    CHENG B Y, LI T, WANG Y L. Fusion of infrared and visible light images based on visual saliency weighting and maximum gradient singular value[J]. Chinese Optics, 2022, 15(4): 675-688. (in Chinese)
    [33] 刘杨帆, 曹立华, 李宁, 等. 基于YOLOv4的空间红外弱目标检测[J]. 液晶与显示,2021,36(4):615-623. doi: 10.37188/CJLCD.2020-0227

    LIU Y F, CAO L H, LI N, et al. Detection of space infrared weak target based on YOLOv4[J]. Chinese Journal of Liquid Crystals and Displays, 2021, 36(4): 615-623. (in Chinese) doi: 10.37188/CJLCD.2020-0227
  • 加载中
图(5) / 表(5)
计量
  • 文章访问数:  347
  • HTML全文浏览量:  191
  • PDF下载量:  173
  • 被引次数: 0
出版历程
  • 收稿日期:  2022-11-08
  • 修回日期:  2022-12-01
  • 网络出版日期:  2023-04-14

目录

    /

    返回文章
    返回