Volume 6 Issue 6
Dec.  2013
Turn off MathJax
Article Contents
JI Shu-jiao, ZHU Ming, HU Han-ping. Aero-borne electronic image stabilization based on feature point matching[J]. Chinese Optics, 2013, 6(6): 841-849. doi: 10.3788/CO.20130606.841
Citation: JI Shu-jiao, ZHU Ming, HU Han-ping. Aero-borne electronic image stabilization based on feature point matching[J]. Chinese Optics, 2013, 6(6): 841-849. doi: 10.3788/CO.20130606.841

Aero-borne electronic image stabilization based on feature point matching

  • Received Date: 19 Sep 2013
  • Rev Recd Date: 23 Nov 2013
  • Publish Date: 10 Dec 2013
  • Electronic Image Stabilization(EIS) technology usually is employed to remove the random jitter generated by the imaging equipment and to stabilize its video output. Firstly, the development status of EIS is introduced. Then the motion estimation module is studied in details, which is one of the most important modules of EIS. Both the direction motion estimation algorithms and the feature-points-based matching algorithms are discussed. Furthermore, the motion correction and compensation algorithm are presented. Finally, according to the difficulties and the future trends of the EIS, the developing direction for feature matching algorithms of EIS is proposed.

     

  • loading
  • [1] 赵红颖,金宏,熊经武. 电子稳像技术概述[J]. 光学 精密工程,2001,8(4):353-359. ZHAO H Y,JIN H,XIONG J W. Overview of the electronic image stabilization technology[J]. Opt. Precision Eng.,2001,8(4): 353-359.(in Chinese) [2] 王志民,徐晓刚. 电子稳像技术综述[J]. 中国图象图形学报,2010,15(3):470-480. WANG ZH M,XU X G. A survey on electronic image stabilization[J]. J. Image and Graphics,2010,15(3):470-480.(in Chinese) [3] 钟平. 机载电子稳像技术研究[D].长春:中国科学院长春光学精密机械与物理研究所,2003. ZHONG P. Study on electronic image stabilization technology for the image sequences of the aero-borne camera system[D]. Changchun:Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences,2003.(in Chinese) [4] 孙辉,李志强,孙丽娜,等. 基于相位相关的亚像素配准技术及其在电子稳像中的应用[J]. 中国光学与应用光学,2010,3(5):480-485. SUN H,LI ZH Q,SUN L N,et al.. Sub-pixel registration based on phase correlation and its application to electronic image stabilization[J]. Chinese J. Opt. Appl. Opt.,2010,3(5):480-485.(in Chinese) [5] 李迪. 微型飞行器电子稳像技术研究[D].长春:中国科学院长春光学精密机械与物理研究所,2012. LI D. Study on electronic digital image stabilization technology for the image sequences of MAV[D]. Changchun:Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences,2012.(in Chinese) [6] 王斌,赵跃进. 基于电子稳像跟踪技术的运动滤波算法[J]. 光学 精密工程,2009,17(1):202-206. WANG B,ZHAO Y J. Motion filtering algorithm for tracking technology based on image stabilization[J]. Opt. Precision Eng.,2009,17(1):202-206.(in Chinese) [7] 张坤,许廷发,王平,等. 高精度实时全帧频SURF电子稳像算法[J]. 光学 精密工程,2011,19(8):1964-1972. ZHANG K,XU T F,WANG P. Rea-l time ful-l frame digital image stabilization system by SURF[J]. Opt. Precision Eng.,2011,19(8):1964-1972.(in Chinese) [8] 朱娟娟,郭宝龙. 一种鲁棒的电子稳像系统[J]. 西安电子科技大学学报 (自然科学版),2007,34(3):418-422. ZHU J J,GUO B L. Electronic image stabilization system based on global features tracking[J]. J. Xidian University(Nature & Science Edition),2007,34(3):418-422.(in Chinese) [9] HUANG J C. Automatic feature-based global motion estimation in video sequences[J]. IEEE,2004,50(3):911-915. [10] ANTONIO R K,ROLAND G. A wavelet-based approach to image feature stability assessment[J]. IEEE,206,22:1-25. [11] ANDREW L,JANUSZ K,WILIAM C K. Probabilistic video stabilization using Kalman filtering and mosaicking[J]. Image and video Communication and Processing,2003,5022:663-674. [12] ERTURK S. Digital image stabilization with sub-image phase correlation based global motion estimation[J]. IEEE T. Consumer Electronics,2003,12:1320-1325. [13] HO D S,JOON L. Digital image stabilization using simple estimation of the rotational and translational motion. Proc. SPIE 5810, Acquisition, Tracking, and Pointing XIX,Orland,Florida,USA,March 2005. [14] XU L D,LIN X G. Digital image stabilization based on circular block matching[J]. IEEE T. Consumer Electronics,2006,52(2):565-574. [15] JINHEE L,SANGKEUN L. Digital image stabilization based on statistical selection of feasible regions[J]. IEEE Transactions on Consumer Electronics,2009,55(4):1748-1755. [16] POURREZA H R,RAHMATI M,BEHAZIN F. An electronic digital image stabilizer based on stationary wavelet transform(SWT) image procession[J]. Proceeding of 2003 International Conference on,2003,3:383-386. [17] ANGELOS A A,ANDREADIS I. Digital image stabilization by independent component analysis[J]. IEEE Trans. Instrumentation and Measurement,2010,59(7):1755-1763. [18] SANJEEV K,HALEH A,MAINAK B,et al.. Real-time affine global motion estimation using phase correlation and its application for digital image stabilization[J]. IEEE T. Image Processing,2011,20(12):3406-3418. [19] KONSTANTINOS I,IOANNIS A A. Digital image stabilization method based on the hilbert huang transform[J]. IEEE T. Instrumentation and Measurement,2012,61(9):2446-2457. [20] 李迪,陈向坚,续志军,等. 模糊神经网络在机载相机稳像中的应用[J]. 浙江大学学报 (工学版),2012,46(8):1540-1545. LI D,CHEN X J,XU ZH J,et al.. Fuzzy neural network with self-organizing recurrent intervals for image stabilization of the airborne camera[J]. J. Zhejiang University(Engineering Science Edition),2012,46(8):1540-1545.(in Chinese) [21] 钟平,于前洋,金光. 基于特征点匹配技术的运动估计与补偿方法[J]. 光电子·激光,2004,15(1):73-77. ZHONG P,YU Q Y,JIN G. Motion estimation and motion compensation based on matching technology of feature point[J]. J. Optoelectronics·Laser,2004,15(1):73-77. [22] 吉淑娇,朱明,胡汉平,等. 基于特征匹配的视频稳像算法[J]. 吉林大学学报 (工学版),2013,43(增刊):322-325. JI SH J,ZHU M,HU H P,et al.. Video stabilization algorithm based on the characteristics matching[J]. J. Jilin University(Engineering and Technology Edition),2013,43 (Sup.):322-325. [23] LOWE D G. Distinctive image features from scale-invariant keypoints[J]. International J. Computer Vision,2004,60(2):91-110. [24] BATTIATO S,GALLO G,PUGLISI G,et al.. SIFT Feature tracking for video stabilization[C]. International conference on Image Analysis and Processing,Modena 2007. [25] BAY H,TUYTELAARS T,GOOL L V. SURF: speeded up robust features[C]. The Ninth European Conference on Computer Vision(ECCV).Graz,Austria: Springer,2006:404-417. [26] BINOY P. Video stabilization using speeded up robust features[C]. Communications and Signal Processing(ICCSP),2011:527-531. [27] 王洪,嵇晓强,戴明,等. 一种改进的快速鲁棒特征匹配算法[J]. 红外与激光工程,2012,41(3):811-817. WANG H,JI X Q,DAI M,et al.. Improved speed up robust feathers matching algorithm[J]. Infrared and Laser Eng.,2012,41(3):811-817. (in Chinese) [28] 李小昌,朱丹. 采用尺度不变特征和区域选择的图像配准方法[J]. 红外与激光工程,2012,41(2):537-542. LI X CH,ZHU D. Image registration method based on region selection and Scale Invariant feature transform-invariant feature[J]. Infrared and Laser Eng.,2012,41(2):537-542.(in Chinese) [29] 吴威,许廷发,王亚伟,等. 高精度全景补偿电子稳像[J]. 中国光学,2013,6(3):378-385. WU W,XU T F,WANG Y W,et al.. High precision digital image stabilization with full frame compensation[J]. Chinese Optics,2013,6(3):378-385.(in Chinese) [30] STEFAN L C,ROLAND S. BRISK:binary robust invariant scalable keypoints[C]. In proceedings of the IEEE international conference on computer vision(ICCV),2011,2548-2555. [31] 许允喜,蒋云良,陈方. 惯性导航系统中基于BRISK的快速镜像匹配方法[J]. 光电子·激光,2012,23(8):1589-1595. XU Y X,JIANG Y L,CHEN F. Rapid scene matching algorithm based on BRISK for inertial integrated navigation system[J]. J. Optoelectronics·Laser,2012,23(8):1589-1595. [32] ERTURK S. Image sequence stabilization based on kalman filtering of frame positions[J]. Electronics Letters,2001,37(20):1217-1219. [33] GULLU M K,YAMAN E,ERTURK S. Image sequence stabilization using fuzzy adaptive Kalman filtering[J]. Electronics Letters,2003,39(5):429-431. [34] ZHANG F,WANG X T,XU X G,et al.. Electronic image stabilization algorithm based on fixed-lag smooth filtering[J]. Optoelectronics Letters,2007,3(4):308-311. [35] YANG J L,SCHONFELD D,MOHAMED M. Robust video stabilization based on particle filter tracking of projected camera motion[J]. IEEE Transactions on Circuits and Systems for Video Technology,2009,19(7):945-954. [36] JIN J S,ZHU Z G,XU G. Y. A stable vision system for moving vehicles[J]. IEEE T. Intelligent Transportation Systems,2000,1 (1): 32-39. [37] 姚军,蒋晓瑜,杜登崇,等. 使用粒子滤波器实现电子稳像[J]. 光学 精密工程,2009,17(5):1105-1110. YAO J,JIANG X Y,DU D CH,et al.. Digital image stabilization based on particle filter[J]. Opt. Precision Eng.,2009,17(5):1105-1110.(in Chinese) [38] HUNG Y Q,JIANG X Y. Application of adaptive α-β filtering algorithm to electronic image stabilization[C]. 2011 International Conference on Mechatronic Science, Electric Engineering and Computer, August 19-22,2011,Jilin,China,322-325. [39] MATSUSHITA Y,OFEK E,GE W,et al.. Full-frame video stabilization with motion inpainting[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence,2006,28(7): 1150-1163. [40] 杨占龙,郭宝龙. 基于兴趣点伪泽尼克矩的图像拼接[J]. 中国激光,2007,34 (11):1548-1552. YANG ZH L,GUO B L. An image mosaic technique based on invariant moments of interest points[J]. Chinese J·Lasers 2007,34(11):1548-1552.(in Chinese) [41] 杨占龙,郭宝龙. 基于兴趣点不变矩的图像拼接方法[J]. 光电子·激光,2007,18(6):738-740. YANG ZH L,GUO B L. An image mosaic technique based on invariant moments of interest points[J]. J. Optoelectronics·Laser,2007,18(6):738-740.(in Chinese)
  • 加载中

Catalog

    通讯作者: 陈斌, bchen63@163.com
    • 1. 

      沈阳化工大学材料科学与工程学院 沈阳 110142

    1. 本站搜索
    2. 百度学术搜索
    3. 万方数据库搜索
    4. CNKI搜索
    Article views(2302) PDF downloads(751) Cited by()
    Proportional views
    Related

    /

    DownLoad:  Full-Size Img  PowerPoint
    Return
    Return