留言板

尊敬的读者、作者、审稿人, 关于本刊的投稿、审稿、编辑和出版的任何问题, 您可以本页添加留言。我们将尽快给您答复。谢谢您的支持!

姓名
邮箱
手机号码
标题
留言内容
验证码

Analysis of the Effect of Lens Shutter on Image Motion in Aerial Camera

Yu Chun-feng Chen Zhi-chao Jia Ping Wang Nai-xiang Hou Han

于春风, 陈志超, 贾平, 王乃详, 候汉. 航空相机镜间快门对像移的影响分析[J]. 中国光学. doi: 10.3788/CO.2019-0127
引用本文: 于春风, 陈志超, 贾平, 王乃详, 候汉. 航空相机镜间快门对像移的影响分析[J]. 中国光学. doi: 10.3788/CO.2019-0127
Yu Chun-feng, Chen Zhi-chao, Jia Ping, Wang Nai-xiang, Hou Han. Analysis of the Effect of Lens Shutter on Image Motion in Aerial Camera[J]. Chinese Optics. doi: 10.3788/CO.2019-0127
Citation: Yu Chun-feng, Chen Zhi-chao, Jia Ping, Wang Nai-xiang, Hou Han. Analysis of the Effect of Lens Shutter on Image Motion in Aerial Camera[J]. Chinese Optics. doi: 10.3788/CO.2019-0127

航空相机镜间快门对像移的影响分析

doi: 10.3788/CO.2019-0127
详细信息
  • 中图分类号: TP73

Analysis of the Effect of Lens Shutter on Image Motion in Aerial Camera

More Information
    Author Bio:

    YU Chun-feng(1979—), was born in Changchun, Jilin province, Doctor, associate professor, Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences. In 2013, graduated from University of Chinese Academy of Sciences, He research interests are aerial imaging and measurement technology. E-mail: hou791016@163.com

    CHEN Zhi-chao (1979-), was born in Tieling, Liaoning province, Doctor, associate professor, Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences. In 2016,graduated from University of Chinese Academy of Sciences, He research interests are automatic focusing technology of aerial camera. E-mail: 17522332@qq.com

    JIA Ping (1964-),, Doctor, professor, Ph.D.supervisor, Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences. He research interests are aerial imaging and measuring instrument technology. E-mail: jiap@ciomp,ac,cn

  • 摘要: 为了提高航空遥感相机的摄影分辨率,获得高分辨率的航空图像,除了采用具有高传递函数的光学系统和高质量成像介质以外,还要正确控制快门的曝光时间,以保证探测器能够获得合适的像移量,基于一种航空测绘相机镜间快门的结构形式及工作原理,以笛卡尔理论为基础,通过坐标变换的方法,建立地面目标和影像之间的矩阵关系,从而确定快门曝光时间和像移量的关系,结合相机速高比、像元尺寸等参数,对像移量及像移残差进行分析。根据相机的不同安装方式,以像移残差为1/3像元尺寸为标准,判定成像系统是否加入像移补偿机构,为相机的设计提供理论依据。通过静态测试及飞行试验对分析进行验证,试验结果表明,相机分辨力达到36.8 lp/mm,航拍图像良好,满足指标要求。
  • Figure  1.  Photograph of Shutter

    Figure  2.  Schematic diagram of blade scanning aperture

    Figure  3.  Forward image shift in camera mounted vertically

    Figure  4.  image motion vector in camera mounted vertically

    Figure  6.  image motion in camera tilt mounted forward

    Figure  5.  The relationship between exposure time and image motion value at difference speed-height ratio

    Figure  7.  The Schematic and histogram of image motion vector in camera lean mounted forward

    Figure  8.  The Schematic and histogram of Forward residual image motion in camera lean mounted forward

    Figure  9.  The relationship between exposure time and image shift at difference V/H and lean angle forward

    Figure  10.  diagram of coordinate transformation relation

    Figure  11.  The schematic and histogram of image shift vector caused by aircraft attitude change

    Figure  12.  Schematic diagram of experiment device

    Figure  13.  Measuring setup

    Figure  14.  Photo of the dynamic target

    Figure  15.  Radial Drone Image in flight

    Table  1.   Imaging experiment result

    Measurement timesVisual resolution(lp/mm)
    136.5
    236.5
    337.2
    436.5
    537.2
    Average36.8
    下载: 导出CSV
  • [1] SIERBAKOV.Design and Calculation of Aerial Camera[M]. The Association of Science and Technology Translation in Jilin, 1985.
    [2] WANG Z Z.Photogram Metry Principle[M]Beijing: Surveying and Mapping Press, 1979. (in Chinese)
    [3] ZHANG L, DING Y L, ZHANG H W. Design and Precison and Analysis of Curtain Type Shutter Based on Timing Belt[J]. Precision Eng, 2013, 21(2): 380-387. doi:  10.3788/OPE.20132102.0380
    [4] David Durfee, Walter Johnson, Scott Mcleod Melles Griot Optics Group. Adwanced Electro-mechanical Micro-shutter for Thermal Infrared Night Vision Imaging and Targeting Systems[J]. 55Science Parkway, Rochester, New York USA 14620.
    [5] LIU M, LIU G, Li Y Y, et al. The Effect of Image Motion on the Quality of Aerial Camera Images[J]. Opto-Electronic Engineering, 2004, 31(12): 12-15.
    [6] YUAN G Q. Research on the Calibration of inner orientation elements for Area Scan color CCD Mapping Camera with forward Image Motion Compensation Mechanism[D] Beijing: Graduate University of the Chinese Academy of Sciences, 2012.(in Chinese)
    [7] YU C F, LI H, et al. Design of the Lens Shutter Mechanism in the Aerial Camera[J]. Precision Eng, 2018, 26(1): 105-113. doi:  10.3788/OPE.20182601.0105
    [8] REN H, YUAN H Y. Research on Image Compensation of Airborne Camera of Focal Plane CCD[J]. Semiconductor Optoelectronics, 2011, 32(3): 417-423.
    [9] YU C F. Design and Analysis of Optical Characteristic on New Type Aerial Lens Shutter[D]. Beijing: Graduate University of the Chinese Academy of Sciences, 2013.(in Chinese)
    [10] YAN C X, WANG J Q. Method of coordination transformation for IM&IMC calculation in aerospace camerasystem[J]. Opt. and Precision Engineering, 2000, 8(3): 203-207.
    [11] CHEN B Y. Local Linear Enhancement of Luminance Histogram of Color Remote Sensing Image[J]. Opt. Precision Eng, 2017, 25(2): 503-508.
    [12] WANG J Q, YU P, YAN CH X, et al. Space Optical Remote Sensor Image Motion Velocity Vector Computational Modeling[J]. Acta Optica Sinica, 2004, 24(2): 1585-1589.
    [13] LI G, YANG M Y. Image Motion Measurement for Airborne Camera Based on Joint Transform Correlation[J]. Chinese Optics, 2015, 8(3): 401-406. doi:  10.3788/co.20150803.0401
  • [1] Jian-hua SHI, Bing-chen HAN.  Internal profile reconstruction of microstructures based on near-infrared light transmission reflection interferometry with optical path compensation . 中国光学, doi: 10.3788/CO.20191202.0395
    [2] Min ZHANG, Jin-guang LV, Jing-qiu LIANG, Zhong-zhu LIANG, Yu-xin QIN, Wei-biao WANG.  Error analysis and fabrication of low-stepped mirrors . 中国光学, doi: 10.3788/CO.20191204.0791
    [3] Fang-xi SONG, Wei-dong MENG, Yan XIA, Yan CHEN, Xiao-yun PU.  Measuring liquid-phase diffusion coefficient of aqueous sucrose solution using double liquid-core cylindrical lens . 中国光学, doi: 10.3788/CO.20181104.0630
    [4] 张玉欣, 刘宇, 葛文奇.  像移补偿技术的发展与展望 . 中国光学,
    [5] 贾红莉, 余自在.  曝光时间对上行传输光束强度起伏的影响 . 中国光学,
  • 加载中
计量
  • 文章访问数:  246
  • HTML全文浏览量:  106
  • 被引次数: 0
出版历程
  • 网络出版日期:  2020-04-03

Analysis of the Effect of Lens Shutter on Image Motion in Aerial Camera

doi: 10.3788/CO.2019-0127
  • 中图分类号: TP73

摘要: 为了提高航空遥感相机的摄影分辨率,获得高分辨率的航空图像,除了采用具有高传递函数的光学系统和高质量成像介质以外,还要正确控制快门的曝光时间,以保证探测器能够获得合适的像移量,基于一种航空测绘相机镜间快门的结构形式及工作原理,以笛卡尔理论为基础,通过坐标变换的方法,建立地面目标和影像之间的矩阵关系,从而确定快门曝光时间和像移量的关系,结合相机速高比、像元尺寸等参数,对像移量及像移残差进行分析。根据相机的不同安装方式,以像移残差为1/3像元尺寸为标准,判定成像系统是否加入像移补偿机构,为相机的设计提供理论依据。通过静态测试及飞行试验对分析进行验证,试验结果表明,相机分辨力达到36.8 lp/mm,航拍图像良好,满足指标要求。

English Abstract

于春风, 陈志超, 贾平, 王乃详, 候汉. 航空相机镜间快门对像移的影响分析[J]. 中国光学. doi: 10.3788/CO.2019-0127
引用本文: 于春风, 陈志超, 贾平, 王乃详, 候汉. 航空相机镜间快门对像移的影响分析[J]. 中国光学. doi: 10.3788/CO.2019-0127
Yu Chun-feng, Chen Zhi-chao, Jia Ping, Wang Nai-xiang, Hou Han. Analysis of the Effect of Lens Shutter on Image Motion in Aerial Camera[J]. Chinese Optics. doi: 10.3788/CO.2019-0127
Citation: Yu Chun-feng, Chen Zhi-chao, Jia Ping, Wang Nai-xiang, Hou Han. Analysis of the Effect of Lens Shutter on Image Motion in Aerial Camera[J]. Chinese Optics. doi: 10.3788/CO.2019-0127
    • The biggest difference between aerial remote sensing photography and ground photography is that the aerial remote sensor is always in motion during the photography process, which results in the change of the axis of sight of the remote sensor. In a certain exposure time of the camera, the relative movement between the photographed scene image and the detector will cause the image motion[1].The degree of image motion determines the ability of image to distinguish details. Therefore, the reducing the image shift can improve the image resolution[2].

      In the 1980s, the minimum exposure time of the lens shutter produced by Vinton UK was 3/1 000 s; The KC-6A mapping aerial photography camera produced by Fairchild USA is equipped with a Rapidyne lens shutter and has an exposure time range of 1/100 s ~1/1 000 s; The shutter of China’s aerospace cameras developed relatively late. After years of efforts, the exposure time range of the focal plane shutter applied to Hangjia series aerial cameras in 1980s reached 1/800 s~1/1 600 s.

      The shutter of aerial camera must satisfy both the required image density and the necessary quality factor[3] of the sensor in the whole image field, otherwise the image motion value will be larger than the allowable value. The method of mechanical image motion compensation and optical image motion compensation can not completely compensate the image motion value of each point in the image[4]. When the lens shutter opens aperture bars for exposure imaging, the image motion will result in the decrease of dynamic spatial resolution of the camera, which will seriously cause image blurring and tailing effect. In order to obtain a clear and accurate image, it is necessary to study the factors which affect the size and direction of image motion value[5].

    • Combining the technical requirements of the camera with the working characteristics of the shutter, an airborne lens shutter mechanism is developed, which has the characteristics of wide exposure time adjustment range and high shutter efficiency to ensure that the camera can obtain high-resolution and clear images[6]. The shutter is mainly composed of fast blade, slow blade, shutter shell, transmission gear train and drive motor. The shutter object is shown in Fig. 1. By controlling the rotation of the blade, the shutter exposes the aperture of the fast blade and the slow blade simultaneously. The fast blade controls the exposure time, and the slow blade controls the exposure period, which is equivalent to the shutter[7].

      Figure 1.  Photograph of Shutter

      Assuming the brightness of the target is uniform and unchanged, the aperture area changes with time to instead of the light flux. As shown in Fig.2, during the shutter operation period, the area of the light-through aperture changes. Point O is the origin of the coordinate system, that is, the axis of blade rotation. R is the radius of the light-through aperture.

      Figure 2.  Schematic diagram of blade scanning aperture

    • When the camera is mounted vertically, its axis of sight is perpendicular to the ground. As shown in Fig.3, the camera flies forward at speed v, the solid line is the position of the image plane at the beginning of exposure controlled by the shutter, the dotted line is the position of the image plane at the end of exposure. At the beginning of exposure time, the ground object points $A$ is transformed into conjugate image point $A_1$ on the image plane by the optical system. After exposure time $t$, the image plane moves to the dotted line position, and the image point $A_1$ moves to point ${A_2}$.At this time, by the optical system the ground object points $A$ images on the conjugate image points $B$ on the image plane. Therefore, in the exposure time, the image of the object points $A$ on the image plane is a straight line segment $\left| {B{A_2}} \right|$, which is the image motion value.

      Figure 3.  Forward image shift in camera mounted vertically

      As shown in Fig.3, the geometry of the vector is as follows:

      $$\delta = \left| {D{A_1}} \right| - \left| {MB} \right| = \frac{f}{H}(\left| {AC} \right| - \left| {AN} \right|) = \frac{f}{H}\nu t$$ (1)

      The image motion velocity is as follows:

      $$ {v_i} = \frac{{d\delta }}{{dt}} = \frac{f}{H}v $$ (2)

      where ${v_i}$ is image motion velocity; $f$ is length of focus; $H$ is altitude of plane; $t$ is real exposure time.

      When the lens shutter opens the aperture bar, the whole image plane receives the light energy at the same time, that is to say, the exposure time of each point on the image plane is exactly the same. Thus it is obvious that the scale of any image point on the vertical mounted camera image plane is the same. Therefore the image motion value is equal, as shown in Fig.4.

      Figure 4.  image motion vector in camera mounted vertically

      Usually when the camera receives the two parameters of speed and altitude provided by the aircraft, the two parameters are converted into one parameter for image motion compensation calculation, so formula (1) is converted into the following formula[10]:

      $$\delta = f\eta t$$ (3)

      where, $\eta $ is speed-height ratio.

      In this paper a digital aerial camera is applied to analysis. The focal length of the lens is 56 mm, and the pixel size of the CCD detector is 13 µm×13 µm. It is generally believed that the image quality will not be affected when the forward image motion value is less than 1/3 of the pixel size, that is to say, the image motion compensation is not needed when the image motion value is less than 4.3 µm. The real range of the speed-height ratio $\eta $ during the flight is 0.05≤$\eta $≤0.17(1/s). When the speed-height ratio changes, the relationship between the exposure time and the image motion value changes accordingly, as shown in Fig.6.

      Figure 6.  image motion in camera tilt mounted forward

      It can be seen from Fig.5 that the image motion value increases with the exposure time, and the higher the speed-height ratio, the faster the image motion value increases. The maximum of image motion value is 0.095 mm, and the minimum is 0.002 8 mm. When the exposure time is greater than 0.001 4 s or the speed-height ratio is greater than 0.07 rad/s, the image motion compensation mechanism must be applied to reduce the image motion. The real range of image motion compensation is ±1.8°,the accuracy is 0.003°/s. Only when the exposure time is less than 0.001 4 s and the speed-height ratio is between 0.05 rad/s and 0.17 rad/s, it is not necessary to apply the image motion compensation mechanism to reduce the image motion value, as shown in the shadow area.

      Figure 5.  The relationship between exposure time and image motion value at difference speed-height ratio

    • The camera's forward tilt installation mode is that the camera coordinate system (${s_c}$) rotates clockwise around the plane's transverse axis relative to the body coordinate system (${s_b}$), i.e. the intersection point E and M of the camera coordinate system (${s_c}$) with the ground and image plane move to points C and N. The process of generating forward image motion on image plane is shown in Fig.6. At the beginning of exposure, the ground object point A is transformed into the image point ${A_1}$ on image plane through optical system. After exposure time $t$, the ground object point A moves to the point B and becomes image point ${A_2}$ on image plane. The short line between the image point ${A_1}$ and the image point ${A_2}$ is the image formed by the object point $A$ on the image plane in the process of aircraft motion. $\delta $ is the image motion value.

      It is supposed that the coordinates of the image point ${A_1}$ in the image plane coordinate system are $(x,y,z)$, $z = 0$. The coordinate system ${s_p}$ is translated to the coordinate system ${s_c}$, and the coordinates after the counter-clockwise rotation angle $\beta $ is as follows:

      $$\left[ \begin{array}{l} {x'} \\ {y'} \\ {z'} \\ \end{array} \right] = \left[ {\begin{array}{*{20}{c}} 1&0&0 \\ 0&{\cos \beta }&{\sin \beta } \\ 0&{ - \sin \beta }&{\cos \beta } \end{array}} \right]\left[ \begin{array}{l} x \\ y \\ z - f \\ \end{array} \right]$$ (4)

      According to the geometric projection relation of optical system, it can be seen that the object point $A$ moves to the point $B$ after exposure time $t$, and the coordinates of the point $B$ in the body coordinate system are $(x'',y'',z'')$, as follows:

      $$\left[ \begin{array}{l} {x''} \\ {y''} \\ {z''} \\ 1 \\ \end{array} \right] = \left[ {\begin{array}{*{20}{c}} {H/Z'}&0&0&0 \\ 0&{H/Z'}&0&{ - vt} \\ 0&0&{H/Z'}&0 \\ 0&0&0&1 \end{array}} \right]\left[ \begin{array}{l} {x'} \\ {y'} \\ {z'} \\ 1 \\ \end{array} \right]$$ (5)

      where, $v$ is flight speed.

      The coordinates of the image point corresponding to object point $B$ formed by the optical system in the body coordinate system ${s_b}$ are $({x_1},{y_1},{z_1})$, at this time, the scale is ${z_1}/H$, which can be obtained from the geometric relationship of the imaging:

      $${x_1} = x'' \times \frac{{{z_1}}}{H} = \frac{{x'}}{{z'}}H \times \frac{{{z_1}}}{H} = \frac{{x'{z_1}}}{{z'}}$$ (6)
      $${y_1} = y'' \times \frac{{{z_1}}}{H} = \left(\frac{{y'}}{{z'}}H - vt\right) \times \frac{{{z_1}}}{H} = \frac{{y'{z_1}}}{{z'}} - \frac{{vt{z_1}}}{H}$$ (7)
      $${z_1} = {z_1}$$ (8)

      The body coordinate system ${s_b}$ is coincided with the coordinate system ${s_c}$ after the clockwise rotation angle $\beta $. The coordinates of the image points in the coordinate system ${s_c}$ are $({x_2},{y_2},{z_2})$, as follows:

      $$\left[ \begin{array}{l} {x_2} \\ {y_2} \\ {z_2} \\ \end{array} \right] = \left[ {\begin{array}{*{20}{c}} 1&0&0 \\ 0&{\cos \beta }&{ - \sin \beta } \\ 0&{\sin \beta }&{\cos \beta } \end{array}} \right]\left[ \begin{array}{l} {x_1} \\ {y_1} \\ {z_1} \\ \end{array} \right]$$ (9)

      The coordinates $({x_2},{y_2},{z_2})$ in the coordinate system ${s_c}$ are transformed into those in the image plane coordinate system ${s_p}$, that is, the coordinate system ${s_c}$ is moved $f$ negatively along the axis ${Z_c}$, and the coordinates $({x_3},{y_3},{z_3})$ after transformation are as follows:

      $${x_3} = {x_2}$$ (10)
      $${y_3} = {y_2}$$ (11)
      $${z_3} = {z_2} + f$$ (12)

      From formula(4)~(12), it can be concluded that both the image plane and the direction of the camera installed in the forward tilt mode will produce image motion, and the image motion value are, as follows.

      $${\delta _x} = \frac{{ - vt{{(x\sin \beta + f\cos \beta )}^2}}}{{vt\sin \beta \left( {x\sin \beta + f\cos \beta } \right) - Hf}}$$ (13)
      $${\delta _y} = \frac{{ - yvt\sin \beta (x\sin \beta + f\cos \beta )}}{{vt\sin \beta \left( {x\sin \beta + f\cos \beta } \right) - Hf}}$$ (14)

      It can be seen from formula (13) and (14) that the image motion value along the flight direction is only related to $x$ of the image plane coordinate system. And the image motion value in the vertical flight direction is related to $x$ and $y$, and the image motion is along the flight direction in the plane ${X_c}O{Z_c}$, and there is no image motion in the vertical direction. For digital aerial cameras, it can be shown from formula(14) that the maximum of image motion value in vertical flight direction is 0.0037 mm which is less than 1/3 of the pixel size when the LOS inclination $\beta = 3^\circ $,speed-height ratio $\eta = 0.17$ and shutter exposure time $t = 0.01s$.The image motion above mentioned will not affect the image quality. Therefore, only the image motion along the flight direction is considered. When the field of view angle is 0, the image motion value of the central field of view is as follows:

      $${\delta _{x0}} = \frac{{vtf{{\cos }^2}\beta }}{{H - vt\sin \beta \cos \beta }}$$ (15)
      $${\delta _{y0}} = 0$$ (16)

      It can be seen from formula (15) that equation (15) is the same as equation (3) when the forward tilt angle of the viewing axis $\beta $ is equal to $0^\circ $. It can be seen that the vertical installation of the camera is also a special case of the forward tilt installation.

      Distribution and histogram of image motion vectors in the full field of view on the image plane of the camera installed by forward tilt mode are shown in Fig. 7. The image plane is $7168 \times 4096$ pixel and 105 image points are distributed on the image plane for vector analysis. The direction of flight is along the direction of the 4096 pixel. Figure 7 shows the distribution of image motion vectors on the image plane in the situation that speed-height ratio is 0.16 rad/s, the shutter exposure time is 0.01 s, and the forward tilt angle is $5^\circ $. All vectors are analyzed by histogram[11].

      Figure 7.  The Schematic and histogram of image motion vector in camera lean mounted forward

      Histogram only counts the distribution of image motion along the flight direction. Combining formula (13) and (14), we can see that the maximum image motion value ${\delta _y}$ which is perpendicular to the flight direction occurs at the maximum values of $x$ and $y$, i.e. in the image plane coordinate system ${s_p}$, $(24.564,43.008)$ and $( - 43.008,24.564)$ p, and the minimum ${\delta _y}$ occurs at the position $y = 0$, i.e. in the axis $x$ of the coordinate system ${s_p}$. The maximum image motion value ${\delta _x}$ along the flight direction occurs at the location $x = 24.564$, and the minimum image motion value ${\delta _x}$ occurs at the location $x = - 24.564$. In the absence of the influence of the attitude angle of the aircraft, the installation of the camera's forward tilt mode will also result in image motion at different speeds, and the residual error of image motion value is as follows:

      $${\delta _{x\Delta }} = \frac{{vtf{{\cos }^2}\beta }}{{vt\sin \beta \cos \beta - H}} - \frac{{vt{{(x\sin \beta + f\cos \beta )}^2}}}{{vt\sin \beta \left( {x\sin \beta + f\cos \beta } \right) - Hf}}$$ (17)

      From formula(17), it can be seen that in the situation that speed-height ratio is 0.17 rad/s, the shutter exposure time is 0.01 s, and the forward tilt angle is $3^\circ $, the maximum forward image motion value along the flight direction is 0.004 49 mm, which is bigger than one-third of the pixel size and can not meet the imaging quality requirements. If the exposure time of the shutter is shortened to meet the requirements of imaging quality, the shortest exposure time should be 1/108 s. Through analysis, the distribution and histogram of image motion value residual vectors in full field of view on the camera image plane installed in forward tilt mode can be obtained as shown in Fig. 8.

      Figure 8.  The Schematic and histogram of Forward residual image motion in camera lean mounted forward

      From Fig.8, the residual image motion value of the central field of view is 0. And the larger the field angle, the larger the residual image motion value. The vector direction of the residual image motion value tends to point to the axis of sight, In addition, the residual image motion value of the whole image plane are distributed symmetrically with respect to the plane ${x_c}o{z_c}$.

      It can be seen from the histogram that the residual image motion value of more than 40 points is greater than 0.004 mm at the edge of the image plane. When the speed-height ratio changes, the relationship between exposure time and image motion value changes accordingly, as shown in figure 9.

      Figure 9.  The relationship between exposure time and image shift at difference V/H and lean angle forward

      From Fig.9, with the same shutter exposure time, the forward image motion value of the central field of view decreases gradually with the decrease of the speed-height ratio, while the forward image motion value of the central field of view increases gradually with the decrease of the rake angle $\beta $. When the rake Angle is $0^\circ $, the relationship between image motion and exposure time is the same as when the camera is installed vertically. The maximum exposure time of the shutter between the mirrors in the shadow area is 0.001 9 s.

    • The flight attitude of an aircraft changes at any moment, and there are three kinds of flight attitude changes, namely pitch, roll and yaw, which are actually the three Euler angle changes between the body coordinate system (camera coordinate system) and the track coordinate system. The process of the ground object's position transformation from the fixed coordinate system on the vertical ground to the image plane coordinate system is shown in Fig. 10[12].

      Figure 10.  diagram of coordinate transformation relation

      The image motion caused by the change of flight attitude is necessary to analyze through the rotation relation between the track coordinate system and the body coordinate system. The transformation process is as follows:

      $$\begin{split} & \left[ {\begin{array}{*{20}{c}} {{x_p}} \\ {{y_p}} \\ {{z_p}} \\ 1 \end{array}} \right] = \left[ {\begin{array}{*{20}{c}} { - \dfrac{f}{H}}&0&0&0 \\ 0&{ - \dfrac{f}{H}}&0&0 \\ 0&0&{ - \dfrac{f}{H}}&{ - f} \\ 0&0&0&1 \end{array}} \right]\left[ {\begin{array}{*{20}{c}} 1&0&0&0 \\ 0&{\cos \varphi }&{\sin \varphi }&0 \\ 0&{ - \sin \varphi }&{\cos \varphi }&0 \\ 0&0&0&1 \end{array}} \right]\left[ {\begin{array}{*{20}{c}} {\cos \theta }&0&{\sin \theta }&0 \\ 0&1&0&0 \\ { - \sin \theta }&0&{\cos \theta }&0 \\ 0&0&0&1 \end{array}} \right] \\ & \left[ {\begin{array}{*{20}{c}} {\cos \psi }&{\sin \psi }&0&0 \\ { - \sin \psi }&{\cos \psi }&0&0 \\ 0&0&1&0 \\ 0&0&0&1 \end{array}} \right]\left[ {\begin{array}{*{20}{c}} 1&0&0&{ - vt} \\ 0&1&0&0 \\ 0&0&1&{ - H} \\ 0&0&0&1 \end{array}} \right]\left[ {\begin{array}{*{20}{c}} {{x_g}} \\ {{y_g}} \\ {{z_g}} \\ 1 \end{array}} \right] \end{split} $$ (18)

      When the attitude of the plane don’t change at the initial moment of exposure, the three Euler angles are all 0. The coordinates of the ground object points corresponding to $({x_p},{y_p},{z_p})$ at any point on the image plane are $({x_g},{y_g},0)$ in the fixed coordinate system of the vertical ground. The relationship between object points and image points can be known from geometric optics,as follows:

      $${x_g} = - \frac{H}{f}{x_p},\;{y_g} = - \frac{H}{f}{y_p}$$ (19)

      After the exposure time t of the shutter between mirrors, the aircraft flies $vt$ with respect to the ground in the direction of track coordinate system ${X_k}$, that is, the body coordinate system moves $vt$ with respect to the fixed coordinate system on the vertical ground. Euler Angle can be obtained by multiplying by $t$ the angular velocity of the plane rotating around the three coordinate axes of the body coordinate system.

      At this point, the coordinates $({x_g},{y_g},0)$ of ground object points in the fixed coordinate system of vertical ground become $({x'_p},{y'_p},{z'_p})$ through the optical system in the corresponding coordinate system of image plane in the image plane coordinate system, and can be obtained from equation (18).

      $$ \begin{split} & \left[ {\begin{array}{*{20}{c}} {{{x'}_p}} \\ {{{y'}_p}} \\ {{{z'}_p}} \\ 1 \end{array}} \right] =\\ & \left[ {\begin{array}{*{20}{c}} { - \dfrac{f}{H}\cos \theta \cos \psi }&{ - \dfrac{f}{H}\cos \theta \sin \psi } &{ - \dfrac{f}{H}\sin \theta }\\ {\dfrac{f}{H}vt\cos \theta \cos \psi + f\sin \theta }\\ {\dfrac{f}{H}(\sin \varphi \sin \theta cos\psi + \cos \varphi \sin \psi )}&{\dfrac{f}{H}(\sin \varphi \sin \theta \sin \psi - \cos \varphi \cos \psi )} & { - \dfrac{f}{H}\sin \varphi \cos \theta }\\ { - \dfrac{f}{H}vt(\sin \varphi \sin \theta \cos \psi + \cos \varphi \sin \psi ) + f\sin \varphi \cos \theta }\\ {\dfrac{f}{H}(\cos \varphi \sin \theta cos\psi - \sin \varphi \sin \psi )}&{\dfrac{f}{H}(\cos \varphi \sin \theta \sin \psi + \sin \varphi \cos \psi )} & { - \dfrac{f}{H}\cos \varphi \cos \theta }\\ { - \dfrac{f}{H}vt(\cos \varphi \sin \theta \cos \psi - \sin \varphi \sin \psi ) + f\cos \varphi \cos \theta - f}\\ 0&0 & 0\\ 1 \end{array}} \right]\\ & \left[ {\begin{array}{*{20}{c}} {{x_g}} \\ {{y_g}} \\ 0 \\ 1 \end{array}} \right] \end{split} $$ (20)

      Substituting equation (19) into the above equation, we can get:

      $$ \begin{split} {x'_p} =& \cos \theta \cos \psi {x_p} + \cos \theta \sin \psi {y_p} \\ & + \frac{f}{H}vt\cos \theta \cos \psi + f\sin \theta \end{split} $$ (21)
      $$ \begin{split} {{y'}_p} = & f\sin \varphi \cos \theta + \cos \varphi \cos \psi {y_p} \\ & - (\sin \varphi \sin \theta cos\psi + \cos \varphi \sin \psi ){x_p} \\ & - \sin \varphi \sin \theta \sin \psi {y_p} \\ & - \frac{f}{H}vt(\sin \varphi \sin \theta \cos \psi + \cos \varphi \sin \psi ) \end{split} $$ (22)
      $$\begin{split} {{z'}_p} = & - (\cos \varphi \sin \theta cos\psi - \sin \varphi \sin \psi ){x_p}\\ & - (\cos \varphi \sin \theta \sin \psi + \sin \varphi \cos \psi ){y_p} \\ & - \frac{f}{H}vt(\cos \varphi \sin \theta \cos \psi - \sin \varphi \sin \psi ) \\ & + f\cos \varphi \cos \theta - f \\ \end{split} $$ (23)

      As it can be seen from the above analysis, that the image motion caused by the flight attitude after the exposure time $t$ of the shutter passes along the three axes of the image plane coordinate system, and the image motion value along the three axes of the image plane coordinate system is as follows:

      $$\begin{split} {\delta _x} =& {{x'}_p} - {x_p} = \cos \theta \cos \psi {x_p} + \cos \theta \sin \psi {y_p} \\ & + \frac{f}{H}vt\cos \theta \cos \psi - f\sin \theta - {x_p} \end{split} $$ (24)
      $$\begin{split} {\delta _y} =& {{y'}_p} - {y_p} = f\sin \varphi \cos \theta + \cos \varphi \cos \psi {y_p} - \\ & (\sin \varphi \sin \theta cos\psi + \cos \varphi \sin \psi ){x_p} \\ & - \sin \varphi \sin \theta \sin \psi {y_p} \\ & - \frac{f}{H}vt(\sin \varphi \sin \theta \cos \psi + \cos \varphi \sin \psi ) - {y_p} \end{split} $$ (25)
      $$\begin{split} {\delta _z} =& {{z'}_p} - {z_p} = - (\cos \varphi \sin \theta cos\psi - \sin \varphi \sin \psi ){x_p} \\ & - (\cos \varphi \sin \theta \sin \psi + \sin \varphi \cos \psi ){y_p}\\ & - \frac{f}{H}vt(\cos \varphi \sin \theta \cos \psi \\ & - \sin \varphi \sin \psi ) + f\cos \varphi \cos \theta - f - {z_p} \end{split} $$ (26)

      From equation(24), the forward image motion caused by the flight attitude is only related to speed-height ratio, the focal length of the lens, the Pitch angle and the Yaw angle. And the Roll angle has nothing to do with the forward image motion. When the attitude of aircraft don’t change, and all three Euler angles are zero, equation (24) and equation (1) are the same. The amount of image motion value in the three directions is related to ${x_p}$ and ${y_p}$. Equation (26) is defocusing amount, which is also related to ${z_p}$.

      Through the analysis of equations (24) and (25), it can be seen that the image motion is mainly caused by the relative motion between the aircraft and the ground, while the image motion caused by other causes is relatively smaller one order of magnitude. Therefore, as long as the forward image motion is effectively compensated, the effect of image motion on image quality can be basically eliminated. The image motion value of the central field of view is as follows:

      $$ {\delta _{x0}} = \frac{f}{H}vt\cos \theta \cos \psi - f\sin \theta $$ (27)
      $$ {\delta _{y0}} = f\sin \varphi \cos \theta - \frac{f}{H}vt(\sin \varphi \sin \theta \cos \psi + \cos \varphi \sin \psi ) $$ (28)

      According to equation (27), when both Pitch angle and Yaw angle are equal to $0^\circ $, equation (27) and equation (3) are the same. The image motion vector distribution and histogram on the all field of sight by the camera with changed flight attitude is shown in Fig.11, and along the 4096 pixel direction is the flight direction. 105 points are uniform selected on the surface as vector analysis, in Fig.11 where the speed-height ratio is 0.16 rad/s, the shutter exposure time is 0.01 s and three Euler angles are $5^\circ $.

      Figure 11.  The schematic and histogram of image shift vector caused by aircraft attitude change

      It can be seen from the histogram that on the whole image plane total statistical points whose image motion value is bigger than 0.004 mm reach 77/105.

    • In order to verify the feasibility of this methods, a experiment is conducted. The test principle is illustrated in Fig 12.

      Figure 12.  Schematic diagram of experiment device

      The mapping camera was installed in front of the dynamic target generator, and the alignment between the visual axis and the target center was adjusted. The imaging of the dynamic target generator by the camera was used to verify whether its dynamic resolution met the requirements [12].

      The experiment device is shown in Fig.13. The imaging CCD detector is an aerial scan CCD with a resolution of 7 168×4 096, pixel size of 13 µm×13 µm and a frame rate of 30 fps. The focal length of the mapping camera is 56 mm, relative aperture is 1:6 and the operating wavelength is 0.4~0.9 µm.By adjusting the target generator to simulate different speed-height ratios and shutter exposure time, the discrimination rate plate image is obtained, as shown in FIG14. The obtained experimental results are shown in Table 1. The visual resolution of the image can reach 36.8 lp/mm, The image achieves the required precision. In flight experiment test, the image is clear as shown in FIG. 15.

      Table 1.  Imaging experiment result

      Measurement timesVisual resolution(lp/mm)
      136.5
      236.5
      337.2
      436.5
      537.2
      Average36.8

      Figure 13.  Measuring setup

      Figure 14.  Photo of the dynamic target

      Figure 15.  Radial Drone Image in flight

      The diffraction limit spatial resolution of the optical system is 38.5 lp/mm. The spatial resolution design index of the mapping camera is 34 lp/mm. According to the control precision requirement, the image motion value of the image is less than 1/3 pixel size, that is to say, the image motion value is less than 4.3 µm. The spatial resolution of the identification plate imaging experiment can reach 36.8 lp/mm, which is close to the diffraction limit resolution and meets the requirements of the technical index.

    • Based on the requirement of digital aerial mapping camera, a lens shutter of airborne remote sensors is designed, the influence of the installation mode of cameras on image motion is analyzed. The influence of the aircraft flight attitude on image motion is analyzed. Combined with the camera parameters such as speed-height ratio, the relationship between the lens shutter exposure time and the image motion is derived. In the case of minimal system signal-to-noise ratio, the short shutter exposure time can reduce the image motion value, which lead to clear image of aerial camera, as to provide theoretical basis for adding the IMC mechanism. Through experimental test and flight test, the clear image of discrimination rate plate and flight target were obtained. The spatial resolution of the flight target imaging can reach 36.8 lp/mm, which is close to the diffraction limit resolution and meets the requirements of the technical index.

WeChat 关注分享

返回顶部

目录

    /

    返回文章
    返回