| Citation: | LIU Yu-hao, WU Fu-pei, WU Shu-zhuang, WANG Rui. Binocular 3D reconstruction method based on interpolation super-resolution[J]. Chinese Optics, 2024, 17(4): 862-874. doi: 10.37188/CO.2023-0214
|
The reconstruction of the three-dimensional surface morphology of objects based on binocular stereo matching is constrained by physical conditions such as sensor size, lens focal length, and environmental light. A binocular surface three-dimensional reconstruction method based on interpolation super-resolution is proposed in response to this issue. First, at the image preprocessing stage, an image enhancement method based on wavelet transform and dual histogram equalization fusion is established to overcome the problems of traditional binocular vision limited by complex environmental light interference. Second, a super-resolution algorithm based on Lagrange and cubic polynomial interpolation is constructed to increase the image’s pixel density and add image details to the binocular matching cost calculation stage, thereby improving the matching accuracy. Finally, a simple linear iterative clustering (SLIC) method is used to segment the target image, and a secondary surface fitting is performed for each segmented area to obtain a height curve that is more closely aligned with the actual surface of the object, which can reduce the reconstruction error and improve the reconstruction accuracy. The experimental results show that the average relative error of the global height measurement of 5 sets of measurement samples is ±2.3%, the average measurement time of the experiment is 1.8828 s, and the maximum time is 1.9362 s. This is a significant improvement over traditional methods. Experimental analysis results verify the effectiveness of the proposed algorithm.
| [1] |
WU F P, ZHU S K, YE W L. A single image 3D reconstruction method based on a novel monocular vision system[J]. Sensors, 2020, 20(24): 7045. doi: 10.3390/s20247045
|
| [2] |
NASRULLOH A V, WILLCOCKS C G, JACKSON P T G, et al. Multi-scale segmentation and surface fitting for measuring 3-D macular holes[J]. IEEE Transactions on Medical Imaging, 2018, 37(2): 580-589. doi: 10.1109/TMI.2017.2767908
|
| [3] |
WANG Y Y, ZHANG H T, XUE J SH, et al. Measurement of three-dimensional pavement morphology using binocular reconstruction improved by second-order fusion algorithm[J]. Automation in Construction, 2024, 157: 105152. doi: 10.1016/j.autcon.2023.105152
|
| [4] |
WANG Y Z, JIA H R, JIA P X, et al. A novel algorithm for three-dimensional shape reconstruction for microscopic objects based on shape from focus[J]. Optics & Laser Technology, 2024, 168: 109931.
|
| [5] |
DU F, WANG K, ZHANG G J, et al. Damage characteristics of coal under different loading modes based on CT three-dimensional reconstruction[J]. Fuel, 2022, 310: 122304. doi: 10.1016/j.fuel.2021.122304
|
| [6] |
尹仕斌, 任永杰, 刘涛, 等. 机器视觉技术在现代汽车制造中的应用综述[J]. 光学学报,2018,38(8):11-22.
YIN SH B, REN Y J, LIU T, et al. Review on application of machine vision in modern automobile manufacturing[J]. Acta Optica Sinica, 2018, 38(8): 11-22. (in Chinese).
|
| [7] |
GUO X ZH, SHI ZH Y, YU B, et al. 3D measurement of gears based on a line structured light sensor[J]. Precision Engineering, 2020, 61: 160-169. doi: 10.1016/j.precisioneng.2019.10.013
|
| [8] |
SIDKI H M, AMER M. Evaluation of CMM for flatness measurements[J]. Metrology and Measurement Systems, 2008, 15(4): 585-593.
|
| [9] |
GUILLORY J, TRUONG D, WALLERAND J P, et al. An SI-traceable multilateration coordinate measurement system with half the uncertainty of a laser tracker[J]. Measurement Science and Technology, 2023, 34(6): 065016. doi: 10.1088/1361-6501/acc26a
|
| [10] |
LIN J R, XIN R K, SHI SH D, et al. An accurate 6-DOF dynamic measurement system with laser tracker for large-scale metrology[J]. Measurement, 2022, 204: 112052. doi: 10.1016/j.measurement.2022.112052
|
| [11] |
HUANG J Q, SUN M ZH, MA J J, et al. Super-resolution image reconstruction for high-density three-dimensional single-molecule microscopy[J]. IEEE Transactions on Computational Imaging, 2017, 3(4): 763-773. doi: 10.1109/TCI.2017.2699425
|
| [12] |
SHI CH Y, LUO X B, GUO J, et al. Three-dimensional intravascular reconstruction techniques based on intravascular ultrasound: a technical review[J]. IEEE Journal of Biomedical and Health Informatics, 2018, 22(3): 806-817. doi: 10.1109/JBHI.2017.2703903
|
| [13] |
WANG ZH ZH. Robust three-dimensional face reconstruction by one-shot structured light line pattern[J]. Optics and Lasers in Engineering, 2020, 124: 105798. doi: 10.1016/j.optlaseng.2019.105798
|
| [14] |
张新荣, 王鑫, 王瑶, 等. 基于转动式二维激光扫描仪和多传感器的三维重建方法[J]. 中国光学(中英文),2023,16(3):663-672. doi: 10.37188/CO.2022-0159
ZHANG X R, WANG X, WANG Y, et al. 3D reconstruction method based on a rotating 2D laser scanner and multi-sensor[J]. Chinese Optics, 2023, 16(3): 663-672. (in Chinese). doi: 10.37188/CO.2022-0159
|
| [15] |
BEVACQUA M T, SCAPATICCI R. A compressive sensing approach for 3D breast cancer microwave imaging with magnetic nanoparticles as contrast agent[J]. IEEE Transactions on Medical Imaging, 2016, 35(2): 665-673. doi: 10.1109/TMI.2015.2490340
|
| [16] |
SUN SH L, WANG X Y, CHEN Y J. Retracted: the application value of CT three-dimensional microscope reconstruction technology in the diagnosis of cervical cancer[J]. Scanning, 2022, 2022: 5648195.
|
| [17] |
WANG ZH ZH, ZHOU Q, SHUANG Y C. Three-dimensional reconstruction with single-shot structured light dot pattern and analytic solutions[J]. Measurement, 2020, 151: 107114. doi: 10.1016/j.measurement.2019.107114
|
| [18] |
MOONEY S W J, MARLOW P J, ANDERSON B L. The perception and misperception of optical defocus, shading, and shape[J]. eLife, 2019, 8: e48214.
|
| [19] |
TIAN X, LIU R, WANG ZH Y, et al. High quality 3D reconstruction based on fusion of polarization imaging and binocular stereo vision[J]. Information Fusion, 2022, 77: 19-28.
|
| [20] |
LIU L, ZHU P, GUAN J X, et al. A binocular reconstruction method fused with laplacian image information for pavement texture evaluation[J]. Measurement, 2021, 185: 110039. doi: 10.1016/j.measurement.2021.110039
|
| [21] |
LI Y, FU Y J, ZHONG K J, et al. A virtual binocular line-structured light measurement method based on a plane mirror[J]. Optics Communications, 2022, 510: 127974.
|
| [22] |
TSENG K K, ZHANG Y Q, ZHU Q L, et al. Semi-supervised image depth prediction with deep learning and binocular algorithms[J]. Applied Soft Computing, 2020, 92: 106272. doi: 10.1016/j.asoc.2020.106272
|
| [23] |
BOUKHTACHE S, BLAYSAT B, GRÉDIAC M, et al. Alternatives to bicubic interpolation considering FPGA hardware resource consumption[J]. IEEE Transactions on Very Large Scale Integration (VLSI) Systems, 2021, 29(2): 247-258. doi: 10.1109/TVLSI.2020.3032888
|
| [24] |
李佳星, 赵勇先, 王京华. 基于深度学习的单幅图像超分辨率重建算法综述[J]. 自动化学报,2021,47(10):2341-2363.
LI J X, ZHAO Y X, WANG J H. A review of single image super-resolution reconstruction algorithms based on deep learning[J]. Acta Automatica Sinica, 2021, 47(10): 2341-2363. (in Chinese).
|
| [25] |
刘艳, 李庆武, 霍冠英, 等. 结合局部二进制表示和超像素分割求精的立体匹配[J]. 光学学报,2018,38(6):0615003. doi: 10.3788/AOS201838.0615003
LIU Y, LI Q W, HUO G Y, et al. Local binary description combined with superpixel segmentation refinement for stereo matching[J]. Acta Optica Sinica, 2018, 38(6): 0615003. (in Chinese). doi: 10.3788/AOS201838.0615003
|
| [26] |
冯维, 徐仕楠, 王恒辉, 等. 逐像素调制的高反光表面三维测量方法[J]. 中国光学,2022,15(3):488-497. doi: 10.37188/CO.2021-0220
FENG W, XU SH N, WANG H H, et al. Three-dimensional measurement method of highly reflective surface based on per-pixel modulation[J]. Chinese Optics, 2022, 15(3): 488-497. (in Chinese). doi: 10.37188/CO.2021-0220
|
| [27] |
吴福培, 余冠霖, 乐聪, 等. 微型相机模组贴装过程画胶表面三维测量方法[J]. 光子学报,2022,51(4):0412006. doi: 10.3788/gzxb20225104.0412006
WU F P, YU G L, LE C, et al. Three-dimensional measurement method of glue surface during the mounting process of micro-camera module[J]. Acta Photonica Sinica, 2022, 51(4): 0412006. (in Chinese). doi: 10.3788/gzxb20225104.0412006
|
| [28] |
平茜茜, 刘勇, 董欣明, 等. 基于偏振双目视觉的无纹理高反光目标三维重构[J]. 红外与毫米波学报,2017,36(4):432-438.
PING X X, LIU Y, DONG X M, et al. 3-D reconstruction of textureless and high-reflective target by polarization and binocular stereo vision[J]. Journal of Infrared and Millimeter Waves, 2017, 36(4): 432-438. (in Chinese).
|
Figures(11) / Tables(5)
DownLoad:
