Citation: | LIU Zhi, LAI Qing-rong, ZHANG Tian-yu, LI Bin, SONG Yun-feng, CHEN Nan. Non-destruction Detection of jelly orange granulation disease using laser Doppler vibrometry[J]. Chinese Optics. doi: 10.37188/CO.2024-0115 |
Granulation is a common internal disease of citrus fruits, and it is difficult to identify the fruits with this disease from their external features. In this study, an acoustic vibration experimental setup was constructed using a micro-laser Doppler vibrometer (micro-LDV) and a resonance speaker. This was used to collect vibration response signals of ‘Aiyuan 38’ jelly orange. The one-dimensional vibration response signals were converted into vibration multi-domain images, and a Resnet-Transformer network (ResT) was constructed to extract deeper features from the vibration multi-domain images for identifying granulation disease in jelly oranges. In this paper, the ResT, Resnet50, and Vision Transformer (ViT) models were trained using vibration multi-domain images, and their performances were compared. Then, partial least squares discriminant analysis (PLS-DA) and support vector machine (SVM) models were trained using vibration multi-domain image texture features or vibration spectrum features, and the performance was compared with the ResT model. The results show that the ResT model trained using vibration multi-domain images can achieve accurate identification of jelly orange granulation disease with 98.61% detection accuracy, 0.986 F1, 0.986 precision, and 0.986 recall. The proposed method can accurately identify granulated jelly oranges with simplicity, speed, and low cost.
[1] |
ZHENG Y J, TIAN SH J, XIE L J. Improving the identification accuracy of sugar orange suffering from granulation through diameter correction and stepwise variable selection[J]. Postharvest Biology and Technology, 2023, 200: 112313. doi: 10.1016/j.postharvbio.2023.112313
|
[2] |
THEANJUMPOL P, WONGZEEWASAKUN K, MUENMANEE N, et al. Non-destructive identification and estimation of granulation in ‘Sai Num Pung’ tangerine fruit using near infrared spectroscopy and chemometrics[J]. Postharvest Biology and Technology, 2019, 153: 13-20. doi: 10.1016/j.postharvbio.2019.03.009
|
[3] |
陈玥瑶, 夏静静, 韦芸, 等. 近红外光谱法无损检测平谷产大桃品质方法研究[J]. 分析化学,2023,51(3):454-462.
CHEN Y Y, XIA J J, WEI Y, et al. Research on nondestructive quality test of Pinggu peach by near-infrared spectroscopy[J]. Chinese Journal of Analytical Chemistry, 2023, 51(3): 454-462. (in Chinese).
|
[4] |
于水, 宦克为, 王磊, 等. 基于卷积神经网络的近红外光谱多组分定量分析模型研究[J]. 分析化学,2024,52(5):695-705.
YU SH, HUAN K W, WANG L, et al. Multicomponent quantitative analysis model of near infrared spectroscopy based on convolution neural network[J]. Chinese Journal of Analytical Chemistry, 2024, 52(5): 695-705. (in Chinese).
|
[5] |
JIE D F, WU SH, WANG P, et al. Research on Citrus grandis granulation determination based on hyperspectral imaging through deep learning[J]. Food Analytical Methods, 2021, 14(2): 280-289. doi: 10.1007/s12161-020-01873-6
|
[6] |
NAYAK S L, SETHI S, SAHOO R N, et al. Potential of X-ray imaging to detect citrus granulation in different cultivars with progress in harvesting time[J]. Indian Journal of Experimental Biology, 2022, 60(4): 263-268.
|
[7] |
KADOWAKI M, NAGASHIMA S, AKIMOTO H, et al. Detection of core rot symptom of Japanese pear (Pyrus pyrifolia cv. Kosui) by a nondestructive resonant method[J]. Journal of the Japanese Society for Horticultural Science, 2012, 81(4): 327-331. doi: 10.2503/jjshs1.81.327
|
[8] |
ZHANG H, ZHA ZH H, KULASIRI D, et al. Detection of early core browning in pears based on statistical features in vibro-acoustic signals[J]. Food and Bioprocess Technology, 2021, 14(5): 887-897. doi: 10.1007/s11947-021-02613-2
|
[9] |
ZHAO K, LI H, ZHA ZH H, et al. Detection of sub-healthy apples with moldy core using deep-shallow learning for vibro-acoustic multi-domain features[J]. Measurement: Food, 2022, 8: 100068. doi: 10.1016/j.meafoo.2022.100068
|
[10] |
JIN CH, XIE L J, YING Y B. Eggshell crack detection based on the time-domain acoustic signal of rolling eggs on a step-plate[J]. Journal of Food Engineering, 2015, 153: 53-62. doi: 10.1016/j.jfoodeng.2014.12.011
|
[11] |
SUN L, BI X K, LIN H, et al. On-line detection of eggshell crack based on acoustic resonance analysis[J]. Journal of Food Engineering, 2013, 116(1): 240-245. doi: 10.1016/j.jfoodeng.2012.11.001
|
[12] |
WANG D CH, FENG ZH, JI SH Y, et al. Simultaneous prediction of peach firmness and weight using vibration spectra combined with one-dimensional convolutional neural network[J]. Computers and Electronics in Agriculture, 2022, 201: 107341. doi: 10.1016/j.compag.2022.107341
|
[13] |
崔笛, 张文, 应义斌. 激光多普勒测振技术在农产品品质检测中的应用[J]. 农业机械学报,2013,44(7):160-164. doi: 10.6041/j.issn.1000-1298.2013.07.027
CUI D, ZHANG W, YING Y B. Applications of laser doppler vibrometer technology in nondestructive detection of agro-product quality[J]. Transactions of the Chinese Society for Agricultural Machinery, 2013, 44(7): 160-164. (in Chinese). doi: 10.6041/j.issn.1000-1298.2013.07.027
|
[14] |
FATHIZADEH Z, ABOONAJMI M, BEYGI S R H. Nondestructive firmness prediction of apple fruit using acoustic vibration response[J]. Scientia Horticulturae, 2020, 262: 109073. doi: 10.1016/j.scienta.2019.109073
|
[15] |
ABBASZADEH R, RAJABIPOUR A, DELSHAD M, et al. Application of vibration response for the nondestructive ripeness evaluation of watermelons[J]. Australian Journal of Crop Science, 2011, 5(7): 920-925.
|
[16] |
AKAN A, CURA O K. Time-frequency signal processing: Today and future[J]. Digital Signal Processing, 2021, 119: 103216. doi: 10.1016/j.dsp.2021.103216
|
[17] |
FU W L, JIANG X H, LI B L, et al. Rolling bearing fault diagnosis based on 2D time-frequency images and data augmentation technique[J]. Measurement Science and Technology, 2022, 34(4): 045005.
|
[18] |
HUANG X F, LEI Q, XIE T L, et al. Deep transfer convolutional neural network and extreme learning machine for lung nodule diagnosis on CT images[J]. Knowledge-Based Systems, 2020, 204: 106230. doi: 10.1016/j.knosys.2020.106230
|
[19] |
TANG X Y, XU Z B, WANG ZH G. A novel fault diagnosis method of rolling bearing based on integrated vision transformer model[J]. Sensors (Basel, Switzerland), 2022, 22(10): 3878. doi: 10.3390/s22103878
|
[20] |
LIU H, LIU ZH Y, JIA W Q, et al. Tool wear estimation using a CNN-transformer model with semi-supervised learning[J]. Measurement Science and Technology, 2021, 32(12): 125010. doi: 10.1088/1361-6501/ac22ee
|
[21] |
ALSHAMMARI H, GASMI K, BEN LTAIFA I, et al. Olive disease classification based on vision transformer and CNN models[J]. Computational Intelligence and Neuroscience, 2022, 2022: 3998193.
|
[22] |
ZHAO K, ZHA Z H, LI H, et al. Early detection of moldy apple core based on time-frequency images of vibro-acoustic signals[J]. Postharvest Biology and Technology, 2021, 179: 111589. doi: 10.1016/j.postharvbio.2021.111589
|
[23] |
ZHANG W, CUI D, YING Y B. The impulse response method for pear quality evaluation using a laser Doppler vibrometer[J]. Journal of Food Engineering, 2015, 159: 9-15. doi: 10.1016/j.jfoodeng.2015.03.013
|
[24] |
DING CH Q, WANG D CH, FENG ZH, et al. Integration of vibration and optical techniques for watermelon firmness assessment[J]. Computers and Electronics in Agriculture, 2021, 187: 106307. doi: 10.1016/j.compag.2021.106307
|
[25] |
张弛, 王顺, 关向雨, 等. 激光多普勒测振技术应用的新进展[J]. 激光与光电子学进展,2022,59(19):1900006.
ZHANG CH, WANG SH, GUAN X Y, et al. New progress in application of laser doppler vibration measurement technology[J]. Laser & Optoelectronics Progress, 2022, 59(19): 1900006. (in Chinese).
|
[26] |
WANG D CH, DING CH Q, FENG ZH, et al. Recent advances in portable devices for fruit firmness assessment[J]. Critical Reviews in Food Science and Nutrition, 2023, 63(8): 1143-1154. doi: 10.1080/10408398.2021.1960477
|