Research of aircraft pose estimation based on neural network feature line extraction

Chen Changjun; Tang Dan; Yang Hao; You Anqing; Pan Xudong

doi:10.11884/HPLPB202436.240032

Volume 36 Issue 6

May 2024

Turn off MathJax

Article Contents

Article Navigation > High Power Laser and Particle Beams > 2024 > 36(6): 069001

Chen Changjun, Tang Dan, Yang Hao, et al. Research of aircraft pose estimation based on neural network feature line extraction[J]. High Power Laser and Particle Beams, 2024, 36: 069001. doi: 10.11884/HPLPB202436.240032

Citation:

Chen Changjun, Tang Dan, Yang Hao, et al. Research of aircraft pose estimation based on neural network feature line extraction[J]. High Power Laser and Particle Beams, 2024, 36: 069001. doi: 10.11884/HPLPB202436.240032

Citation:

PDF( 2973 KB)

Research of aircraft pose estimation based on neural network feature line extraction

doi: 10.11884/HPLPB202436.240032

Chen Changjun^{1, 2
,},
Tang Dan^{1
,
,},
Yang Hao¹,
You Anqing¹,
Pan Xudong¹

1.
Institute of Applied Electronics, CAEP, Mianyang 621900, China
2.
Graduate School, China Academy of Engineering Physics, Beijing 100088, China

Received Date: 2024-01-23
Accepted Date: 2024-03-06
Rev Recd Date: 2024-03-06

Available Online: 2024-03-15

Publish Date: 2024-05-11

Abstract

Abstract

To estimate the aircraft pose in complex situation, this paper proposes a new method of aircraft pose estimation based on neural network line extraction. This method uses 3D model to render images, and forms dataset through adding backgrounds. The dataset is enhanced to make the algorithm robust. The line extraction model uses convolutional neural network to extract deep features, and uses heatmap to obtain aircraft feature lines. The target pose is solved by combining the aircraft feature line, the aircraft 3D model and the perspective-n-line method. The accuracy of the line extraction model is 91% in complex background. The accuracy is 84% after addingall sorts of noises. The aircraft pose is solved by using EPnL algorithm and nonlinear optimization. The average angle error is about 0.57°, and the average translation error is about 0.47% when the target is in a complex background. After addingall sorts of noises to the image, the average angle error is about 2.11°, and the average translation error is about 0.93%. The aircraft pose estimation method proposed in this article can accurately predict the aircraft pose under complex backgrounds and various types of noise, and its application scenarios are more extensive.
- neural network,
- line extraction,
- pose estimation,
- dataset enhancement

FullText(HTML)

References(20)

References

[1]	刘刚, 梁晓庚, 张京国. 基于红外图像的飞机目标关键攻击部位识别[J]. 计算机工程与应用, 2011, 47(24):174-177,228 Liu Gang, Liang Xiaogeng, Zhang Jingguo. Recognizing airplane’s key attacking part based on infrared image[J]. Computer Engineering and Applications, 2011, 47(24): 174-177,228
[2]	成杰, 李新德. 基于Hu矩与改进PNN的飞机姿态识别算法[J]. 航空兵器, 2017(1):55-61 Cheng Jie, Li Xinde. An algorithm of aircraft pose recognition based on Hu moments and IPNN[J]. Aero Weaponry, 2017(1): 55-61
[3]	王宏波, 庄志洪, 张清泰. 基于动态红外图像的飞机姿态识别方法研究[J]. 红外与激光工程, 2003, 32(1):8-12 Wang Hongbo, Zhuang Zhihong, Zhang Qingtai. Study on recognition of aircraft status based on dynamic infrared images[J]. Infrared and Laser Engineering, 2003, 32(1): 8-12
[4]	王宏波, 庄志洪, 张清泰. 一种红外成像引信中的飞机姿态识别方法[J]. 宇航学报, 2003, 24(4):354-358 doi: 10.3321/j.issn:1000-1328.2003.04.006 Wang Hongbo, Zhuang Zhihong, Zhang Qingtai. A recognizing method of aircraft status in imaging infrared fuze[J]. Journal of Astronautics, 2003, 24(4): 354-358 doi: 10.3321/j.issn:1000-1328.2003.04.006
[5]	冀芳, 武瑞娟, 何红丽. 大型外挂物投放影像测量亚像素定位技术[J]. 计算机与数字工程, 2017, 45(8):1647-1651 Ji Fang, Wu Ruijuan, He Hongli. Sub pixel positioning technology for large external store image measurement[J]. Computer and Digital Engineering, 2017, 45(8): 1647-1651
[6]	Santos N P, Melício F, Lobo V, et al. A ground-based vision system for UAV pose estimation[J]. International Journal of Robotics and Mechatronics, 2014, 1(4): 138-144.
[7]	Su Guozhong, Zhang Jianqing, Zheng Shunyi. Moving objects pose acquisition from image sequence[C]//Proceedings of the 20th ISPRS Congress Technical Commission V. 2004: 730-734.
[8]	李兴唐, 郭立红. 基于三维模型的飞机识别与姿态估计[J]. 武汉理工大学学报, 2008, 30(8):74-77 Li Xingtang, Guo Lihong. Aircraft recognition and pose estimation base on 3D model[J]. Journal of Wuhan University of Technology, 2008, 30(8): 74-77
[9]	王习文, 马军, 陈娟, 等. 飞机三维姿态测量的角平分线方向向量法[J]. 光学精密工程, 2010, 18(2):369-376 Wang Xiwen, Ma Jun, Chen Juan, et al. Direction vector method of angle bisector lines for measuring aircraft’s 3D attitude[J]. Optics and Precision Engineering, 2010, 18(2): 369-376
[10]	王彬, 何昕, 魏仲慧. 采用单目图像特征直线的飞机姿态估计[J]. 计算机测量与控制, 2013, 21(2):473-476 doi: 10.3969/j.issn.1671-4598.2013.02.061 Wang Bin, He Xin, Wei Zhonghui. A method of measuring pose of aircraft from mono-view based on line features[J]. Computer Measurement & Control, 2013, 21(2): 473-476 doi: 10.3969/j.issn.1671-4598.2013.02.061
[11]	王彬, 何昕, 魏仲慧. 采用多站图像直线特征的飞机姿态估计[J]. 光学精密工程, 2013, 21(7):1831-1839 doi: 10.3788/OPE.20132107.1831 Wang Bin, He Xin, Wei Zhonghui. Attitude estimation of aircrafts using line features on multi-camera images[J]. Optics and Precision Engineering, 2013, 21(7): 1831-1839 doi: 10.3788/OPE.20132107.1831
[12]	Teng Xichao, Yu Qifeng, Luo Jing, et al. 2019. Aircraft pose estimation based on geometry structure features and line correspondences[J]. Sensors, 2019, 19: 2165. doi: 10.3390/s19092165
[13]	Li Yibo, Yu Ruixing, Zhu Bing. 2D-key-points-localization-driven 3D aircraft pose estimation[J]. IEEE Access, 2020, 8: 181293-181301. doi: 10.1109/ACCESS.2020.3026209
[14]	Fan Runze, Xu Tingbing, Wei Zhenzhong. Estimating 6D aircraft pose from keypoints and structures[J]. Remote Sensing, 2021, 13: 663. doi: 10.3390/rs13040663
[15]	王平, 何卫隆, 张爱华, 等. EPnL: 一种高效且精确的PnL问题求解算法[J]. 自动化学报, 2022, 48(10):2600-2610 Wang Ping, He Weilong, Zhang Aihua, et al. EPnL: an efficient and accurate algorithm to the PnL problem[J]. Acta Automatica Sinica, 2022, 48(10): 2600-2610
[16]	He Kaiming, Zhang Xiangyu, Ren Shaoqing, et al. Deep residual learning for image recognition[C]//Proceedings of 2016 IEEE Conference on Computer Vision and Pattern Recognition. 2016: 770-778.
[17]	Xie Saining, Girshick R, Dollár R, et al. Aggregated residual transformations for deep neural networks[C]//Proceedings of 2017 IEEE Conference on Computer Vision and Pattern Recognition. 2017: 5987-5995.
[18]	Sun Ke, Xiao Bin, Liu Dong, et al. Deep high-resolution representation learning for human pose estimation[C]//Proceedings of 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2019: 5686-5696.
[19]	Huang Gao, Liu Zhuang, Van Der Maaten L. Densely connected convolutional networks[C]//Proceedings of 2017 IEEE Conference on Computer Vision and Pattern Recognition. 2017: 2261-2269.
[20]	Sandler M, Howard A, Zhu Menglong, et al. MobileNetV2: inverted residuals and linear bottlenecks[C]//Proceedings of 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2018: 4510-4520.