基于QAR2Vec模型的QAR数据特征提取

doi:10.16265/j.cnki.issn 1003-3033.2021.01.021

中国安全科学学报 ›› 2021, Vol. 31 ›› Issue (1): 145-152.doi: 10.16265/j.cnki.issn 1003-3033.2021.01.021

基于QAR2Vec模型的QAR数据特征提取

段照斌¹ 讲师, 杜海龙¹ 讲师, 张鹏² 教授

1 中国民航大学工程技术训练中心,天津 300300;
2 中国民航大学适航学院,天津 300300

收稿日期:2020-10-10 修回日期:2020-12-21 出版日期:2021-01-28
作者简介:段照斌 (1989—),男,河南南阳人,硕士,讲师,主要从事航空电子、民航飞机健康管理等方面的研究。E-mail: zbduan@cauc.edu.cn。
基金资助:
国家自然科学基金青年基金资助(61703406);天津市教学成果奖重点培育项目(PYGJ-006)。

Feature extraction of QAR data based on QAR2Vec model

DUAN Zhaobin¹, DU Hailong¹, ZHANG Peng²

1 Engineering Techniques Training Center, Civil Aviation University of China, Tianjin 300300, China;
2 College of Airworthiness, Civil Aviation University of China, Tianjin 300300, China

Received:2020-10-10 Revised:2020-12-21 Published:2021-01-28

摘要/Abstract

摘要： 针对传统特征提取方法难以从海量、高维的快速存取记录器(QAR)数据中提取有效特征,且QAR数据缺乏足够的标记等问题,提出一种以Transformer网络为核心的QAR2Vec模型,将QAR数据与位置信息、飞行阶段信息共同编码,作为QAR2Vec模型的输入;通过构建自回归预测的预训练任务以自监督的方式来学习海量QAR数据中的深层特征;保存预训练好的QAR2Vec模型权重,并在飞行状态预测和着陆异常天气识别任务上,微调预训练模型,使模型适应不同的下游任务;将QAR2Vec模型与2种没有预训练步骤的深度学习算法CNN-LSTM、MTL-LSTM进行对比。结果表明:QAR2Vec模型能够更有效地从QAR数据中提取特征,在飞行状态预测和着陆异常天气识别任务上的预测误差更低、识别准确度更高。

关键词: QAR2Vec, 特征提取, Transformer网络, 自回归, 预训练, 深度学习

Abstract: In order to address difficulties that traditional extraction methods have in extracting effective features from massive and high-dimensional QAR data which lack sufficient labeled data, a QAR2Vec model was proposed with Transformer as its core. Firstly, QAR data were co-encoded with location and flight phase information as input of the model. Secondly, pre-training task of autoregressive prediction was constructed to learn deep features of massive QAR data in a way of self-supervision. Finally, scale of pre-trained QAR2Vec model was recorded and slightly adjusted on flight state prediction and landing abnormal weather recognition tasks, and performance of QAR2Vec model was evaluated by comparing it with two deep learning algorithms—CNN-LSTM and MTL-LSTM without pre-training steps. The results show that QAR2Vec can extract features from QAR data more effectively, with lower errors and higher accuracy on flight status prediction and landing abnormal weather recognition tasks

Key words: QAR2Vec, feature extraction, Transformer net, auto-regression, pre-training, deep learning

中图分类号:

X949

段照斌, 杜海龙, 张鹏. 基于QAR2Vec模型的QAR数据特征提取[J]. 中国安全科学学报, 2021, 31(1): 145-152.

DUAN Zhaobin, DU Hailong, ZHANG Peng. Feature extraction of QAR data based on QAR2Vec model[J]. China Safety Science Journal, 2021, 31(1): 145-152.

参考文献

[1] 耿宏,李萍萍. QAR数据处理在气动力矩参数辨识中的应用[J]. 航空电子技术,2012,43(3): 25-29.
GENG Hong, LI Pingping. Application of QAR data processing in aerodynamic moment parameter identification [J].Avionics Technology, 2012, 43(3): 25-29.
[2] 葛飞,李娜,魏志强.针对高原机场障碍物补偿修正量的改进[J].中国安全科学学报,2019,29(4): 183-188.
GE Fei, LI Na, WEI Zhiqiang. Improvement on compensation and correction amount of obstacles at plateau airports[J]. China Safety Science Journal, 2019,29(4): 183-188.
[3] 孙瑞山,杨泽煊,汪磊.QAR数据在飞行安全评价中的应用[J].中国安全科学学报,2015,25(7): 87-92.
SUN Ruishan, YANG Zexuan, WANG Lei. Study of flight safety evaluation based on QAR data[J]. China Safety Science Journal, 2015,25(7): 87-92.
[4] 王剑辉,邓伟,夏正洪,等.运输航空飞行安全风险评价方法[J].中国安全科学学报,2019,29(12): 110-116.
WANG Jianhui, DENG Wei, XIA Zhenghong, et al. Flight risk assessment method of transport aviation[J]. China Safety Science Journal,2019,29(12): 110-116.
[5] 吴奇,储银雪.基于深度学习的航空器异常飞行状态识别[J].民用飞机设计与研究,2017(3):68-78,4.
WU Qi, CHU Yinxue. Abnormal flight status of aircraft identification based on deep learning[J]. Civil Aircraft Design & Research, 2017(3):68-78,4.
[6] ZHANG Xiaoyu, CHEN Jiusheng, GAN Quan. Anomaly detection for aviation safety based on an improved KPCA algorithm[J]. Journal of Electrical and Computer Engineering, 2017, 2017: 1-8.
[7] HINTON G E, OSINDERO S, TEH Y W. A fast learning algorithm for deep belief nets[J]. Neural Computation, 2006, 18(7): 1 527-1 554.
[8] 张军阳,王慧丽,郭阳,等.深度学习相关研究综述[J].计算机应用研究,2018,35(7): 1 921-1 928,1 936.
ZHANG Junyang, WANG Huili, GUO Yang, et al. Review of deep learning[J]. Application Research of Computers, 2018,35(7):1 921- 1 928,1 936.
[9] JIA Feng, LEI Yaguo, LIN Jing, et al. Deep neural networks: a promising tool for fault characteristic mining and intelligent diagnosis of rotating machinery with massive data[J]. Mechanical Systems & Signal Processing, 2016, 72/73: 303-315.
[10] ZHANG Qingchen, YANG L T, CHEN Zhikui. Deep computation model for unsupervised feature learning on big data[J]. IEEE Transactions on Services Computing, 2016, 9(1): 161-171.
[11] TONG Chao, YIN Xiang, WANG Shili, et al. A novel deep learning method for aircraft landing speed prediction based on cloud-based sensor data[J]. Future Generation Computer Systems, 2018, 88: 552-558.
[12] HOCHREITER S, SCHMIDHUBER J. Long short-term memory[J]. Neural Computation, 1997, 9(8): 1 735-1 780.
[13] UZUN M, DEMIREZEN M U, KOYUNCU E, et al. Design of a hybrid digital-twin flight performance model through machine learning[C]. 2019 IEEE Aerospace Conference, 2019: 1-14.
[14] 张鹏,杨涛,刘亚楠,等.基于CNN-LSTM的QAR数据特征提取与预测[J].计算机应用研究,2019,36(10): 2 958-2 961.
ZHANG Peng, YANG Tao, LIU Yanan, et al. Feature extraction and prediction of QAR data based on CNN-LSTM[J]. Application Research of Computers, 2019,36(10): 2 958-2 961.
[15] LECUN Y, BOTTOU L, BENGIO Y, et al. Gradient-based learning applied to document recognition[J]. Proceedings of the IEEE,1998, 86(11): 2 278-2 324.
[16] 张鹏,杨涛,刘亚楠.基于深度学习的伺服系统状态预测算法[J].计算机应用与软件,2019,36(3): 236-242.
ZHANG Peng, YANG Tao, LIU Ya′nan, State prediction algorithm of servo system based on deep learning[J]. Computer Applications and Software, 2019,36(3): 236-242.
[17] RADFORD A, NARASIMHAN K, SALIMANS T, et al. Improving language understanding by generative pre-training[EB/OL].(2018-06-12).https://s3-us-west-2.amazonaws.com/openai-assets/research-covers/language-unsupervised/language_understanding_paper.pdf
[18] VASWANI A, SHAZEER N, PARMAR N, et al. Attention is all you need[C]. 31^stAnnual Conference on Neural Information Processing Systems, 2017: 5 999-6 009.
[19] BAHDANAU D, CHO K, BENGIO Y. Neural machine translation by jointly learning to align and translate[EB/OL]. [2020-07-26]. https://arxiv.org/abs/1409.0473.
[20] BA J L, KIROS J R, HINTON G E. Layer normalization[EB/OL].[2020-07-26]. https://arxiv.org/abs/1607.06450.
[21] 张鹏. 自动飞行控制系统[M]. 北京:中国民航出版社, 2016: 218-234.
[22] KINGMA D P, BA J. Adam: a method for stochastic optimization[EB/OL]. [2020-07-26].https://arxiv.org/abs/1412.6980.

基于QAR2Vec模型的QAR数据特征提取

Feature extraction of QAR data based on QAR2Vec model

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

本文评价

[1]	魏德志, 杜志勇, 滕春阳, 辛吴天, 李泽坤. 露天矿破碎站链条断裂安全监测技术研究[J]. 中国安全科学学报, 2023, 33(S2): 170-175.
[2]	尚书宏, 曹亮, 鲁伟. 基于小波变换特征提取的脱介筛故障诊断算法[J]. 中国安全科学学报, 2023, 33(S2): 233-237.
[3]	张琦, 吉日格勒. 基于卷积神经网络的煤泥水外溢检测算法[J]. 中国安全科学学报, 2023, 33(S1): 192-195.
[4]	赵光辉, 赵鹏, 胡金良. 语义分割的传送带跑偏视频检测算法[J]. 中国安全科学学报, 2023, 33(S1): 81-84.
[5]	林青, 姚俊名, 梁伟, 杨放, 廖春燕, 王有春. 基于深度学习的燃气发电机组剩余寿命预测[J]. 中国安全科学学报, 2023, 33(9): 113-121.
[6]	殷逸冰, 张永亮, 刘尊民, 张强. 基于静电传感信号的小孔泄漏探测方法与试验[J]. 中国安全科学学报, 2023, 33(9): 142-149.
[7]	李善梅, 周相志. 基于S2S-CNN-GRU的机场离港航班延误预测[J]. 中国安全科学学报, 2023, 33(8): 93-100.
[8]	卢才武, 高睿阳, 徐晓慧, 江松, 刘迪, 付信凯. 基于脑电数据的不同噪声工况下矿工注意力研究[J]. 中国安全科学学报, 2023, 33(5): 35-41.
[9]	潘卫军, 覃莉茹, 骆晨, 黄园晶. 通用航空森林消防救援数据适配性特征提取[J]. 中国安全科学学报, 2023, 33(11): 67-74.
[10]	李海, 孙鹏. 基于知识图谱的火灾图像识别研究[J]. 中国安全科学学报, 2023, 33(10): 147-159.
[11]	王金江, 关鹏婷, 陈卓, 葛伟凤, 鞠茜. 基于深度学习的检修作业过程风险智能预警[J]. 中国安全科学学报, 2023, 33(10): 16-22.
[12]	马庆禄, 孙枭, 唐小垚, 鲁佳萍, 段学锋. 基于改进YOLOv5s算法的隧道初期火灾检测模型[J]. 中国安全科学学报, 2023, 33(10): 214-223.
[13]	范冰倩, 董秉聿, 王彪, 李铭, 吴松, 佟瑞鹏. 基于深度学习的地铁施工作业人员不安全行为识别与应用[J]. 中国安全科学学报, 2023, 33(1): 41-47.
[14]	黄珍珍, 肖硕, 王钰, 陈伟, 王升志, 江海峰. 铁路工人人体行为识别模型[J]. 中国安全科学学报, 2022, 32(6): 17-22.
[15]	张萌, 韩豫, 刘泽锋. 深度学习下建筑工人高空安全防护装备检测方法[J]. 中国安全科学学报, 2022, 32(5): 140-146.