An EEG study on semantic cognition and emotional evaluation for traffic signs

doi:10.16265/j.cnki.issn1003-3033.2021.03.026

Abstract

Abstract: In order to make drivers understand traffic signs more correctly and quickly, avoiding improper driving behavior, and improving driving safety, semantic cognition and emotional evaluation for traffic signs was investigated. Objective evaluation indicators of semantic congruence and emotional arousal of traffic signs using ERPs measurement combined with EEG time-frequency(TF)analysis was explored and a S1-S2 paradigm was adopted. The result shows that a larger N400 and θ activity in the same time window were elicited by semantically incongruent traffic sign and word pairs, which indicated semantic distance between traffic signs and words. A larger late positive potential (LPP) was induced by semantically congruent traffic sign-word pairs. It implied emotional arousal of participants. N400, θ wave and LPP can be used to determine semantic distance and emotional arousal in traffic signs. The results of ERPs combined with EEG TF analysis can provide a neuroscientific interpretation of behavioral data and it can be employed to measure traffic sign comprehension.

Key words: traffic signs, semantic cognition, emotional evaluation, electroencephalogram (EEG), event related potentials(ERPs)

CLC Number:

X910

LU Guoying, ZHANG Ting. An EEG study on semantic cognition and emotional evaluation for traffic signs[J]. China Safety Science Journal, 2021, 31(3): 184-190.

References

[1] LIANG Yulan, LEE J D, YEKHSHATYAN L. How dangerous is looking away from the road algorithms predict crash risk from glance patterns in naturalistic driving [J]. Human Factors, 2012,54: 1 104-1 116.
[2] NG Annie W Y, CHAN Alan H S. The effects of driver factors and sign design features on the comprehensibility of traffic signs [J]. Journal of Safety Research, 2008, 39(3): 321-328.
[3] NG Annie W Y, CHAN Alan H S. Effects of user factors and sign referent characteristics in participatory construction safety sign redesign [J]. Safety Science, 2015, 74: 44-54.
[4] STASI L L D, MEGIAS A, CANDIDO A, et al. Congruent visual information improves traffic signage [J]. Transportation Research Part F Traffic Psychology & Behaviour, 2012, 15(4): 438-444.
[5] BENBASSAT T, SHINAR D. Ergonomic guidelines for traffic sign design increase sign comprehension [J]. Human Factors, 2006, 48(1): 182-195.
[6] SHINAR D, VOGELZANG M. Comprehension of traffic signs with symbolic versus text displays [J]. Transportation Research Part F Traffic Psychology & Behaviour, 2013, 18(4): 72-82.
[7] OUYANG Kun, LIU Yungching. Effects of design feature and training on traffic sign comprehension between different user groups[C]. Proceeding in the 17^th World Congress on Ergonomics, 2009: 1-5.
[8] 陈默, 王海燕, 薛澄岐,等. 基于事件相关电位的产品意象-语义匹配评估[J]. 东南大学学报:自然科学版, 2014, 44(1): 58-62.
CHEN Mo, WANG Haiyan, XUE Chengqi,et al. Match judgments of semantic word-product image based on event-related potential [J]. Journal of Southeast University:Natural Science Edition, 2014, 44(1): 58-62.
[9] KUTAS M, FEDERMEIER K D. Thirty years and counting: finding meaning in the N400 component of the event-related brain potential (ERP) [J]. Annual Review of Psychology, 2011, 62(1): 621-647.
[10] CUTHBERT B N, SCHUPP H T, BRADLEY M M, et al. Brain potentials in affective picture processing: covariation with autonomic arousal and affective report [J]. Biological Psychology, 2000, 52(2): 95-111.
[11] PASTOR M C, BRADLEY M M, LOW A, et al. Affective picture perception: emotion, context, and the late positive potential [J]. Brain Research, 2008, 1189(1): 145-151.
[12] CODISPOTI M, FERRARI V, BRADLEY M M. Repetition and event-related potentials: distinguishing early and late processes in affective picture perception [J]. Journal of Cognitive Neuroscience, 2007, 19(4): 577-586.
[13] 裴玉龙, 金英群, 陈贺飞. 基于脑电信号分析的不同年龄驾驶人疲劳特性[J]. 中国公路学报, 2018, 31(4):59-65, 77.
PEI Yulong, JIN Yingqun, CHEN Hefei. Fatigue characteristics in drivers of different ages based on analysis of EEG[J]. China Journal of Highway and Transport, 2018, 31(4):59-65,77.
[14] DAVIDSON D J, INDEFREY P. An inverse relation between event-related and time-frequency violation responses in sentence processing [J]. Brain Research, 2007, 1158(1): 81-92.
[15] SAUSENG P, GRIESMAYR B, FREUNBERGER R, et al. Control mechanisms in working memory: a possible function of EEG theta oscillations [J]. Neuroscience & Biobehavioral Reviews, 2010, 34(7): 1 015-1 022.
[16] BASTIAANSEN M C, BERKUM V J J, HAGOORT P. Event-related theta power increases in the human EEG during online sentence processing [J]. Neuroscience Letters, 2002, 323(1): 13-16.
[17] HAMM J P, JOHNSON B W, KIRK I J. Comparison of the N300 and N400 ERPs to picture stimuli in congruent and incongruent contexts [J]. Clinical Neurophysiology, 2002, 113(8): 1 339-1 350.
[18] BARRETT S E, RUGG M D. Event-related potentials and the semantic matching of pictures [J]. Brain & Cognition, 1990, 14(2): 201-212.
[19] POLICH J. N400s from sentences, semantic categories, number and letter strings? [J]. Bulletin of the Psychonomic Society, 1985, 23(4): 361-364.
[20] MCPHERSON W B, HOLCOMB P J. An electrophysiological investigation of semantic priming with pictures of real objects [J]. Psychophysiology, 2010, 36(1): 53-65.
[21] DYCK M, BRODEUR M B. ERP evidence for the influence of scene context on the recognition of ambiguous and unambiguous objects [J]. Neuropsychologia, 2015, 72(4): 43-51.
[22] GUO Fu, WANG Xueshuang, LIU Weilin, et al. Affective preference measurement of product appearance based on event-related potentials[J]. Cognition Technology & Work, 2018, 20(2): 299-308.
[23] 郭伏, 刘玮琳, 王雪霜,等. 网页界面满意度评估的事件相关电位研究[J]. 工业工程与管理, 2016, 21(3): 126-131.
GUO Fu, LIU Weilin, WANG Xueshuang, et al. Event-related potentials study on webpages satisfaction evaluation[J].International Engineering and Management, 2016, 21(3): 126-131.
[24] SCHUPP H T, CUTHBERT B N, BRADLEY M M, et al. Affective picture processing: the late positive potential is modulated by motivational relevance [J]. Psychophysiology, 2010, 37(2): 257-261.
[25] HAGOORT P, HALD L, BASTIAANSEN M, et al. Integration of word meaning and world knowledge in language comprehension [J]. Science, 2004, 304(5669): 438-441.
[26] MAGUIRE M J, BRIER M R, FERREE T C. EEG theta and alpha responses reveal qualitative differences in processing taxonomic versus thematic semantic relationships [J]. Brain & Language, 2010, 114(1): 16-25.
[27] HALD L, BASTIAANSEN M, HAGOORT P. EEG theta and gamma responses to semantic violations in online sentence processing [J]. Brain & Language, 2006, 96(1): 90-105.
[28] LIN Chinteng, LIN Hongzhang, CHIU Tzaiwen, et al. Distraction-related EEG dynamics in virtual reality driving simulation[C]. IEEE International Symposium on Circuits & Systems, 2008: 1 088 - 1 091.
[29] LIN Chinteng, CHEN Shian, KO Liwei, et al. EEG-based brain dynamics of driving distraction[C]. International Joint Conference on Neural Networks, 2011: 1 497-1 500.