Skip to article
AHFE AHFE Discoveries AHFE International Open Access Journal
AHFE OPEN ACCESS OPEN ACCESS CONFERENCE PROCEEDINGS PAPER

Understanding Driver's Emotion and Attention in the Context of Augmented Reality Head-up Display System

School of Design, The Hong Kong Polytechnic University, Hong Kong SAR, China ↗
Publication year
Digital Object Identifier10.54941/ahfe1005231

Abstract

As one of the primary psychological factors, the emotion of the driver affects the driving behaviour constantly. Negative emotions may lead to improper driving behaviour, threatening the safety of drivers, and even endangering society. Monitoring and regulating drivers' emotions while they are behind the wheel is crucial. It not only helps to lower the risks on the road, but it also enables a novel approach to driver-car interactions. Augmented reality head-up display (AR-HUD), as a developing technology, has been invested in the innovation of automobile driving, with promising potential to support driving and change driver-vehicle interaction. While research on driver emotion is well developed, more study is needed in the context of the AR-HUD system is still emergent for the future industry. The paper presents a systematic literature review to highlight recent research on driver’s emotion in the context of the AR-HUD system. The paper explores the integration of emotional recognition technologies into AR-HUD systems, examining their effectiveness in improving driver mood and reducing the risk of accidents. This review also discusses the challenges and future directions in this field, proposing ways to optimize AR-HUD systems for better emotional awareness and road safety.

INTRODUCTION

Emotions are generally defined as human responses with specific patterns of psycho-physiological activity, either conscious or unconscious (Ekman & Davidson, 1994). From a biological point of view, emotions are related to the nervous system (Darwin & Prodger, 1998). The psychological theory of emo- tion directly links emotion to bodily manifestation, which includes the viscera and the skeletal muscles (James, 2009). And in neuroscience, emotions often relate to consciousness and decision-making (Damasio et al., 1990). Gen- erally, emotions are categorized according to the six basic emotions theory, which are anger, fear, surprise, disgust, and joy (Strongman, 1996). Accord- ing to Ekman’s theory, these six basic emotions are universal and innate. One piece of evidence is the cross-cultural similarity in facial expressions of peo- ple from different cultures. There is also another classification approach for emotions with two continuous dimensions, which are valence and arousal

© 2024. Published by AHFE Open Access. All rights reserved. 397

(Lang et al., 1993). Valence measures how good or bad an experience was. Arousal is a measure of activation that ranges from calm to extremely excited.

Understanding the relationship between emotion and behaviour has always been a research topic. Particularly, drivers’ emotion is one valuable branch (Zepf et al., 2019; Underwood et al., 1999; Jeon, 2016; Nass et al., 2005; Mesken et al., 2007; Pecher et al., 2009; Roidl et al., 2014; Braun et al., 2020). According to the Yerkes-Dodson law (Yerkes et al., 1908), stating that task performance is interconnected with arousal, this behavioral principle has been applied to the driving context. Emotions can affect the cognition of drivers, which way may lead to dangerous situations. Many existing studies have proven that investigating the effects of emotion on driving performance, risk perception, and so on (Steinhauser et al., 2018; Jeon, 2016).

In order to investigate the context in which different emotions can develop, many works research the trigger of a driver’s emotion. Commonly, the trig- ger can be divided into two kinds: inner triggers and external triggers (Zepf et al., 2019). The inner trigger refers to a person’s characteristics. External triggers can be further divided into four categories: i) traffic and driving task, involving traffic lights, traffic density, etc. ii) HCI and navigation, involving route guidance, navigation settings, etc. iii) vehicle and equipment, involving air conditioning, etc. iv) environment and other, such as weather and sites.

Generally, researchers will choose an appropriate definition method according to the needs. Whichever is used, to detect different emotions, vari- ant methods can be applied. Commonly, it can be divided into two kinds: obtrusive solutions and unobtrusive solutions. Obtrusive solutions involve tools such as fMRI (Phan et al., 2002; Ochsner et al., 2002; Lutz et al., 2014), EEG (Bos et al., 2006), ECG (Agrafioti et al., 2011), and other tools in contact with the human body. On the contrary, unobtrusive solutions mean detecting emotions by collecting signals that human conveys without contact. For example, behavioral signals such as speech (Dellaert et al., 1996; Nwe et al., 2001; Liu et al., 2018), facial expressions (Ekman, 1993; Keltner et al., 2003; Niedenthal et al., 2000; Yan & Yue-Jia, 2005; Pham & Philippot, 2010; Wallbott, 1991), and body gestures (Shan et al., 2007; Piana et al., 2014) are often used. In the automotive domain, unobtrusive solutions are commonly used considering the need not to interrupt the driver’s performance during driving (Weber, 2018).

Regulating drivers’ emotions can be crucial for reducing traffic accidents and enabling new driver-car interactions. In a broad sense, regulation is defined as mechanisms used to strengthen, stabilize, or weaken responses (Gross, 2002). Specifically in driving contexts, different regulation approach is applied for different emotions from different triggers. For example, approaches usually try to bring emotional sympathetic resonance (Nass et al., 2005; Hernandez et al., 2014; Paredes et al., 2018) corresponding to inner triggers.

Different from a traditional head-up display (HUD), augmented reality head-up display (AR-HUD) projects graphics on top of the real world, allow- ing interaction with and augmenting real-world objects. As a new technology that just appears in the area, it has promising potential to improve driving performance and to keep the driver’s attention focusing on the road. Existing

Understanding Driver’s Emotion and Attention in the Context 399

research has been endeavoured to study in this field for future insight into industry (Gabbard et al., 2014; Schall Jr et al., 2013; Rusch et al., 2013). In this paper, we focus on the interaction between the driver and the vehi- cles. This review aims to highlight recent research on driver’s emotion in the context of AR-HUD system.

METHODOLOGY

The systematic review focuses on the driver’s mindless response (emotion or attention) in the context of the AR-HUD system. The systematic review method would strictly correspond to the guidelines set forth by Liberati et al. (2009).

Based on the objectives, studies meeting the following criteria were included: (i) drivers aged 16 years and older; (ii) focus on any emotions or attention; (iii) examined driver behaviours in the context of distraction and of ADAS or other vehicle automation systems; (iv) reported one or more of the following outcomes: driver performance, safety outcomes, distrac- tion behaviours, driver trust, or situation awareness; (v) AR-HUD or any new techniques involved; and (vi) written in English. We excluded studies where target populations were not drivers or no any AR or advanced tech- niques involved. Literature review articles, non-empirical manuscript types and abstract only papers were also excluded.

We searched the publication from four commonly used databases in this area, which are Web of Science, PubMed, PsycInfo, and Scopus. The pub- lication dates were restricted between recent 6 years. The search based on three different concepts: (1) driving-related concepts, (2) AR-HUD-related concepts, and (3) emotion or attention. The final formulation is shown in Table 1.

Table 1. List of search keywords.

Table available in the original PDF paper.

Concept Keywords Driving driv* OR car OR vehicle OR automotive AR-HUD ar OR augmented* OR (head* AND display) Emotion emotion OR stress OR attention OR affect* Area hci OR interaction OR design

Search results were downloaded to Endnotes. The inclusion and exclusion criteria were applied to select studies for the review. The initial search gen- erated 1591 potentially relevant articles, as shown in Fig 1. After removing 250 duplicates, 1341 papers remained. Of those, 1295 were removed based on reading the title and the abstracts, leaving 46 papers for further reading. Finally, after reading the full text, there are 24 articles left in this review.

Two authors independently screened the titles and abstracts in the initial review to determine the relevant papers in the field of driver’s emotion under AR-HUD system. A union result of the two is included for the full texts assessment. Then, the full texts of the final chosen papers were assessed. Any

disagreement in the whole process was discussed involving a third author until a consensus was reached.

We analysed and synthesized the selected articles, extracting informa- tion including author, abstract, research field, research motivation, research design and methods, AR-HUD technology, research methods, and significant findings of the review research question. By comparing this key informa- tion, we further explored the innovation of each article in the research and application of driver’s emotion under the AR HUD system, or their impact in related fields. At the same time, we also focused on the challenges and future research directions mentioned in the article, to better understand the development trends and potential of this technology. Finally, we summarized the common issues and differences that emerged in the study, providing more in-depth insights and suggestions for subsequent research.

RESULTS

The final 24 studies were identified further by the objectives, which are (i) the superiority of AR-HUD where research shows strong advantages compared with traditions; (ii) the AR-HUD interface design, where research conducted insights towards future AR-HUD interface design for better supervision while driving; (iii) the adaptive system, where new interaction was proposed.

SUPERIORITY OF AR-HUD Currently, many studies have demonstrated the advantages of AR-HUD over traditional methods. The existing research on the superiority of AR-HUD systems is often reflected in their positive impact on driving behaviour and

Understanding Driver’s Emotion and Attention in the Context 401

safety, although Frémont et al. (2020) mention that drivers perform best without any visual assistance because they would be more focused on tasks. Research has shown that the AR-HUD system can significantly improve driver’s attention and behavior during driving activities (Mendoza, 2020; Aydogdu et al., 2020; Luzuriaga et al., 2022; Heo et al., 2022), especially in reducing cognitive load, enhancing attention to dangerous driving situa- tions, and reducing the impact of environmental conditions. In addition to the AR-HUD system in daily driving scenarios, its advantages are also reflected in the military (Bielecki et al., 2020), agriculture (Pei et al., 2020), and other fields. Bielecki et al. (2020) discuss the use of the AR-HUD system to improve the ability of combat vehicles and soldiers by maintaining a comprehensive understanding of tactical situations during mission execution.

However, the impact of AR-HUD on drivers is also influenced by vari- ous factors such as experience. Research has shown that AR-HUD’s effects are more pronounced among elderly drivers, students, and women. These groups feel a significant reduction in driving burden when activating AR- HUD, especially women who feel safer during AR-HUD activation (Aydogdu et al., 2020; Luzuriaga et al., 2022). In the subjective evaluation survey of the AR-HUD system conducted by Cheng et al. (2023), it is also found that the subjective acceptance of drivers is significantly influenced by driv- ing experience and gender. Furthermore, the effectiveness of AR-HUD varies between daytime and nighttime (Cheng et al., 2023). In nighttime driving situations, the AR-HUD system significantly improves driver attention and reduces cognitive load. However, in the daytime driving scenario, the impact of the AR-HUD system is not significant.

In measuring attention, eye tracking is commonly used alongside sub- jective evaluations to assess drivers’ focus. By analyzing eye tracking data, researchers can gain insights into how drivers allocate their attention to visual stimuli, among other aspects. Cheng et al. (2023) used eye tracking technol- ogy in the experiment to analyze and evaluate the driver’s perception of the driving environment, as well as their attention allocation and response when facing risky driving situations. Additionally, Peˇceˇcnik et al. (2022) mentioned in their article that monitoring changes in pupil size is an indirect method to evaluate drivers’ attention needs and distractions. Experiments have shown that HUD can enhance driving performance and pupil response. When atten- tion is focused, pupils dilate to allow more light to enter the eyes, thereby improving visual acuity and attention. Conversely, when attention is diverted, pupils constrict, reducing the amount of light entering the eyes.

In addition to its impact on attention, the AR-HUD system has also been shown to have a positive impact on driver’s emotion. Detjen et al. (2020) demonstrate that virtual windshield systems have a positive effect on reduc- ing stress and increasing passenger safety by allowing participants to watch videos including a car accident scene in a real but stationary car. Similarly, Kim et al. (2023) indicate that the AR-HUD system can effectively alleviate driver’s nervousness, thus positively affecting their emotions. Furthermore, Morra et al. (2019) utilized electrodermal response (GSR) to measure partic- ipants’ emotional responses, finding that the design of the AR-HUD interface can significantly alter participants’ electrodermal response levels.

Although AR-HUD can effectively improve driver’s attention and have a positive impact on emotions, it is worth noting that AR-HUD can also bring negative effects. As mentioned by Wang et al. (2022), the use of AR-HUD may increase the driver’s attention blind spots, especially in the absence of enhancements for unpredictable events, which may pose a potential threat to driving safety.

AR-HUD INTERFACE DESIGN AR-HUD, as an emerging technology, has seen significant investment in auto- motive innovation. The benefits of AR-HUD systems, such as reducing driver cognitive load and enhancing driving safety, underscore the importance of AR-HUD interface design in future vehicle-human interactions. Research into AR-HUD interfaces is actively advancing. Zhang et al. (2022) con- ducted experiments to investigate the information needs and priorities of novice and experienced drivers in various road conditions, informing AR- HUD interface design. Furthermore, Frémont et al. (2020) noted that most participants preferred bounding box prompts over pedestrian panel prompts because bounding boxes better help determine the position of pedestrians, whereas pedestrian panels may prompt unnecessary braking. To ensure vehi- cle safety, Dou et al. (2022) designed the interface’s content color to balance the driver’s visual sensitivity and fatigue, thereby directly impacting driver performance. Li et al. (2021) also suggested that a HUD system with blue as the primary color can serve as an effective aid, thus enhancing driving safety. The arrow-pointing AR-HUD interface and the virtual shadow AR- HUD interface have been shown to reduce driver visual dispersion more effectively than non-AR-HUD interfaces (Jing et al., 2022). It is also noted that the effectiveness of different AR-HUD interfaces varies in specific sce- narios, indicating that interface design should be tailored accordingly. Yu et al. (2023) noted that driver’s needs for AR element information vary across different scenarios, with their subjective attention differing among information types. Morra et al. (2019) observed that incorporating more information into AR-HUD interface designs can reduce participants’ stress and enhance their trust in autonomous driving. Hecht et al. (2022) introduced an emotional information auxiliary element, and experiments indicated that participants’ attention to the road remained relatively stable when this ele- ment was included. Bielecki et al. (2020) investigated how AR symbols and multimodal methods could effectively reduce driver cognitive load. Addition- ally, Wang et al. (2022) demonstrated through experiments that multimodal warning signals enhance driving performance more than single-modal sig- nals, linking the addition of visual or auditory signals to driving performance improvements.

ADAPTIVE SYSTEM The adaptive system based on AR-HUD is one of the development trends of the future industry. Frémont et al. (2020) proposed a new adaptive system that provides visual cues based on the driver’s alertness, which can better

Understanding Driver’s Emotion and Attention in the Context 403

adapt to the driver’s attention and emotional state, thereby improving pedes- trian driving awareness in dangerous situations. Wojtkowski et al. (2022) proposed an attention-based adaptive system and demonstrated its effective- ness in maintaining safe driving. Bautu et al. (2020) has developed a system to assist drivers in managing and driving related information, in order to improve their attention and safety. The system can filter out notifications from third-party applications, such as social media, email, and instant mes- saging, to reduce driver interference. In addition, the system can also provide information about weather and traffic conditions to help drivers make better decisions.

CONCLUSION

This review summarizes the literature on the interaction between driver unconscious responses and AR-HUD systems. From the literature, it can be seen that most studies focus on driver’s attention and driving performance in the context of AR-HUD, verifying the effectiveness of AR-HUD in improving driving safety. However, there is little research on drivers’ emotions in the context of AR-HUD. Studying how AR-HUD affects drivers’ emotions is not only important for providing new insights into the industry, but also for main- taining steady development in the entire field. Correspondingly, detecting and regulating emotions within the driving environment is crucial. Designing visual information for AR-HUD systems that effectively identify emotions in various driving scenarios is important. Furthermore, incorporating sys- tem feedback and adaptive adjustments holds significant potential for future industry advancements. Based on these studies, reasonable methods can be proposed to monitor driving emotions in the context of AR-HUD. In the future, other sensors and machine learning models can be used to more accu- rately detect the emotion of drivers, further improving the personalization and adaptability of autonomous driving. For instance, the driver’s emotions can be detected solely through facial expressions, and the AR-HUD interface can be adjusted accordingly to improve driving safety.

ACKNOWLEDGMENT

This work was supported partially by General Research Fund (GRF/PolyU 15606321) from Research Grants Council of Hong Kong, The Hong Kong Polytechnic University under Grant (P0046465), and Research Centre of Future (Caring) Mobility (P0042701).

REFERENCES

Agrafioti, F., Hatzinakos, D., & Anderson, A. K. (2011). Ecg pattern analysis for emotion detection. IEEE Transactions on affective computing, 3 (1), 102–115. Aydogdu, S., Luzuriaga, M., & Schick, B. (2020). How can we improve the driving

experience with human-machine-interface for automated driving? In Advances in usability, user experience, wearable and assistive technology: Proceedings of the ahfe 2020 virtual conferences on usability and user experience, human factors and assistive technology, human factors and wearable technologies, and virtual environments and game design, July 16–20, 2020, USA (pp. 218–224).

Bautu, E., Puchianu, C. M., Bran, E., Sburlan, D. F., & Popovici, D. M. (2020, May).

In-vehicle software system for fostering driver’s attentiveness. In 2020 Interna- tional Conference on Development and Application Systems (DAS) (pp. 151–156). IEEE. Bielecki, K., L ’opez Hern ’andez, D., Bloch, M., Baltzer, M., Schmidt, R., Wasser, J., & Flemisch, F. (2020). Enhancing reality: Adaptation strategies for ar in the field. In Augmented cognition. human cognition and behavior: 14th international con- ference, ac 2020, held as part of the 22nd hci international conference, HCII 2020, Copenhagen, Denmark, July 19–24, 2020, proceedings, part ii 22 (pp. 304–315). Bos, D. O., et al. (2006). EEG-based emotion recognition. The influence of visual

and auditory stimuli, 56 (3), 1–17. Braun, M., Weber, F., & Alt, F. (2020). Affective automotive user interfaces– reviewing the state of emotion regulation in the car. arXiv preprint arXiv:2003.13731. Cheng, Y.-n., Zhong, X., & Tian, L.-w. (2023). Does the ar-hud system affect

driving behaviour? an eye-tracking experiment study. Transportation research interdisciplinary perspectives, 18, 100767. Damasio, A. R., Tranel, D., & Damasio, H. (1990). Face agnosia and the neural substrates of memory. Annual review of neuroscience, 13 (1), 89–109. Darwin, C., & Prodger, P. (1998). The expression of the emotions in man and

animals. Oxford University Press, USA. Dellaert, F., Polzin, T., & Waibel, A. (1996). Recognizing emotion in speech. In Proceeding of fourth international conference on spoken language processing. icslp’96 (Vol. 3, pp. 1970–1973). Detjen, H., Geisler, S., & Schneegass, S. (2020). “Help, accident ahead!” using mixed

reality environments in automated vehicles to support occupants after passive acci- dent experiences. In 12th international conference on automotive user interfaces and interactive vehicular applications (pp. 58–61). Dou, J., Xu, C., Chen, S., Xue, C., & Li, X. (2022). Ar hud interface optimization model for balancing driver’s visual sensitivity and fatigue. Procedia Computer Science, 214, 1568–1580. Ekman, P. (1993). Facial expression and emotion. American psychologist, 48 (4),

384. Ekman, P. E., & Davidson, R. J. (1994). The nature of emotion: Fundamental questions. Oxford University Press. Frémont, V., Phan, M.-T., & Thouvenin, I. (2020). Adaptive visual assistance sys-

tem for enhancing he driver awareness of pedestrians. International Journal of Human–Computer Interaction, 36 (9), 856–869. Gabbard, J. L., Fitch, G. M., & Kim, H. (2014). Behind the glass: Driver challenges and opportunities for ar automotive applications. Proceedings of the IEEE, 102 (2), 124–136. Gross, J. J. (2002). Emotion regulation: Affective, cognitive, and social consequences.

Psychophysiology, 39 (3), 281–291. Hecht, T., Zhou, W., & Bengler, K. (2022). How to keep drivers attentive during level 2 automation? development and evaluation of an hmi concept using affective elements and message framing. Safety, 8 (3), 47. Heo, J., Lee, H., Yoon, S., & Kim, K. (2022). Responses to take-over request

in autonomous vehicles: effects of environmental conditions and cues. IEEE transactions on intelligent transportation systems, 23 (12), 23573–23582. Hernandez, J., McDuff, D., Benavides, X., Amores, J., Maes, P., & Picard, R. (2014).

Autoemotive: bringing empathy to the driving experience to manage stress. In Proceedings of the 2014 companion publication on designing interactive systems (pp. 53–56).

Understanding Driver’s Emotion and Attention in the Context 405

James, L. (2009). Road rage and aggressive driving: Steering clear of highway warfare. Prometheus Books. Jeon, M. (2016). Don’t cry while you’re driving: Sad driving is as bad as angry driv-

ing. International Journal of Human–Computer Interaction, 32 (10), 777–790. Jing, C., Shang, C., Yu, D., Chen, Y., & Zhi, J. (2022). The impact of different ar-hud virtual warning interfaces on the takeover performance and visual characteristics of autonomous vehicles. Traffic injury prevention, 23 (5), 277–282. Keltner, D., Ekman, P., Gonzaga, G. C., & Beer, J. (2003). Facial expression of

emotion. Kim, S., Oh, J., Seong, M., Jeon, E., Moon, Y.-K., & Kim, S. (2023). Assessing the impact of ar huds and risk level on user experience in self-driving cars: Results from a realistic driving simulation. Applied Sciences, 13 (8), 4952. Lang, P. J., Greenwald, M. K., Bradley, M. M., & Hamm, A. O. (1993). Looking

at pictures: Affective, facial, visceral, and behavioral reactions. Psychophysiology, 30 (3), 261–273. Li, X., Jiang, B., Li, Z., & Wu, Z. (2021). Research on the usability design of hud interactive interface. In Human-computer interaction. design and user experience case studies: Thematic area, hci 2021, held as part of the 23rd hci international conference, hcii 2021, virtual event, july 24–29, 2021, proceedings, part iii 23 (pp. 370–380). Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J.

P.,... Moher, D. (2009). The prisma statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: Explanation and elaboration. Journal of clinical epidemiology, 62 (10), e1–e34. Liu, Z.-T., Xie, Q., Wu, M., Cao, W.-H., Mei, Y., & Mao, J.-W. (2018). Speech emotion recognition based on an improved brain emotion learning model. Neu- rocomputing, 309, 145–156. Lutz, J., Herwig, U., Opialla, S., Hittmeyer, A., Jancke, L., Rufer, M.,... Bruhl, A.

B. (2014). Mind-fulness and emotion regulation—an fmri study. Social cognitive and affective neuroscience, 9 (6), 776–785. Luzuriaga, M., Aydogdu, S., & Schick, B. (2022). Boosting advanced driving information: A real-world experiment about the effect of hud on hmi, driving effort, and safety. International Journal of Intelligent Transportation Systems Research, 20 (1), 181–191. Mendoza, J. (2020). Head-up displays vs. head-down displays for vehicle naviga-

tion with implemented driving distractions. In Iie annual conference. proceedings (pp. 1074–1079). Mesken, J., Hagenzieker, M. P., Rothengatter, T., & De Waard, D. (2007). Frequency, determinants, and consequences of different drivers’ emotions: An on-the-road study using self-reports, (observed) behaviour, and physiology. Transportation research part F: traffic psychology and behaviour, 10 (6), 458–475. Morra, L., Lamberti, F., Prattic ’o, F. G., La Rosa, S., & Montuschi, P. (2019). Build-

ing trust in autonomous vehicles: Role of virtual reality driving simulators in hmi design. IEEE Transactions on Vehicular Technology, 68 (10), 9438–9450. Morton, J. B., & Trehub, S. E. (2001). Children’s understanding of emotion in speech.

Child development, 72 (3), 834–843. Nass, C., Jonsson, I.-M., Harris, H., Reaves, B., Endo, J., Brave, S., & Takayama, L. (2005). Improving automotive safety by pairing driver emotion and car voice emotion. In Chi’05 extended abstracts on human factors in computing systems (pp. 1973–1976).

Niedenthal, P. M., Halberstadt, J. B., Margolin, J., & Innes-Ker,

  • A. H. (2000). Emotional state and the detection of change in facial expression of emotion. European journal of social psychology, 30 (2), 211–222. Nwe, T. L., Foo, S. W., & De Silva, L. C. (2003). Speech emotion recognition using

hidden Markov models. Speech communication, 41 (4), 603–623. Ochsner, K. N., Bunge, S. A., Gross, J. J., & Gabrieli, J. D. (2002). Rethinking feelings: an fmri study of the cognitive regulation of emotion. Journal of cognitive neuroscience, 14 (8), 1215–1229. Paredes, P. E., Zhou, Y., Hamdan, N. A.-H., Balters, S., Murnane, E., Ju, W., &

Landay, J. A. (2018). Just breathe: In-car interventions for guided slow breath- ing. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 2 (1), 1–23. Pececnik, K. S., & Sodnik, J. (n.d.). Increasing driver’s situational awareness in semiautomated vehicles using a head-up display. Pbecher, C., Lemercier, C., & Cellier, J.-M. (2009). Emotions drive attention: Effects

on driver’s behaviour. Safety Science, 47 (9), 1254–1259. Pei, Y., Song, Z., Jin, X., Yang, Z., Wen, C., & Shao, X. (2020). Modeling and evaluation of attention allocation in an intelligent tractor head-up display interface. Human Factors and Ergonomics in Manufacturing & Service Industries, 30 (3), 204–220. Pham, T. H., & Philippot, P. (2010). Decoding of facial expression of emotion in

criminal psychopaths. Journal of personality disorders, 24 (4), 445. Phan, K. L., Wager, T., Taylor, S. F., & Liberzon, I. (2002). Functional neuroanatomy of emotion: A meta-analysis of emotion activation studies in pet and fmri. Neuroimage, 16 (2), 331–348. Piana, S., Stagliano, A., Odone, F., Verri, A., & Camurri, A. (2014). Real-time auto-

matic emotion recognition from body gestures. arXiv preprint arXiv:1402.5047. Roidl, E., Frehse, B., & Hoger, R. (2014). Emotional states of drivers and the impact on speed, acceleration and traffic violations—a simulator study. Accident Analysis & Prevention, 70, 282–292. Rusch, M. L., Schall Jr, M. C., Gavin, P., Lee, J. D., Dawson, J. D., Vecera, S., & Rizzo,

M. (2013). Directing driver attention with augmented reality cues. Transportation research part F: Traffic psychology and behaviour, 16, 127–137. Schall Jr, M. C., Rusch, M. L., Lee, J. D., Dawson, J. D., Thomas, G., Aksan, N., & Rizzo, M. (2013). Augmented reality cues and elderly driver hazard perception. Human factors, 55 (3), 643–658. Shan, C., Gong, S., & McOwan, P. W. (2007). Beyond facial expressions: Learning

human emotion from body gestures. In Bmvc (pp. 1–10). Steinhauser, K., Leist, F., Maier, K., Michel, V., Parsch, N., Rigley, P.,... Steinhauser, M. (2018). Effects of emotions on driving behavior. Transportation research part F: Traffic psychology and behaviour, 59, 150–163. Strongman, K. T. (1996). The psychology of emotion: Theories of emotion in

perspective. John Wiley & Sons. Underwood, G., Chapman, P., Wright, S., & Crundall, D. (1999). Anger while driving. Transportation Research Part F: Traffic psychology and behaviour, 2 (1), 55–68. Wallbott, H. G. (1991). Recognition of emotion from facial expression via imitation?

some indirect evidence for an old theory. British journal of social psychology, 30 (3), 207–219. Wang, Y., Wu, B., Ma, S., Wang, D., Gan, T., Liu, H., & Yang, Z. (2022). Effect of mapping characteristic on audiovisual warning: Evidence from a simulated driving study. Applied ergonomics, 99, 103638.

Understanding Driver’s Emotion and Attention in the Context 407

Wang, Y., Wu, Y., Chen, C., Wu, B., Ma, S., Wang, D.,... Yang, Z. (2022).

Inattentional blindness in augmented reality head-up display-assisted driving. International Journal of Human–Computer Interaction, 38 (9), 837–850. Weber, M. (2018). Automotive emotions: a human-centred approach towards the measurement and understanding of drivers’ emotions and their triggers (Unpub- lished doctoral dissertation). Brunel University London. Wojtkowski, B., Thouvenin, I., & Teichrieb, V. (2022). Ami: Attention based adapta-

tive feedback with augmented reality to improve takeover performances in highly automated vehicles. In Visigrapp (2: Hucapp) (pp. 99–107). Yan, W., & Yue-jia, L. (2005). Standardization and assessment of college students’ facial expression of emotion. Chinese Journal of Clinical Psychology. Yerkes, R. M., Dodson, J. D., et al. (1908). The relation of strength of stimulus to

rapidity of habit-formation. Yu, M., Li, C., Wu, J., & Wang, H. (2023). Exploring the attention level of arhud interface elements based on driving scenarios. In 2023 14th international conference on mechanical and intelligent manufacturing technologies (icmimt) (pp. 117–121). Zepf, S., Dittrich, M., Hernandez, J., & Schmitt, A. (2019). Towards empathetic car

interfaces: Emotional triggers while driving. In Extended abstracts of the 2019 chi conference on human factors in computing systems (pp. 1–6). Zhang, H., Yu, Z., Zhang, C., Zhang, R., Liu, Y., & Lee, S. H. (2022). User-centered information architecture of vehicle ar-hud interface. In International conference on human-computer interaction (pp. 309–325).

Cover of the proceedings volume Advances in Human Factors of Transportation

Explore the complete digital volume

Advances in Human Factors of Transportation

Read this individual research paper free through the original publisher, or explore the full digital proceedings book.

ISBN 978-1-964867-24-3

Explore this ISBN in the AHFE Bookstore Listed in the July 2026 bookstore catalogue; search by ISBN to confirm current availability · Digital book purchase optional

Explore Related Research

Related research 8 matches

More papers from this volume

← Back to Research ExplorerBrowse the full library →