Skip to article
AHFE AHFE Discoveries AHFE International Open Access Journal
AHFE OPEN ACCESS OPEN ACCESS CONFERENCE PROCEEDINGS PAPER

Clarification of drug-checking strategies for expert pharmacists based on gaze analysis

Medical Simulation Centre, Jichi Medical University, 3311–1 Yakushiji, Shimotsuke-shi, Tochigi, 329-0498, Japan ↗
Publication year
Digital Object Identifier10.54941/ahfe1004844

Abstract

In Japan, a pharmacist who receives a physician’s prescription for a drug (1) checks the medical and pharmacological validity of the prescription; (2) prepares the drug; and (3) confirms that the drug has been prepared as prescribed, and that there are no quality issues. The aforementioned checkpoints (1) and (3) are particularly important for ensuring patient safety. Meanwhile, knowledge of checking is tacit and not shared among pharmacists. Therefore, a pharmacist’s gaze was analyzed to identify checking strategies based on expert gaze patterns. Gazing points in prescriptions during expert checks were measured in a clinical setting. Four participants had 20–30 years of experience as pharmacists. Consequently, four check strategies were identified. However, the check strategy differed, depending on the participant. This indicates that each pharmacist in charge of checking prescriptions has a different strategy, and that there are errors that are difficult to detect. In the future, it is necessary to verify the validity of these strategies in terms of safety, and to develop methods to educate novices in a well-balanced manner in each of these strategies.

INTRODUCTION

Pharmacists play an important role in providing effective and safe medical care (Arakawa, 2022). Countermeasures against unsafe or unjustified drug treatments are a global healthcare safety issue. The World Health Organiza- tion has set a goal of 50% reduction in drug-related avoidable harm globally by 2022 (World Health Organization, 2017; Sheikh et al. 2019). There- fore, various measures, including computerized drug ordering, barcode drug matching, automated dispensing devices, and contraindicated drug-checking systems, have been implemented to improve drug safety in hospitals (Hirano et al. 2017; Kawamoto et al. 2009; Kunitsu et al. 2020; Shah et al. 2016). However, medication errors continue to occur and cause serious harm to patients (Council of Europe, 2007; Wahr et al. 2014). A total of 1,539 med- ical incident reports were submitted to the Japan Medical Safety Research Organization in five years to September 2020, of which 273 (17.7%) were drug-related fatalities (Japan Medical Safety Research Organization, 2022).

© 2024. Published by AHFE Open Access. All rights reserved. 109

110 Maeda

Additionally, >2,000 drug-related incidents are reported annually at the Jichi Medical University Hospital.

In Japan, a pharmacist who receives a physician’s prescription for a drug (1) checks the medical and pharmacological validity of the prescription; (2) prepares the drug; and (3) confirms that the drug has been prepared as pre- scribed, and that there are no quality issues. The aforementioned checkpoints (1) and (3) are particularly important for ensuring patient safety. Many inci- dents have been attributed to omissions in the detection of errors due to inadequate prescriptions and drug checks.

Furthermore, efficient checking strategies are important. The workload of pharmacists in many hospitals is high. For example, at the Jichi Medical Uni- versity Hospital, approximately 20 pharmacists dispense >1,000 inpatient medications daily. Medical care sophistication has increased the complexity of pharmaceutical operations. There are many different prescription drugs, and the time required to check each case is long. Novice pharmacists often check drugs in busy situations. Novices also have expertise in pharmacies; however, their knowledge and skills necessary for safe and efficient checking are lacking and error-prone. Therefore, quality education on safety-related operations is essential. However, in many hospitals, pre-graduate and novice education are insufficient (Vosper and Hignett, 2018). For example, many hospitals use manuals that summarize standard procedures (e.g., checking drug specifications) for education. However, education on specific methods (how to check) is left to each instructor, resulting in variation in education quality. This is partly because the knowledge of safe and efficient checking is tacit.

Therefore, the drug-checking strategies of expert pharmacists must be identified and shared effectively and efficiently among pharmacists. This is expected to allow novices to check and improve their dispensing accuracy and operational efficiency. However, extracting tacit knowledge through simple interviews is difficult. Some industries use expert gaze data to clarify tacit knowledge (Morita et al. 2018; Udagawa 2020; Yamashita et al. 2019).

Hence, in this study, gaze analysis of pharmacists was performed to identify check strategies based on expert gaze patterns.

METHODS

Gazing points during expert checks were measured in a clinical setting (see Figure 1). Four participants had 20–30 years of experience as pharmacists. Each participant wore an eye-mark recorder (Tobii Pro Glasses 2), and gaze data were recorded during a 5-min check. Sampling rate was set at 100Hz, and the four participants checked 24 prescriptions and drugs within 5 min. Eye detection rate from the start to the end of the task was >60% for all the four participants. Tobii Pro Studio (Tobii Technology, Inc., Stockholm, Sweden) was used to analyze the gazing-point videos. The gaze points for each participant were extracted by slowing down the gaze video to 1/16th of the original speed. Based on previous studies (Fukuda et al. 1996) on the definition of gaze point, we confirmed the gaze point by replaying the videos frame by frame, and defined the gaze point as a pause of >0.133 s. Gazing

Clarification of Drug-Checking Strategies for Expert Pharmacists Based on Gaze Analysis 111

duration, number of gazes at the area of interest (AOIs), and order of gazes between AOIs were recorded.

First, gazing pattern at prescriptions, which is the most important source of information during drug checks, was identified. Twenty-four prescription checks were classified using factor analysis based on the duration of gazing at 15 prescription AOIs (see Figure 2). Based on a scree plot, the number of factors was set to four, and principal axis factoring and promax rotation were used.

Figure 1: Experimental environment.
Original PDF Figure 1:
Figure 2: Prescription AOIs.
Original PDF Figure 2:

Next, a scan-path diagram was created to visualize 24 check gazings clas- sified using factor analysis. This is a visualization of the percentage of gaze duration for each AOI relative to the total gaze duration (percentage of gaze duration), as well as the direction and number of movements between AOIs (Aoki et al. 2019; Aoki and Suzuki, 2010; Itoh et al. 1998). First, the per- centage of the gaze duration for each AOI was expressed in terms of the area

112 Maeda

of the circle. Next, for each AOI, the direction of gaze movement was repre- sented by arrows. The thickness of the arrows corresponds to the number of movements. The AOIs of the prescription are shown in Figure 2; the AOIs of the medicine bag are patient name, drug name, prescription number, admin- istration, dosage, days, date dispensed, pharmacist name, and precautions. The AOIs of the drug are patient name, drug name, prescription number, quantity of drug, packaging, imprint, and expiry date.

This study was conducted in accordance with the Declaration of Helsinki, and was approved by the Ethics Review Committee of Jichi Medical Univer- sity (23-005). We explained that consent to participate in the study could be withdrawn at any time, that the results of this study would be published after processing, and that the participants’ personal information would not be revealed in the publication.

RESULTS

Table 1 summarizes the gaze data of the four experts. The number of AOIs and mean number of eye movements in participants 2 and 4 tended to be low, and the mean duration per fixation tended to be long. In other words, participants 2 and 4 focused on referring to less information when checking. Conversely, participants 1 and 3 had more information-based checks.

Table 2 shows the results of the factor analysis based on the gaze duration at the prescription AOIs. Factor 1 consisted of three AOIs regarding adminis- tration and precautions from a physician regarding dosage. Therefore, it was referred to as detection of administration errors.

Table 1. Summary of gazing data for each participant.

Table available in the original PDF paper.

Participant 1 Participant 2 Participant 3 Participant 4

188.1 159.4 178.4 192.7

Total duration of fixation (s)

7 4 8 5

Number of prescriptions checked in 5 min

19 11 18 13

Number of AOIs (Prescription and medicine bag)

1.32 0.88 1.35 1.05

Mean number of eye movements per second

0.758 1.139 0.740 0.954

Mean duration per fixation (s)

Factor 2 consisted of AOIs for understanding a patient’s disease, such as information on the background of dispensing, patient’s age, and hospital department. This was called the detection of inappropriate prescriptions for symptoms.

Clarification of Drug-Checking Strategies for Expert Pharmacists Based on Gaze Analysis 113

Table 2. Factor analysis pattern matrix based on gazing duration of AOIs on prescription (principal axis factoring, promax rotation).

Table available in the original PDF paper.

AOIs Factor 1 Factor 2 Factor 3 Factor 4

29.80 44.17 53.49 60.54

Factor 1: Detection of administration errors Administration 0.986 0.052 −0.099 −0.042 Precautions 0.942 −0.137 0.2 −0.206 Dosage forms 0.728 0.092 −0.098 0.2 Factor 2: Detection of inappropriate prescription for symptoms Pharmacist name 0.029 1.034 -0.267 0.048 Patient age −0.012 0.763 0.155 0.01 Hospital department −0.027 0.496 0.154 −0.361 Patient name −0.212 0.448 0.185 −0.113 Factor 3: Comprehensive checking Specifications −0.138 0.174 0.755 0.352 Prescription number −0.012 −0.2 0.734 0.088 Patient height and weight 0.031 0.045 0.683 −0.288 Factor 4: Detection of dosage errors Dosage −0.165 −0.038 0.092 0.827 Drug Name 0.384 0.017 0.056 0.746 Total amount 0.093 −0.058 0.325 0.411 Variance explained 4.469 2.157 1.397 1.057 Cumulative proportion of variance explained (%)

Factor 3 consisted of the AOIs required for prescription validity and prescription-to-medication matching, such as drug specifications, prescrip- tion number, and patient height and weight. In other words, this information was used to comprehensively check whether the physician is prescribing correctly and whether the pharmacist has prepared the drug as prescribed. Therefore, this was called comprehensive checking.

Factor 4 consisted of AOIs used to check the validity of the drug dosage. This was called detection of dosage errors.

Table 3 lists the factor scores for each check. The relationships between checks by participant 2 and factor 1, participant 3 and factor 2, and par- ticipant 1 and factor 3 were strong. Participant 1 focused on AOIs for comprehensive checking, participant 2 focused on AOIs for administration, and participant 3 focused on AOIs for a patient’s disease. For factor 4 (AOIs on dosage), all the participants gazed.

Table 3. Factor scores for each check (sub A-B: A is the participant number in Table 1, and B is the check number).

Table available in the original PDF paper.

Factor 1 Factor 2 Factor 3 Factor 4 Sub 2–4 4.330 −0.933 −0.729 1.594 Sub 2–2 0.552 −0.982 −0.771 0.165 Sub 4–1 −0.094 −0.935 −1.104 −0.132 Sub 3–4 −0.658 2.136 −0.421 −0.106

(Continued)

114 Maeda

Table 3. Continued Factor 1 Factor 2 Factor 3 Factor 4

Table available in the original PDF paper.

Sub 3–3 −0.723 1.934 −0.585 −0.314 Sub 3–6 −0.404 1.449 0.761 −0.266 Sub 3–7 −0.353 1.303 0.148 −1.403 Sub 3–5 −0.262 1.223 −0.347 0.871 Sub 3–8 −0.411 1.156 0.008 −0.273 Sub 3–2 −0.486 0.618 −0.008 −2.389 Sub 1–6 0.432 0.002 2.210 1.656 Sub 1–5 0.099 −0.352 1.969 −0.848 Sub 1–2 0.262 −0.106 1.095 −0.827 Sub 1–4 0.164 −0.567 1.056 −0.771 Sub 1–3 −0.728 −0.087 0.837 −1.550 Sub 1–1 −0.319 −0.055 0.351 −1.154 Sub 4–2 0.090 −0.789 −0.220 2.069 Sub 1–7 0.333 −0.242 0.458 1.709 Sub 2–3 −0.078 −0.983 −0.791 0.923 Sub 3–1 −0.414 −0.759 −0.213 0.786 Sub 4–3 −0.153 −0.864 −0.823 0.575 Sub 2–1 −0.346 −0.569 −0.472 0.080 Sub 4–4 −0.298 −0.830 −1.169 0.014

Figure 3: Typical scan path for factor 1 (detection of administration errors).
Original PDF Figure 3:

Figures 3–6 show the scan paths for the checks that are representative of each factor. The grey circles indicate AOIs that are strongly related to each factor. First, the scan path of factor 1 (see Figure 3) was simple, with a small number of AOIs and eye movements between the AOIs. Administra- tion and precautions were intensively gazed. Next, the scan path of factor 2 (see Figure 4) showed many eye movements between age, patient name, department, and drug name on the prescription. In other words, after a thor- ough understanding of the patient’s disease based on the prescription, the consistency between the patient’s disease and drug was checked. The scan path of factor 3 (see Figure 5) were the most AOIs in the prescription, and they were exhaustively gazed at. The validity of the physician’s prescription was checked based on the patient’s disease information, and the pharmacists’

Clarification of Drug-Checking Strategies for Expert Pharmacists Based on Gaze Analysis 115

drug preparation errors were checked based on the drug specifications and prescription number. The scan path of factor 4 (Figure 6) had a long gaze duration for the drug name and dosage, concentrating on the information necessary to validate the drug dosage. There was also frequent eye movement between the name of the drug on the prescription and name of the drug on the medication, as well as cross-checking of prescriptions and medications.

Figure 4: Typical scan path for factor 2 (detection of inappropriate prescription for symptoms).
Original PDF Figure 4:
Figure 5: Typical scan path for factor 3 (comprehensive checking).
Original PDF Figure 5:
Figure 6: Typical scan path for factor 4 (detection of dosage errors).
Original PDF Figure 6:

116 Maeda

DISCUSSION

In this study, we identified a drug-checking strategy based on the gaze pat- terns of expert pharmacists. Consequently, the following four check strategies were identified: The first check strategy focused on the detection of administrative errors. Participant 2 was strongly associated with this strategy. Participant 2 tended to have a lower number of AOIs, lower mean number of eye movements, and longer mean duration of fixation than the other participants. As the scan path is very simple, it focuses on detecting administration errors, thereby making the check more efficient. Administration errors account for 34% of preventable drug events (Bates et al. 1995; Raban and Westbrook, 2013). If a physician’s instructions for administering medication are incorrect, the nurse or patient who implements them may make errors that could cause serious harm to the patient. These facts are considered important by experts, and as a result, AOIs related to the prevention of administration errors are considered important.

The second strategy emphasized the detection of prescriptions that are inappropriate for the patient’s disease. Participant 4 was strongly associated with this strategy. Participant 4 focused on information from the prescrip- tion to understand the patient’s disease (patient age, hospital department, etc.). Although contraindications between drugs can be easily detected by electronic medical record systems, it is difficult to automatically check the contraindications of drugs for a patient’s disease (Kunitsu et al. 2020), and human checks by pharmacists are important. It is likely that the experts were aware of this and focused their checks on patient information regarding prescriptions.

The third strategy was to comprehensively check for prescriptions. Par- ticipant 1 was strongly associated with this strategy. Participant 1 had the highest number of AOI references for prescription. The validity of the pre- scription by the physician and drug preparation errors by the pharmacist were checked in a balanced manner. Generally, there are three types of safety checks (Matsui et al. 2008). A surface check reconciles the prescription with the matching drug. A logic check detects contraindications between drugs and checks the logic based on these rules. A context check is used to detect the drug’s validity for the patient’s disease and check its validity for the tar- get situation. For proofreading, context check is more accurate than surface check (Nihei et al. 2002). Pharmacists must balance surface and logic/context checks (drug validity checks) (Japan Medical Safety Research Organization, 2022). The check strategy of participant 1 appeared to balance these forms of checks.

The fourth strategy focused on drug dosage. This strategy was imple- mented for all the participants. As with the first check strategy, the high tendency of physician prescription errors regarding dosage was considered important by all the experts.

Implementing these four check strategies in a balanced manner is essen- tial. However, various experts employed different verification strategies. This indicates that the accuracy of error detection depends on the pharmacist

Clarification of Drug-Checking Strategies for Expert Pharmacists Based on Gaze Analysis 117

responsible for the check. Novice pharmacists are often trained by mentors through on-the-job training (Kasashi et al. 2015). In other words, novices may inherit only the check strategies of their assigned mentors and may not learn all four check strategies in a balanced manner. In the future, it will be necessary to develop educational methods to comprehensively transfer these check strategies to novices.

This study has several limitations. The experimental environment was not controlled because the gaze measurements were conducted in a clinical setting. Specifically, the amount and content of drugs differed among the patients, which may have affected the check strategy. Additionally, because only experts were included in the study, it was not possible to verify whether the results were expert-specific. In the future, novices should be added to the participant population and their check strategies should be compared. Since the number of the participants were four, the check strategies should be con- sidered individualized, and the number of participants should be increased in future studies.

CONCLUSION

In this study, pharmacists’ gaze was analyzed to identify check strategies based on expert gaze patterns. Consequently, four check strategies were iden- tified. In the future, it will be necessary to verify the validity of these strategies in terms of safety and develop a method for comprehensively educating novices on these strategies.

ACKNOWLEDGMENT

I would like to thank Editage (www.editage.com) for English language editing.

FUNDING SOURCES This study was supported by the JSPS KAKENHI (Grant Number JP23K04309).

REFERENCES

Aoki, H., Seki, S., Nishimagi, H., et al. (2019). Visual Perception Patterns in Clinical Reasoning Processes During Diagnosis of Infant Epilepsies: Comparisons of Eye Movement among Nurses and Students Considering their Expertise Levels. The Japanese journal of ergonomics, Volume 55 Issue 5, pp. 200–211. Aoki, H., Suzuki, S. (2010). Gaze metrics for efficient and safe operations of

hemodialysis. Proceedings of the 7th International Conference on Methods and Techniques in Behavioral Research, Eindhoven. Arakawa, N. (2022). Eikoku no Yakuzaishi no Yakuwari to Yakugaku Kyoiku no Henkaku (The Role of Pharmacists and the Transformation of Pharmacy Edu- cation in the United Kingdom), Japanese Journal of Community Medicine and Pharmaceutical Sciences, Volume 9, No. 1, pp. 59–61 [in Japanese].

118 Maeda

Bates D, Cullen D, Laird N, et al. (1995). Incidence of adverse drug events and potential adverse drug events: Implications for prevention. JAMA, Volume 274, pp. 29–34. Council of Europe. (2007). Creation of a better medication safety culture in Europe:

Building up safe medication practices. Expert group on safe medication practices (P-SP-PH/SAFE). Available: https://optimiz-sih-circ-med.fr/Documents/Council_ of_Europe_Medication_Safety_Report_19-03-2007.pdf [Accessed 16 Jan 2024]. Fukuda, R., Sakuma, M., Nakamura, E., et al. (1996). An experimental consideration on the definition of a fixation point. The Japanese journal of ergonomics, Volume 32 Issue 4, pp. 197–204. Hirano, Y., Kodawara, T., Igarashi, T., et al. (2017). Preventive Effect for Dispens-

ing Errors and Incidents by Drug Verification and Quantity Management System Using Personal Digital Assistants and Medicine Barcodes, Japanese Journal of Pharmaceutical Health Care and Sciences, Volume 43 Issue 9, pp. 502–508. Itoh, K., Hansen, J. P., Nielsen, F. (1998). Cognitive modelling of a ship navigator based on protocol and eye-movement analysis. Le Travail Humain, pp. 99–127. Japan Medical Safety Research Organization. (2022). Recommendations for the

prevention of recurrence of medical accidents (Number 15) Analysis of Deaths Related to “Erroneous Administration of Medicine”. Available: https://www.me dsafe.or.jp/uploads/uploads/files/teigen15english.pdf [Accessed 16 Jan 2024]. Kasashi, K., Miyamoto, T., Harada, S., et al. (2015). Development and Evaluation of an Educational Program for Newly Graduated Pharmacists, Japanese Journal of Pharmaceutical Health Care and Sciences, Volume 41 Issue 8, pp. 533–539. Kawamoto, T., Tominaga, M., Ohshita, M., et al. (2009). Influence of a combined

authentication system and computerized physician order entry system on quality and quantity in near-miss medication reports, The Journal of Japan Society for Health Care Management, Volume 10 Issue 2, pp. 443–448. Kunitsu, Y., Hira, D., Uenishi, K., et al. (2020). Evaluation of Usefulness of Check System for Contraindications for Diseases Linked with Electronic Medical Record System, Japanese Journal of Pharmaceutical Health Care and Sciences, Volume 46 Issue 9, pp. 489–502. Matsui Y, Goto M, Shimadate Y, et al. (2009). The Relationships between Checking

Methods and Error Types on Error Detection for Writings, Numeric Tables, and Drawings, INSS journal: Journal of the Institute of Nuclear Safety System, Volume 16, pp. 2–13. Morita, J., Fujimoto, N., Yanagita, K. (2018). Approach to the transfer of quality control skills at the construction site using eye-gazing data, Proceedings of the Annual Conference of JSAI, Volume. JSAI2018, 32nd, p. 1M202. Nihei, Y., Terashima, M., Suzuki, I., et al. (2002). Why are four eyes better than

two? Effects of collaboration on the detection of errors in proofreading. Japanese Psychological Research, Volume. 44, pp. 173–179. Raban, M. Z., Westbrook, J. I. (2013). Are interventions to reduce interruptions and errors during medication administration effective?: A systematic review. BMJ quality and safety. Shah, K., Lo, C., Babich, M., et al. (2016). Bar code medication administration

technology: A systematic review of impact on patient safety when used with com- puterized prescriber order entry and automated dispensing devices. Can J Hosp Pharm, Volume 69, pp. 394–402. Sheikh, A., Rudan, I., Cresswell, K., et al. (2019) Agreeing on global research priorities for medication safety: An international prioritization exercise. J Glob Health, Volume 9, p. 010422.

Clarification of Drug-Checking Strategies for Expert Pharmacists Based on Gaze Analysis 119

Udagawa, Y. (2020). Study on Technique Transmission and Skill Transmission in the Building Facilities Part 1 Verification of Construction Quality Inspection by Eye-tracking, Technical Papers of Annual Meeting the Society of Heating, Air- conditioning and Sanitary Engineers of Japan, Volume 1, pp. 129–132. Vosper, H., Hignett, S. (2018). A UK Perspective on Human Factors and Patient

Safety Education in Pharmacy Curricula, American Journal of Pharmaceutical Education, Volume 82 Issue 3, p. 6184. Wahr, J. A., Shore, A. D., Harris, L. H., et al. (2014). Comparison of Intensive Care Unit Medication Errors Reported to the United States’ MedMarx and the United Kingdom’s National Reporting and Learning System. Am J Med Qual, Volume 29, pp. 61–69. World Health Organization. (2017) Medication Without Harm -Global Patient

Safety Challenge on Medication Safety. Geneva: World Health Organization. Yamashina, H., Kano, S., Suzuki, T., et al. (2019). Assessing Visual Attention of Mammography Positioning Using Eye Tracking System: A Comparison between Experts and Novices, Japanese Journal of Radiological Technology, Volume 75, Issue 11, pp. 1316–1324.

Cover of the proceedings volume Healthcare and Medical Devices

Explore the complete digital volume

Healthcare and Medical Devices

Read this individual research paper free through the original publisher, or explore the full digital proceedings book.

ISBN 978-1-964867-06-9

Explore this ISBN in the AHFE Bookstore Listed in the July 2026 bookstore catalogue; search by ISBN to confirm current availability · Digital book purchase optional

Explore Related Research

Related research 8 matches

More papers from this volume

← Back to Research ExplorerBrowse the full library →