Skip to main content
Download PDF

Effect of problem-based learning on severity classification agreement by triage nurses

BMC Nursing volume 20, Article number: 256 (2021) Cite this article

Abstract

Background

Differences in the classification results among triage nurses in the emergency room can be improved by training or applying an algorithm. This study aimed to confirm whether the agreement among triage nurses could be improved through learner-led problem-based learning.

Methods

This study had a single-group time series design to investigate the effect of problem-based learning led by triage nurses on the agreement of Korean Triage and Acuity Scale classification results for patients who visited the emergency department. We extracted 300 patients each in May and August 2018 before learning began and 300 patients each in May and August 2019 after learning.

Results

After problem-based learning was applied, the self-efficacy of triage nurses for emergency patient classification increased statistically significantly compared to before learning (7.88 ± 0.96, p < .001), and the weighted kappa coefficient was also found to be almost perfectly agreement (0.835, p < .001).

Conclusions

In this study, problem-based learning improved the inter-rater agreement of Korean Triage and Acuity Scale classification results and self-efficacy of triage nurses. Therefore, problem-based learning can contribute to patient safety in the emergency department by enhancing the expertise of triage nurses and increasing the accuracy of triage classification.

Peer Review reports

Background

According to statistics released by the National Emergency Medical Center in Korea in 2019, more than 10 million patients visited the emergency department (ED) during 2018, which was more than 20% higher than that in 2008 as a result, ED overcrowding is increasing [1]. As the number of patients who visited the ED increases, ED overcrowding has been pointed out as one of the most important problems [2]. One of the most important ways to relieve ED overcrowding is by reducing the length of stay of emergency patients [3, 4]. The ED stay time can be reduced by appropriately classifying the severity of emergency through accurate initial assessment of patients who visit the ED [5, 6].

Classifying the severity appropriately through initial assessment of patients visiting the ED is a process of determining where to receive treatment [7]. Accurate patient classification is essential for identifying patients who do not require prior intervention and optimizing emergency medical resources for immediate treatment [8]. Therefore, triage nurses in charge of initial assessment in the ED should quickly and appropriately categorize the severity of patients visiting the ED. This is one of the most important tasks of ED triage nurses [9].

For initial assessment and classification tool of emergency patients in Korea, various classification tools were used in each hospital until recently [10]. In 2012, the Korean Triage and Acuity Scale (KTAS) Committee affiliated with the Korean Society of Emergency Medicine developed KTAS as a Korean type emergency patient classification tool based on Canadian Triage and Acuity Scale (CTAS), Canada’s five-stage classification tool, by modifying and supplementing it to suit the domestic situation [11]. Since 2016, the law on emergency medical care has been changed. All EDs have been using the KTAS to classify patients visiting the ED [12]. This severity classification is performed by nurses in the United States [12]. In most EDs in Korea, nurses perform patient classification through initial evaluation. However, there is a difference in the degree of agreement among triage nurses according to ED experience or clinical experience of nurses who perform the evaluation. Objective evaluation may be difficult in psychological and mental health areas, although respiratory diseases could be objectively evaluated [9]. In addition, the severity classification may be different because different factors determine the degree of urgency [13]. Even if there are clear criteria for classification, there might be differences in the severity classification results among evaluators. In one study determining the agreement between nurses and emergency doctors [14], the Kappa coefficient was 0.659. In addition, there was a significant difference in classification between male and female nurses (p = .003) [14]. Another study has assessed the degree of agreement among nurses [15] and found that the kappa coefficient is 0.79. The kappa coefficient was 0.721 in one study that determined the degree of agreement between nurses and medical students [16]. In one study that determined the agreement between triage nurses and an expert group consisting of KTAS instructors, the weighted kappa coefficient was 0.77 [17]. These results are interpreted by Landis & Koch, which shows a ‘substantial agreement’, but there are some differences among evaluators [18]. As such, differences in severity classification results among triage nurses may occur, and the differences in classification results may cause patient dissatisfaction and threaten patient safety. The agreement of these classification results can be improved by training or applying an algorithm [13].

Problem-based learning (PBL) is a small group of learning method that enables students to present problems and learn knowledge, skills, and attitudes to solve problems [19]. This is a learning method that can develop not only knowledge acquisition, but also reasoning ability and critical thinking ability [19]. In previous studies, after PBL was conducted, learning attitude [20, 21], critical thinking skill [22, 23], problem solving [21, 24], and knowledge [25, 26] of nursing students and medical students were improved. As such, it is believed that PBL, led by nurses, will help resolve the discrepancy in the severity classification results of ED patients and help improve the patient classification algorithm. However, previous studies that suggested a method to improve the agreement of the severity classification results through PBL were insufficient. It is necessary to confirm whether PBL led by triage nurses using actual patient cases helps to improve the agreement of classification results among triage nurses. Therefore, the purpose of this study is to investigate the effect of PBL led by a triage nurse on the consistency of KTAS classification results of patients who visited the ED.

Methods

Study design

This study had a single-group time series design to investigate the effect of PBL led by triage nurses on the agreement of KTAS classification results for patients who visited the ED.

Study subjects

Patients

Bujang and Baharum have presented a minimum sample number of 396 with a significant level of 0.05, power of 90%, with a goal of 0.7 to 0.8 kappa coefficient for tools of grade 5 [27]. In another study that presented a monogram for calculating sample size with Kappa statistics, the required number of samples was at least 283 at significant level of 0.05, power of 80%, and kappa coefficient of 0.9 [28]. Therefore, this study included approximately 1,200 patients (600 patients before PBL and 600 patients after PBL, considering daily visits to the ED. Patients aged 15 years or older who had visited an ED during May and August 2018 for preliminary surveys and May and August 2019 for postmortem surveys respectively were included. Those who had insufficient initial evaluation nursing record in the electronic medical record were excluded.

Triage nurses

Subjects were nurses with KTAS certification in the ED who were in charge of initial patient classification during the study. A total of 51 nurses are working in the ED of the hospital in which this study was conducted, and one triage room is operated normally. Of a total of 51 nurses, about 15 nurses who have received the qualifications granted by the KTAS committee take turns classifying patients in the ED. We retrospectively investigated the results of triage nurses classifying patients who visited the ED. In May and August 2018, the preliminary survey period, 11 and 12 triage nurses were included, respectively, and in May and August 2019, the post-test period, 12 and 13 triage nurses were included, respectively.

Study procedure

Problem based learning (PBL)

PBL was led by triage nurses in charge of patient classification in the ED. Triage nurses in charge of patient classification in the emergency room were asked to record ambiguous cases during the initial patient classification task in a shared notebook placed in the triage room. In this learning meeting, triage nurses and emergency physicians gathered to present their opinions on the KTAS classification results of cases recorded in this shared note, and through discussions, a classification policy was set so that patients with similar symptoms can later visit the ED (Fig. 1). The date and time of PBL was announced two weeks in advance, and triage nurses were encouraged to participate voluntarily. When additional learning is needed for a specific case, one or two triage nurses reviewed the literature and made a presentation within 10 min at the next meeting, and the classification policy for the case was decided through further discussion. Social media, groupware e-mails, and shared notes in the triage room were used to share the decisions made in PBL with other ED nurses. This learning meeting lasted about 60 min each time, and about 10-15 people participated, and it was held twice a month (Fig. 2).

Fig. 1
figure 1

Problem based-learning procedure

Full size image
Fig. 2
figure 2

 A scene from a PBL meeting with triage nurses and emergency physicians

Full size image

Data collection procedure

For pre-investigation, we extracted 300 patients using Microsoft’s Excel random function from EDs in May and August of 2018 before the PBL meeting began. We retrospectively reviewed emergency nursing information surveys stored in the electronic medical record (EMR). For post-investigation, we reviewed patient’s emergency nursing information surveys stored in the EMR for patients visiting the ED six months after the problem-based study meeting in May 2019 and August 2019 in the same way as the pre-investigation. Emergency nursing information surveys for patients who visited the ED during pre- and post- investigation periods were retrospectively reevaluated without knowing KTAS classification results evaluated by triage nurses by two Gold Standard nurses; one nurse was a KTAS instructor and a nurse with over 15 years of ED work experience, and the other nurse had over 15 years of emergency room work experience and over 10 years of triage work experience. We compared KTAS classification results classified by these Gold Standard nurses with those evaluated by triage nurses. We measured and compared the weighted Kappa coefficient, the coefficient of agreement.

Study endpoints

Inter-rater agreement of KTAS

Gold Standard evaluators re-evaluated the KTAS classification results classified by triage nurses, and the weighted KAPPA coefficient was measured to confirm the degree of agreement between these two groups. Cohen suggested the Kappa result be interpreted as follows: values ≤ 0 as indicating no agreement and 0.01–0.20 as none to slight, 0.21–0.40 as fair, 0.41– 0.60 as moderate, 0.61–0.80 as substantial, and 0.81–1.00 as almost perfect agreement.

KTAS self-efficacy

The self-efficacy of the severity classification was investigated with the self-efficacy tool developed by Bandura [29]. This tool is a numeric evaluation scale, with 0 points for the leftmost and 100 points for the rightmost for self-efficacy for triage, and the subject selects one point on a continuous line. And scored. The higher the score, the higher the level of self-efficacy.

Length of ED stay

In the electronic medical record, length of ED stay (ED LoS) was defined as the time of discharge in the ED such as discharge or hospitalization in minutes from the time of receipt in the ED.

Statistical analysis

Collected data were analyzed using SPSS for Windows 23.0 (IBM, Armonk, NY, USA). General characteristics of triage nurses and patients were subjected to descriptive statistics using nominal variables, frequency, and percentage. Continuous variables are presented as mean and standard deviation. One-way ANOVA was used to test the homogeneity of general characteristics of patients and triage nurses before and after PBL meeting. One-way ANOVA was used to compare ED stay time and self-efficacy of nurses before and after PBL. Weighted Kappa coefficient was measured to analyze the consistency of KTAS classification results between triage nurses and Gold standard evaluators.

Ethical considerations

This study was conducted after receiving approval from the B Hospital Medical Research Ethics Review Committee, where researchers of this study were affiliated (IRB approval number: 20,190,426/30-2019-36/053).

Results

General characteristics of study patients and triage nurses according to investigation time

Homogeneity test was performed for general characteristics of study patients and triage nurses at the time of the investigation. As a result, the homogeneity of general characteristics according to the time of investigation was secured for both patients and triage nurses groups (Tables 1 and 2).

Table 1 General characteristics of study patients according to investigation time
Full size table
Table 2 General characteristics of triage nurses according to investigation time
Full size table

ED LoS according to investigation time

Table 1 shows the ED LoS according to the time of investigation. Mean lengths of ED stay at the time of the investigation were 261.53 ± 215.74 min and 264.91 ± 201.63 min prior to the PBL in May 2018 and August 2018, respectively. Mean lengths of ED stay in May 2019 and September 2019 were 237.82 ± 164.13 min and 239.31 ± 181.21 min, respectively. After the PBL meeting, the mean ED LoS decreased, although such decrease was not statistically significant (p = .172) (Table 3).

Table 3 Length of ED stay according to investigation time
Full size table

Self-efficacy according to the time of investigation

Mean self-efficacy scores of KTAS classification at the time of the investigation of triage nurses were 6.50 ± 1.16 and 6.57 ± 0.94 in May 2018 and August 2018, respectively, before the PBL meeting was conducted. After the PBL meeting, mean self-efficacy scores in May 2019 and August 2019 were significantly increased to 7.73 ± 0.89 and 7.88 ± 0.96, respectively (p < .001) (Table 4). As a result of the post-HOC test, there was no statistically significant difference in self-efficacy between May 2018 and August 2018 before the PBL meeting. And there was no statistically significant difference in self-efficacy between May 2019 and August 2019 after the PBL meeting either. However, there were significant differences in self-efficacy between before and after PBL meeting (Table 4).

Table 4 Self-efficacy according to the time of investigation
Full size table

Inter-rater agreement of KTAS classification results by investigation time

The inter-rater agreement of triage nurses in the ED showed weighted Kappa coefficients of 0.69 and 0.67 in May 2018 and August 2018, respectively, before the PBL meeting. However, after conducting the PBL meeting, showed weighted Kappa coefficients in May 2019 and August 2019 were 0.82 and 0.83, respectively, indicating ‘almost perfect’ agreement according to the interpretation proposed by Landis and Koch (1977). The inter-rater agreement of KTAS classification results between triage nurses and gold standard nurses was significantly (p < .001) improved after conducting PBL meeting (Fig. 3).

Fig. 3
figure 3

Inter-rater agreement by time of investigation

Full size image

Discussion

As Emergency Medical Service Act was amended, all EDs in Korea have been using KTAS to classify emergency patients since January 2016 [10]. This task is handled by nurses in most EDs. Many previous studies have reported that KTAS classification results might be different among evaluators. However, it is difficult to find studies suggesting a way to improve the inter-rater agreement among triage nurses. Therefore, this study attempted to improve the agreement among triage nurses’ self-efficacy for severity classification and inter-rater agreement among triage nurses through PBL meeting. Whether the improved agreement might affect the length of ED was also examined. Based on the results of this study, we would like to discuss ways to improve the professionalism of ED triage nurses.

Self-efficacy for patient classification task

In this study, self-efficacy for emergency patient severity classification was improved after PBL led by ED triage nurses. This result cannot be directly compared to previous results because there is no previous research applying PBL. However, results of the study [30] were similar to results of the present study. They compared self-efficacy by developing and applying a web-based KTAS learning program with a control group [30]. Self-efficacy has been found to be improved after education compared to that before and after education in a study comparing HIRAID (History, Identify, Red flags, Assessment, Interventions, Diagnostics, reassessment and communication) framework developed to provide ED nurses with a structured and systematic approach to emergency patient assessment as a simulation training program [31]. The present study confirmed that the self-efficacy was improved through PBL led by triage nurses. However, previous studies have evaluated self-efficacy by applying web-based self-learning program or simulation program. We speculate that self-education, repetitive learning, and meetings to discuss learner-led clinical cases might have raised the self-efficacy of triage nurses’ KTAS classification.

CTAS and KTAS, unlike ESI which predicts and classifies emergency medical resources to be used, are tools that can classify patients based on their complaints [10]. In the first stage, patients are classified by age. In the second stage, patients are classified according to symptoms that patients complain. In the third stage, detailed symptoms included in the major classification are selected. In step 4, the KTAS level is determined by checking the pain or symptom of detailed symptoms selected in step 3. Finally, the place of treatment of the patient is determined according to the possibility of infectious disease that can transmit the disease [10]. Worldwide, emergency patients are classified by nurses in most EDs [9, 32]. Thus, KTAS classification results should be carefully classified because they can be directly linked to the calculation of emergency medical care fees. They are also important for the safety of patients. However, several previous studies have reported differences in classification among evaluators. The Kappa coefficient was 0.659 in a study of Rahmani et al. to determine the agreement of ESI classification between nurses and emergency physicians. In the study of Choi et al., classification was conducted by two research nurses for a total of 233 patients [15]. These patients were also reassessed by 10 triage nurses. They found that the weighted Kappa coefficient was 0.79. The weighted Kappa coefficient was 0.721 in a study of Kim et al., confirming the inter-rater agreement between nurses and medical students [16]. In addition, a weighted Kappa factor of 0.77 was reported in a study confirming the agreement between an expert group consisting of KTAS instructors and triage nurses for severity classification of ED pediatric patients [17]. The interpretation presented by Landis and Koch can be interpreted as a ‘substantial agreement’ [16]. However, there were some differences between the evaluators. In this study, the weighted Kappa coefficients were identified 0.687 and 0.67 respectively, before PBL meeting between triage nurses and Gold Standard nurses. After the PBL meeting was conducted, these weighted Kappa coefficients were improved significantly to 0.823 and 0.835, respectively, showing almost perfect agreement according to Landis and Koch’s interpretation [18]. Results of the present study could not be directly compared to results of previous studies because there is no such previous research. However, results of this study were similar to results of Rankin, Then, & Atack showing that online learning could help triage nurses improve their severity classification accuracy for emergency patients [33].

Effect of PBL on the agreement of triage results

Barrows has proposed PBL method that can be conducted in small groups of student-led learning for medical students [19]. It is a learning method that learners can present their problems and learn knowledge and skills to solve problems through discussions in small groups so that they can develop reasoning skills and critical thinking skills to cope with given similar situations [19]. Previous studies have reported that learning attitude [20, 21], critical thinking skill [22, 23], problem solving ability [21, 24], and knowledge [25, 26] of nursing students and medical students are improved after the implementation of PBL. In the present study, learner-led PBL meeting was held with triage nurses working on the KTAS classification task to discuss cases that needed further discussion. In doing so, a consensus was reached and shared among ED nurses. These shared results might have helped their decision making for similar situations later and inter-rater agreement among triage nurses is likely to improve.

However, there was a slight decrease in the ED LoS before and after PBL, although the decrease was not statistically significant. This was different from previous studies [5, 6] showing that the ED LoS was reduced due to accurate patient classification. In the study of Jobé, Ghuysen, & D’Orio, accurate patient classification helped reduce the ED LoS for patients who came to the ED for chest pain [6]. Direct comparisons, not pre-post comparisons, were difficult. However, Erimsah, Yaka, Yilmaz, Kama, & Pekdemir and Kim et al. have reported that adequate patient classification can help reduce the ED LoS [34, 35]. Pierce & Gormley have also reported that primary and secondary assessments can improve the classification of emergency patients, resulting in a shorter ED LoS as a result of applying a more accurate and appropriate patient classification system [36]. In the present study, the ED LoS was reduced approximately 30 min after the PBL meeting, although such reduction was not statistically significant. Various factors may exist to explain the reduction in the ED LoS. It would be hard to say that the improvement in the consistency of KTAS classification only affected the reduction in the ED LoS. Further studies will be needed to determine whether the agreement of emergency severity classification affects the ED LoS.

Limitations

This study has some limitations. First, the inter-rater agreement of KTAS classification might have improved as nurses’ experiences in patient classification work increased after PBL meeting compared to those before PBL meeting. Second, the participation rate was very high, although PBL meeting for nurses was voluntary. However, there were also a small number of nurses who showed low participation frequency. For nurses who did not participate in the problem based-learning meeting, results of the meeting were shared using SNS ‘Band’ application, ‘Groupware email’, and ‘Shared Note’. Third, in this study, the inter-rater agreement between triage nurses and Gold Standard nurses was evaluated. However, we did not determine agreements among the three evaluators. Such information might provide more accurate classification results. Fourth, although most of the nurses who participated in the PBL before and after meeting were the same, the before and after were not completely the same because there were two nurses who resigned and three nurses who were newly starting the triage task. Lastly, this study was a single-center study conducted at a general hospital in Seoul. Thus, it is difficult to generalize results of this study to other settings.

Conclusions

In this study, PBL meeting for triage nurses improved the inter-rater agreement of KTAS classification results and the self-efficacy of triage nurses for emergency patient severity classification. Therefore, PBL meeting led by triage nurses can contribute to patient safety in hospitals by enhancing the expertise of triage nurses and increasing the accuracy of triage classification. Further studies should be conducted to determine whether the agreement of KTAS classification results among triage nurses affects the ED LoS. Educational programs need to be developed to enhance the capacity and professionalism of triage nurses.

Availability of data and materials

The datasets used and/or analysed during the current study are available from the corresponding author upon reasonable request.

Abbreviations

ED:

emergency department

KTAS:

Korean Triage and Acuity Scale

CTAS:

Canadian Triage and Acuity Scale

PBL:

problem-based learning

EMR:

electronic medical record

ED LoS:

length of emergency department stay

References

  1. Moon SW. 2018 Emergency Medical Statistics Yearbook[Internet]. Seoul: National Emergency Medical Center; 2019. [cited 2020 Feb 23]. Available from :https://www.egen.or.kr/nemc/statistics_annual_report.do?brdclscd=01.

  2. Mohiuddin S, Busby J, Savović J, Richards A, Northstone K, Hollingworth W, et al. Patient flow within UK EDs: a systematic review of the use of computer simulation modelling methods. BMJ Open. 2017;7(5):e015007. https://doi.org/10.1136/bmjopen-2016-015007.

    Article  PubMed  PubMed Central  Google Scholar 

  3. Azeredo TRM, Guedes HM, de Almeida RAR, Chianca TCM, Martins JCA. Efficacy of the Manchester Triage System: a systematic review. Int Emerg Nurs. 2015;23(2):47–52. https://doi.org/10.1016/j.ienj.2014.06.001.

    Article  PubMed  Google Scholar 

  4. Thirlwall K, Cooper PJ, Karalus J, Voysey M, Willetts L, Creswell C. Treatment of child anxiety disorders via guided parent-delivered cognitive–behavioural therapy: Randomised controlled trial. Br J Psychiatry. 2013;203(6):436–44. https://doi.org/10.1192/bjp.bp.113.126698.

    Article  PubMed  Google Scholar 

  5. Ha BH, Park JY. Triage and length of stay in a cancer center emergency department. Asian Oncol Nurs. 2017;17(4):246–51. https://doi.org/10.5388/aon.2017.17.4.246.

    Article  Google Scholar 

  6. Jobé J, Ghuysen A, D’Orio V. Advanced nurse triage for emergency department. Rev Med Liege. 2018;73(5-6):229–36. PMID: 29926560.

    PubMed  Google Scholar 

  7. Christ M, Grossmann F, Winter D, Bingisser R, Platz E. Modern triage in the emergency department. Deutsches Ärzteblatt. 2010;107(50):892. https://doi.org/10.3238/arztebl.2010.0892.

    Article  Google Scholar 

  8. Kuriyama A, Urushidani S, Nakayama T. Five-level emergency triage systems: variation in assessment of validity. Emerg Med J. 2017;34(11):703–10. https://doi.org/10.1136/emermed-2016-206295.

  9. Lee EK, Kim JS. Factors influencing triage nurses’ the Korean Triage and Acuity Scale performance ability. J Korean Acad Soc Nurs Educ. 2018;24(1):94–102. https://doi.org/10.22650/JKCNR.2018.24.1.94.

  10. Park J, Lim T. Korean triage and acuity scale (KTAS). J Korean Soc Emerg Med. 2017;(6):547–51.

  11. Lee I, Kim O, Kim C, Oh J, Lim T, Lee J, et al. Validity analysis of Korean Triage and Acuity Scale. J Korean Soc Emerg Med. 2018;29(1):13–20.

    Google Scholar 

  12. Migdal VL, Harper K, Haqqani N, Janiak B. Time Cost of Standardized Nursing Screens in the ED. West J Emerg Med. 2019;20(6):851. https://doi.org/10.5811/westjem.2019.9.44084.

    Article  PubMed  PubMed Central  Google Scholar 

  13. FitzGerald G, Jelinek GA, Scott D, Gerdtz MF. Republished paper: emergency departement triage revisited. J Postgrad Med. 2010;86(1018):502–8. https://doi.org/10.1136/pgmj.2009.077081rep.

    Article  Google Scholar 

  14. Rahmani F, Sepehri Majd P, Ebrahimi Bakhtavar H, Rahmani F. Evaluating the accuracy of emergency nurses in correct triage using emergency severity index triage in Sina hospital of Tabriz: a cross-sectional analysis. JEPT. 2018;4(1):9–13. https://doi.org/10.15171/JEPT.2017.19.

    Article  Google Scholar 

  15. Choi HK, Choi MJ, Kim JW, Lee JY, Shin SH, Lee HJ. Reliability of the Emergency Severity Index version 4 performed by trained triage nurse. J Korean Crit Care Nurs. 2012;5(2):61–71.

    Google Scholar 

  16. Kim JY, Hong DY, Kim SY, Kim JW, Park SO, Lee KR, et al. Reliability of Korean Triage and Acuity Scale-based triage system as a severity index in emergency patients. J Korean Soc Emerg Med. 2017;28(6):552–6.

    Google Scholar 

  17. Moon SH, Shim JL. Triage accuracy of pediatric patients using the Korean Triage and Acuity Scale in emergency departments. J Korea Acad Industr Coop Soc. 2018;19. https://doi.org/10.5762/KAIS.2018.19.11.626.

  18. Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;159–74. https://doi.org/10.2307/2529310.

  19. Barrows HS. A taxonomy of problem-based learning methods. Med Educ. 1986;20(6):481–6. https://doi.org/10.1111/j.1365-2923.1986.tb01386.x.

  20. Mulyanto H, Gunarhadi G, Indriayu M. The effect of problem based learning model on student mathematics learning outcomes viewed from critical thinking skills. J Edu Res Rev. 2018;3(2):37–45. https://doi.org/10.24331/ijere.408454.

    Article  Google Scholar 

  21. Senel E, Ulucan H, Adilogullari I. The Relationship between Attitudes towards problem-based Learning and motivated strategies for learning: A study in school of physical education and sport. Anthropologist. 2015;20(3):446–56. https://doi.org/10.1080/09720073.2015.11891748.

    Article  Google Scholar 

  22. Asyari M, Al Muhdhar MHI, Susilo H. Improving critical thinking skills through the integration of problem based learning and group investigation. Int J Lesson Learn Stud. 2016;5(1):36–44. https://doi.org/10.1108/IJLLS-10-2014-0042.

    Article  Google Scholar 

  23. Yu D, Zhang Y, Xu Y, Wu J, Wang C. Improvement in critical thinking dispositions of undergraduate nursing students through problem-based learning: A crossover-experimental study. J Nurs Educ. 2013;52(10):574–81. https://doi.org/10.3928/01484834-20130924-02.

    Article  PubMed  Google Scholar 

  24. Son Y-J, Song Y-A. Effects of simulation and problem-based learning courses on student critical thinking, problem solving abilities and learning. J Korean Acad Soc Nurs Educ. 2012;18(1):43–52. https://doi.org/10.5977/jkasne.2012.18.1.043.

    Article  Google Scholar 

  25. Last K, Appleton J, Stevenson H. Basic science knowledge of dental students on conventional and problem-based learning (PBL) courses at Liverpool. Eur J Dent Educ. 2001;5(4):148–54. https://doi.org/10.1034/j.1600-0579.2001.50402.x.

  26. Mayner L, Gillham D, Sansoni J. Anatomy and physiology for nursing students: Is problem-based learning effective? Prof Inferm. 2013;66(3):182–86. https://doi.org/10.7429/pi.2013.663182.

  27. Bujang MA, Baharum N. A simplified guide to determination of sample size requirements for estimating the value of intraclass correlation coefficient: A review. Arch Orofac Sci. 2017;12(1):1–11.

    Google Scholar 

  28. Hong H, Choi Y, Hahn S, Park SK, Park B-J. Nomogram for sample size calculation on a straightforward basis for the kappa statistic. Ann Epidemiol. 2014;24(9):673–80. https://doi.org/10.1016/j.annepidem.2014.06.097.

    Article  PubMed  Google Scholar 

  29. Bandura A. Guide for creating self-efficacy scales. In: Pajares F, Urdan T, editors. Self-efficacy beliefs of adolescents. Greenwich (CT): Information Age Publishing; 2006. pp. 307–37.

    Google Scholar 

  30. Kim H-J, Kang H-Y. Effects of a Web-Based Korean Triage and Acuity Scale learning program on triage self-efficacy and triage performance ability for nurses in emergency department. J Korean Acad Nurs. 2019;49(2):171–80. https://doi.org/10.4040/jkan.2019.49.2.171.

    Article  PubMed  Google Scholar 

  31. Munroe B, Buckley T, Curtis K, Murphy M, Strachan L, Hardy J, et al. The impact of HIRAID on emergency nurses’ self-efficacy, anxiety and perceived control: A simulated study. Int Emerg Nurs. 2016;25:53–8. https://doi.org/10.1016/j.ienj.2015.08.004.

    Article  PubMed  Google Scholar 

  32. Göransson KE, Ehrenberg A, Ehnfors M. Triage in emergency departments: National survey. J Clin Nurs. 2005;14(9):1067–74. https://doi.org/10.1111/j.1365-2702.2005.01191.x.

    Article  PubMed  Google Scholar 

  33. Rankin JA, Then KL, Atack L. Can emergency nurses’ triage skills be improved by online learning? Results of an experiment. J Emerg Nurs. 2013;39(1):20–6. https://doi.org/10.1016/j.jen.2011.07.004.

    Article  PubMed  Google Scholar 

  34. Erimşah ME, Yaka E, Yilmaz S, Kama A, Pekdemir M. Inter-rater reliability and validity of the Ministry of Health of Turkey’s mandatory emergency triage instrument. Emerg Med Australas. 2015;27(3):210–5. https://doi.org/10.1111/1742-6723.12385.

    Article  PubMed  Google Scholar 

  35. Kim JH, Kim JW, Kim SY, Hong DY, Park SO, Baek KJ, et al. Validation of the Korean Triage and Acuity Scale compare to triage by emergency severity index for emergency adult patient: Preliminary study in a tertiary hospital emergency medical center. J Korean Soc Emerg Med. 2016;27(5):436–41.

    Google Scholar 

  36. Pierce BA, Gormley D. Are split flow and provider in triage models in the emergency department effective in reducing discharge length of stay? J Emerg Nurs. 2016;42(6):487–91. https://doi.org/10.1016/j.jen.2016.01.005

    Article  PubMed  Google Scholar 

Download references

Acknowledgements

The authors would like to acknowledge the triage nurses in the emergency department of Seoul National University Boramae Medical Center.

Funding

No funding was received for this study. All data collection and analysis fees were paid by the authors.

Author information

Authors and Affiliations

  1. Department of Nursing, Bucheon University, 56, Sosa-ro, Bucheon-si, Gyeonggi-do, Republic of Korea

    Kyeongmin Jang

  2. Department of Nursing, Seoul Metropolitan Government-Seoul National University Boramae Medical Center, 20 Boramae-ro 5-gil, Dongjak-gu, 07061, Seoul, Korea

    Eunmi Jo

  3. Department of Emergency Medicine, Seoul Metropolitan Government-Seoul National University Boramae Medical Center, Seoul National University College of Emergency Medicine, Seoul, Korea

    Kyoung Jun Song

Authors
  1. Kyeongmin Jang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Eunmi Jo
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Kyoung Jun Song
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

KJ and EJ conceived and designed the study, KJ and KJS analysed the data, and KJ wrote the manuscript. EJ and KJS recruited the study participants and collected the data. KJ and EJ were involved in the interpretation of the data and contributed to the manuscript preparation. EJ and KJS were involved in title selection, data analysis, and drafting of the manuscript and approved the final manuscript. All authors have read and approved the final version of the manuscript.

Corresponding author

Correspondence to Eunmi Jo.

Ethics declarations

Ethics approval and consent to participate

This study was approved by the SMG-SNU Boramae Medical Center Institutional Review Board (IRB approval number: 20190426/30-2019-36/053). Written informed consent was obtained from all the triage nurses. All methods were performed in accordance with the relevant guidelines and regulations.

Consent for publication

We obtained written consent from all participants for the use of personally identifiable images in one scene of the PBL meeting of triage nurses and emergency physician in “Fig. 2”.

Competing interests

All the authers declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Jang, K., Jo, E. & Song, K.J. Effect of problem-based learning on severity classification agreement by triage nurses. BMC Nurs 20, 256 (2021). https://doi.org/10.1186/s12912-021-00781-2

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12912-021-00781-2

Keywords

BMC Nursing

ISSN: 1472-6955

Contact us