Skip to main content

Development of nursing handoff competency scale: a methodological study

Abstract

Background

Nursing handoff competency is the ability of the nurse performing the handoff to select and interpret the necessary information for patient care and to convey it efficiently to the nurse accepting the handoff. Nursing handoff is an important nursing task that ensures nursing care continuity, quality and patient safety. This study aimed to develop a scale to measure nursing handoff competency and verify its validity and reliability.

Methods

This study adopted a methodological design. A research process included three phases: (1) scale development (literature review and interviews); (2) scale validation (validity and reliability); (3) standard setting. Data were collected from 496 clinical nurses currently working in hospital wards, intensive care units, and emergency rooms, and who independently perform a handoff in South Korea.

Results

The final scale comprises a self-reported 4-points Ilert scale with 25 items based on four factors: knowledge on handoff methods, identification of patient information, judgment and transfer of nursing situation, and “formation of supportive relationships. Construct validity, criterion-related validity, and discrimination validities were verified and the fitness of the scale revealed good results in confirmatory factor analysis. The Cronbach’s α of the whole tool was.912 and the cut-off score for satisfied/unsatisfied was.72.

Conclusions

The developed scale can evaluate the nurse’s handoff competencies and determine whether training is necessary. The measurement results of the scale can be used to select training subjects and compose the contents of the education program.

Peer Review reports

Introduction

Nursing Handoff is communication between nurses sharing patient information [1]. The Joint Commission on Accreditation of Healthcare Organizations defines a handoff as an interactive process of transferring patient-specific information to ensure patient care continuity and patient safety [2]. The nursing care of inpatients is transferred between nurses at least 2–3 times every 24 h, but nurses must consistently provide proper care [3]. Therefore, nursing handoff is one of the most important nursing tasks in ensuring patient safety and quality of care.

The nurse who is accepting the handoff (receiving nurse) understands the patient’s situation based on the content and delivery method of the information provided by the nurse performing the handoff (sending nurse) [4]. In particular, the information content and delivery method affect the receiving nurse’s clinical judgment, which is directly linked to patient care. Hence, the nurse must identify significant information and effectively deliver it [5]. Competencies required for this can be divided into two categories: the ability to comprehensively understand the patient’s health problems by analyzing patient information and the ability to explain things so that nurses can easily understand them.

Previous studies used clinical reasoning competency [6], critical thinking disposition [7], clinical judgment [4], communication ability [8], and communication clarity [9] to indirectly measure the handoff competency. These tools do not reflect the characteristics of the nursing handoff, such as accurately grasping important patient information, presenting it logically, and delivering it promptly and accurately. Therefore, these instruments have limitations in accurately assessing handoff competency.

The Handoff Clinical Evaluation Exercise [10] and Handover Evaluation Scale [11] were developed to not contain items to assess the specific abilities required for a handoff. The Korean versions of the Perceived self-efficacy of hand-off reporting scale [12] and scale to evaluate communication in nursing handoff [13] reflect the handoff characteristics but only focus on specific areas such as communication standards. Therefore, an instrument that addresses the limitations of existing scales and comprehensively assesses nursing handoff competency is needed.

This study aimed to develop a nursing handoff competency scale for assessing the overall handoff competencies required of nurses to identify meaningful patient information and deliver it effectively. The assessment results can be used to identify nurses who need additional training and shed light on their areas of weakness to develop education programs specific to their needs. Providing tailored educational support can enhance the nursing handoff competencies, which would ultimately improve nursing care efficiency and quality.

Methods

Study design

This methodological study developed a scale to measure nursing handoff competency and to verify its validity and reliability.

Study procedure

This study was conducted in three phases: developing nursing handoff competency measurement scale, testing its validity and reliability, and standard setting for the scale.

Phase 1: Development of the scale

The conceptual framework was derived through literature and interviews. From this, preliminary items were formed.

Conceptual framework

Anayzing the literature review and interview results generated the conceptual framework. We searched using the following search criteria. Literature published from 2011 to 2021 was searched and searches were performed on PubMed, CINAHL, RISS, KISS. The terms used in the search were a combination of handoff, handover, nursing, competency, and competence. A literature review was conducted using 26 studies on intervention studies evaluating the effectiveness of handoff education programs, systematic literature review studies, and studies on the development of patient handoff scales.

Personal interviews were conducted with 2 nursing managers and 10 clinical nurses to derive qualitative data. To confirm suitability with the clinical department, interviews were conducted with a total of 12 people, including nurse managers, new nurses, and clinical nurses with preceptor experience. To specifically analyze handoff capabilities, intensive care unit nurses who intensively care for patients with complex health problems were included, and ward and emergency room nurses were also included. The main questions of the interview were open-ended: “What does it mean to be good at handoff?” and “What are the characteristics of a nurse who is good at handoff?” The inductive content analysis method of Elo and Kyngäs [14] was used for data analysis. The analysis classified the conceptual framework of nursing handoff competency into two dimensions: nursing judgment and nursing delivery.

Content validation of the preliminary items

Content validity was conducted in two rounds for 2 dimensions, 8 attributes, and 69 preliminary items derived from the conceptual framework phase. The first round was conducted by 9 experts, including nursing college professors, nursing managers, and nurses with > 5 years of nurse education experience. The evaluation results were analyzed whether the Item-Content Validity Index (I-CVI) of the item was > 0.80 and the S-CVI/Ave was > 0.90 [15]. S-CVI/Ave was 0.92 in the first round, which satisfied the validity standard. The I-CVI distribution was 0.67  1.00 and with 10 items having < 0.80.

Six items that overlapped with other items or were inappropriate for measuring handoff competence were deleted among the items with an I-CVI of < 0.80. Additionally, four items with unclear meanings were modified. The second content validity was qualitatively evaluated by three nursing professors. Items with similar contents were deleted, and items were organized to include only the core contents. Finally, 2 dimensions, 8 attributes, and 49 preliminary questions were derived.

Phase 2: Evaluation of the scale

In the scale verification stage, construct validity, convergent validity, discriminant validity, criterion validity, and reliability were verified.

Samples and data collection

Data collection was performed twice for tool evaluation. The first survey was conducted for exploratory factor analysis (EFA) in the scale development stage, and the second survey was conducted for confirmatory factor analysis (CFA), convergent, discriminant, criterion validities, and reliability verification in the scale verification stage.

The inclusion criteria for this study are as follows: (1) nurses currently working in hospital wards, intensive care units, and emergency rooms, and (2) clinical nurses performing handoff independently. The exclusion criteria of this study are as follows: (1) nurses currently on duty at the hospital but not performing patient handoff, and (2) new nurses who do not perform independent nursing due to the training period. Participants in the first main survey were excluded from the second main survey.

Based on previous studies, the number of samples for EFA is required to be 5–10 times greater than the number of items in the scale [16], which was calculated as 273, considering the dropout rate of 10%. The number of samples for CFA was calculated to be 223, considering the appropriate research results of at least 200 people and a dropout rate of 10%. The second main survey was conducted with the scales modified as an EFA result with the data collected in the first main survey.

For data collection, the researcher explained the purpose of the study and the personal information protection of research participants on the social network system and online cafes, where clinical nurses are the main visitors, and posted the link address of the recruitment documents and questionnaires for research participants. The first survey included 273 participants, while the second included 223, with a total of 496 participants.

Measurement

The general characteristics of the participants, including gender, age, type and region of the institution, department, total clinical career, clinical career at the current hospital, and current working type were investigated. The first survey consisted of 57 questions, including 49 preliminary items and 8 general characteristic items. The second survey consisted of 65 items, including 27 items modified after EFA, 30 for criterion validity, and 8 for general characteristics.

The Korean version of the “Nurses Clinical Reasoning Scale (NCRS)” [17] and the “Global Interpersonal Communication Competence” measuring communication ability (GICC-15) scale were used to verify the criterion validity [18]. NCRS consists of 15 items on a 5-point Likert scale, wherein higher scores indicate higher clinical reasoning competencies. The scale’s reliability was Cronbach’s α = 0.94; in this study, Cronbach’s α was 0.87. The GICC-15 consists of 15 items on a 5-point Likert scale, wherein higher scores indicate higher communication abilities. The scale’s reliability was Cronbach’s α = 0.72; in this study, Cronbach’s α was 0.77.

Data analysis

The collected data were analyzed using SPSS 25.0 and AMOS 22.0 programs. The specific analysis method is as follows.

  1. 1)

    The general participant characteristics were analyzed using descriptive statistics such as frequency, percentage, mean, and standard deviation.

  2. 2)

    EFA and CFA were conducted to verify construct validity. Kaiser-Meyer-Olkin (KMO) measure and Bartlett’s test were conducted to confirm that the items were suitable for EFA. The maximum likelihood method was used for factor extraction, and the promax rotation method was used for factor rotation. The criteria for deleting items were a factor loading value of less than 0.30 [19]. Model fit in CFA was judged through the \( {x}^{2} \)test (p >.05), Standardized Root Mean-square Residual (SRMR < 0.05), Root Mean Square Error of Approximation (RMSEA < 0.05), Comparative Fit Index (CFI > 0.9), and Tucker-Lewis Index (TLI > 0.9).

  3. 3)

    The standardized factor loading values derived from CFA and the correlation coefficient between factors and standard error values were used to confirm the confidence interval of the correlation coefficient between factors to verify convergent and discriminant validities.

  4. 4)

    Pearson’s correlation coefficient was used to verify the criterion validity.

  5. 5)

    the reliability of the developed scale was evaluated using Cronbach’s α value and Spearman-Brown’s coefficient.

Phase 3: Standard setting of the scale

Finally, the cut-off score of the developed scale was set. The extended Angoff method estimates the score expected for a minimum competency holder [20]. The criteria for sufficiency/insufficiency in this study were established using the extended Angoff method. Criteria setters consisted of 6 people, including 2 new nurses and 4 experienced nurses who had experience in educating new nurses. The first round score was calculated by assigning a score that a nurse with a minimum competency could obtain out of four points for each item on the scale. A discussion was conducted between the criteria setters in the second round, based on the evaluation results of the first round. The cut-off score was derived through a total of two rounds.

Ethical consideration

Ethical approval

for this study was obtained from the institutional review board of Ewha Womans University (Approval no. ewha-202105-0028-02). The researcher provided sufficient information to the participants about the purpose of the study, the use of data, and the protection of information before the survey. Consent was obtained from all participants in the online survey by presenting a consent form and having them participate in the survey after agreeing to the study.

Results

Development of the initial items

Based on the literature, a concept analysis resulted in the derivation of two dimensions: nursing judgment and nursing delivery, as components for assessing nursing handoff competencies. In previous studies, handoff competencies of nursing judgment dimension include clinical reasoning, problem-solving ability, critical thinking tendency, clinical judgment, handoff performance ability, clinical performance ability, handoff self-efficacy, communication self-efficacy, handoff confidence, reporting confidence. Nursing delivery dimensions were evaluated as communication clarity, communication ability, information clarity, SBAR skills and knowledge, and handoff time. Notable indicators from scales utilized in prior research to measure nursing handoff capabilities were analyzed. Additionally, characteristics and items were derived through studies on factors influencing handoff, studies on the development of handoff scale, and qualitative studies on nurses’ experiences with handoff. Thus, in the nursing judgment dimension, 5 attributes and 17 indicators were generated, while in the nursing delivery dimension, 3 attributes and 17 indicators were derived.

Furthermore, through the analysis of interview content, two dimensions, nursing judgment, and nursing delivery, were developed, yielding 8 attributes and 48 indicators. Within the nursing judgment dimension, 5 attributes and 23 indicators were derived. These attributes encompass possessing substantial knowledge related to patient conditions, understanding and applying hospital-suggested handoff methods, and comprehending meaningful information. Moreover, an attribute not previously explored in the literature, “utilizing various resources for information gathering,” was identified. The attribute “reasoning health problems by considering contextual situations” includes indicators for task prioritization, comprehensive understanding of patient health issues, and identification of contextual factors influencing patient condition changes.

In the developmental phase of the conceptual framework, attributes and indicators derived from literature and interviews were analyzed, similar content was grouped, and duplicated indicators were eliminated. Consequently, the initial scale comprised two dimensions, eight attributes, and 69 preliminary items.

Participant characteristics

The general characteristics of the participants in this study are shown in Table 1. The first survey included 228 (83.5%) female participants and an average age of 29.7 (± 5.0) years. The tertiary general hospital was the most common type of hospital where the participants worked 148 (54.2%), and the average clinical career was 4.8 (± 3.9) years. Additionally, 85.7% of the participants in the second main survey were female, the average age was 29.9 (± 4.8) years, and the average clinical career was 4.4 (± 3.5) years.

Table 1 General characteristics of participants (N = 496)

Validity and reliability

Construct validity

Exploratory factor analysis

The correlation coefficient for the item “I do not talk about things that are not related to work” between the item and total score was r =.14. The reliability of all items increased from Cronbach’s α of 0.943 to 0.944 when this item was deleted. Therefore, EFA was performed on 48 questions except for this one. The KMO measurement value was 0.92 and Bartlett’s sphericity was statistically significant (\( {x}^{2}\) = 4908.858, df = 1128, p <.001), thus the collected data were suitable for factor analysis. Communality was set at 0.30 to construct items that can express the meaning of factors well. The eigenvalue of ≥ 1.0, which means the explanatory power of the factors, and the scree plot were referred to for the number of factors. Items with a factor loading of ≥ 0.30 were considered meaningful [19], so items with a factor loading of < 0.30 were deleted. This study extracted 12 factors with an eigenvalue of ≥ 1.0, but 4 factors were suitable for the point where the eigenvalue of the scree plot rapidly decreases as a result of checking the “elbow” point (Fig. 1). Therefore, the number of factors was fixed at 4, and the first factor analysis was performed. Finally, the scale was confirmed with 4 factors and 27 items derived from the results of 4 EFA rounds, with 87.52% cumulative explanatory power of the scale (Table 2). The difference between the content of the item and the factor load was considered for items with overlapping loads on both factors. Hence, item 5 was deleted, and items 21 and 23 were placed in factor 3 with a greater factor load. Item 2 was maintained factor 2 by reviewing the contents. Factor 1 has 22.02% explanatory power with 4 items, factor 2 has 24.06% explanatory power with 8 items, factor 3 has 20.88% explanatory power with 7 items, and factor 4 has 20.55% explanatory power with 8 items.

Table 2 Rotated factor pattern matrix (28 items) (N = 273)
Fig. 1
figure 1

Scree plot eigenvalues of exploratory factor analysis

Confirmatory factor analysis

CFA was conducted to confirm the structural suitability of 27 questions and 4 factors derived through EFA. Maximum likelihood estimation was used for CFA, and a standard of ≥ 0.50 was applied for the standardization coefficient [21]. The contents were reviewed among the five items with a standardized coefficient of ≤ 0.50 for the first CFA, wherein two items (Items 27 and 33) were deleted. The second CFA result is shown in (Table 3). The fitness indices of the model were as follow: \( {x}^{2}\)= 349.335 (p =.001), SRMR of 0.05, RMSEA of 0.04, TLI of 0.95, and CFI of 0.96.

Table 3 Results of confirmatory factor analysis (N = 223)

Criterion-related validity

The criterion validity test revealed a significant correlation between the total score of the Nursing Handoff Competency Scale developed in this study and the scores of the NCRS and GICC-15 (r =.60, p <.01; r =.42, p <.01) The criterion validity of the scale developed in this study was verified (Table 4).

Table 4 Correlation between the nursing handoff competency scale and the nurses clinical reasoning scale (NCRS) and the global interpersonal communication competence (GICC-15) (N = 223)

Convergent and discriminant validity

The construct reliability of each factor greater than 0.7 was taken as an indicator to evaluate convergent validity [22]. In this study, the construct reliability of each factor was 0.73 (factor 1), 0.85 (factor 2), 0.84 (factor 3), and 0.69 (factor 4). Additionally, discriminant validity proves the degree of difference between factors. If the confidence interval of the correlation coefficient between factors does not include 1.0, discriminant validity is judged to have been secured [23]. In this study, discriminant validity was verified because the confidence interval of the correlation coefficient between factors did not include 1.0, so the discriminant validity was verified (Table 5).

Table 5 Discriminant validity between factors

Reliability

Cronbach’s α of the whole scale was 0.91 and the Cronbach’s α of the factors ranged from 0.688 to 0.848. Cronbach’s α of each factor was as follows: knowledge on handoff methods 0.72, identification of patient information 0.85, judgement and transfer of nursing situation 0.84, and formation of supportive relationships 0.69. The correlation coefficient for split-half reliability was calculated by dividing the items into odd and even numbers and then applying them to the Spearman-Brown formula, and was calculated as 0.85, thereby verifying the reliability of the scale.

Final measurement scale

The nursing handoff competency scale was finally confirmed through the validity and reliability verification of the developed scale. The scale consists of 25 items with a total of 4 factors: “knowledge on handoff methods (4 items),” “identification of patient information (8 items),” “judgment and transfer of nursing situation (7 items),” and “formation of supportive relationships (6 items).” The scale has a 4-point Likert scale consisting of strongly disagree (1), disagree (2), agree (3), and strongly agree (4), and the measurement range is 25–100 points. The finally confirmed nursing handoff competency scale is shown in Appendix 1.

Cut-off score

The extended Angoff method was used to set the criterion score. The standard setters consisted of new nurses and nurses with experience as preceptor. In the first round, each standard setter assigned the score (0–4 points) needed for a minimumally competent examinee to pass, resulting in a score of 64.83. In the second round, scores were assigned again after discussion between standard setters based on the scores derived in the first round. The final score of 71.25 was derived by multiplying the average of the final assigned scores by the number of questions. The total score of the scale developed in this study was derived as an integer, but the criterion score was calculated as 71.25. When determining the criterion score, the result of applying the criterion score should be considered [20]. Since the nursing handoff competency scale developed in this study was to select nurses who need nursing handoff education, selecting a high score can provide many subjects with educational opportunities. Therefore, the sufficient/insufficient criterion score of this scale was determined as 72 points.

In total, 17.5% of them have insufficient nursing handoff competency with a score of < 72.0 (Table 6). Among the participants with < 1 year of clinical career, 56.0% had insufficient nursing handoff competencies, which was higher than 44.0% of participants who had sufficient competencies, considering the difference according to the clinical career, whereas 12.6% among the participants with ≥ 1 year of clinical career had insufficient nursing handoff competencies. In particular, Six of the participants with 1–3 years of clinical career had a very low nursing handoff competency score of < 50 points. This indicates that nurses who need handoff education should include not only new nurses but also experienced nurses.

Table 6 Sufficient/insufficient judgment result of participants according to the cut-off score (N = 223)

Discussion

This study developed a scale to measure nurses’ handoff competency and verified its reliability and validity. For handoff, a preparation process is needed to determine the patient’s current condition. In this process, the patient’s health-related data, nursing care performed, current treatment status, and information on treatment plans are selected and organized, and this convey through clinical judgment. Another characteristic of nursing handoff is to efficiently convey the information so that the receiving nurse understands the patient’s situation within the given time. Therefore, in this study, in the process of deriving the conceptual framework of the scale, the items were derived by integrating the results of the content analysis of interviews with clinical nurses as well as the literature review of 26 studies. Through this, we derived items to evaluate understanding ability, such as ‘Identify the overall changes in the patient’s health problems (item 13)’, ‘Explain the patient’s health problem by identifying the contextual factors related to the change in the patient condition (item 16)’. In addition, when deriving items, items about communication skills to convey information efficiently were derived. However, through exploratory factor analysis, only two items were retained. This was not classified as a separate factor, but was combined with items about judgment of the nursing situation and organized into the factor ‘judgment and communication of the nursing situation’. So, the final scale consisted of 4 factors and 25 items.

The first factor “Knowledge on handoff methods” includes four items pertinent to the type of information transferred during handoff, the method of handoff, documentation, and the use of an electronic medical record system. These items were derived based on the statements of new graduate nurses, who find handoff challenging, and experienced nurses with preceptor experience. Only 24.7% of facilities have written guidelines or a checklist for handoff within the unit although nurses receive handoff training after being hired [24, 25]. Consequently, most nurses receive only informal handoff training. Nurses who lack knowledge about handoff may omit important pieces of information or present irrelevant information [26, 27]. Unsystematic handoff causes prolonged handoff time and hinders follow-up nursing tasks [28]. Therefore, systematic handoff education and tools for identifying handoff education needs are required to enhance the efficiency of nurses in nursing tasks and help new graduate nurses adjust to clinical practice.

The second factor, “Identification of patient information” consists of eight items that assess whether important information about the patient’s health problems, treatment, and care was delivered during the handoff. The transfer of essential information about the patient’s health problems, treatment, and care between nurses at the change of shift is important to ensure nursing care continuity [29, 30]. Inadequate understanding of patient information engenders problems that threaten patient safety [31], and information omission and ambiguity hinder the follow-up care provided by the receiving nurse and thwart the provision of continuous care because the receiving nurse lacks knowledge about the current treatment status [32, 33]. Therefore, assessing whether a nurse has identified essential information and delivered them is important to measure handoff competency.

The third factor, “Judgment and transfer of nursing situation” comprises seven items about the clinical inference and judgment based on required patient information for a nursing handoff and the ability to transfer patient information. Critical thinking to understand the clinical situation is required during nursing handoff [34]. New graduate nurses experience difficulties to think critically regarding patient health problems even after a year in clinical practice [7]. Additionally, the item assessed to be the most difficult for the minimally competent person was “Comprehensively understanding the patient’s health problem by connecting relevant data” during the establishment of criteria for the scale in this study. The critical thinking process required for clinical judgment is essential to perform a handoff. However, existing handoff assessment tools only evaluate the handoff task itself and disregard the process of understanding the patient’s health problems before the handoff. Nurses’ handoff performance is assessed by determining their ability to analyse and understand the information in a given situation, and the developed scale is important because it contains items for this purpose. Moreover, the method of information delivery is an important part that affects the clinical decision-making of the receiving nurse [35]. This scale did not separate the competency to communicate effectively as a factor. However, the items “Explain the patient’s health problem by identifying the contextual factors (cause, effect) related to the change in patient condition (item 16)”, “Explain information related to health problems according to a causal relationship (item 18)”, and “Structured by integrating data related to health issues, rather than listing information (item 19)” are important items that measure the competency to deliver the context of the nursing process, rather than simply listing information.

The final factor, “Formation of supportive relationships” comprises six items pertinent to maintaining a collaborative and positive relationship between the transferring and receiving nurses. The quality of care is negatively affected by interpersonal problems among nurses, and nurses with better communication skills can communicate actively to promote patient safety [36]. A handoff can be categorized into technical communication, which involves the structuring and explanation of clinical information, and relational communication, which pertains to the interactions between the nurses [37]. The handoff quality is also influenced by relational factors, thus considering both aspects of communication are important. One of the items of our tool pertains to allowing the receiving nurse to ask questions and discuss difficult clinical situations together. The individual interviews with clinical nurses conducted in this study confirmed that the receiving nurse should check the patient’s condition and treatment status during handoff, and in the process, the receiving nurse could make up for the lacking parts of the sending nurse. Therefore a successful transfer of information requires a mutually respectful attitude between the two involved parties as well as evaluation and feedback to foster a supportive relationship.

As previously discussed, a key strength of the tool developed in this study is that it reflects the interpersonal relationship between nurses during a handoff as well as the nursing handoff. Existing instruments to evaluate the effects of handoff training do not reflect the purpose of a handoff, which is to help the receiving nurse understand the patient’s situation. Therefore, these instruments could not assess the process of summarizing and structuring patient data to transfer this information. The tool developed in this study contains items to assess the ability to understand and deliver data, reflects the nature of the nursing handoff based on field data obtained through interviews, and assesses the competencies required for a handoff comprehensively. However, Although this scale is suitable for inter-shift handoffs, further research is needed to determine whether it is also valid for interdepartmental handoffs.

In this study, we provided evidence on how well this scale reflects the concept it is intended to measure through verification of content validity, construct validity, and criterion validity. In scale validation research, the basis for validity cannot be sufficiently supported with just one approach, so various logical grounds must be presented [38]. This study is significant in that it presented a rational basis through various test of the validity of the scale. Moreover, another significant aspect of our scale is that we set cut-off scores to determine adequate/inadequate handoff competency. The cut-off score was set to 72 points. This score can be used to determine whether a nurse has adequate competency to perform a handoff. Among the second round study participants, 17.5% scored below 72, and the differences in the scores were significantly associated with the length of their clinical career. Also the results indicate that some experienced nurses also need additional handoff training, as identified by the cut-off score. This cut-off score is believed to expand the applicability of this tool. Healthcare facilities could determine nurses’ current handoff competencies and identify those in need of further training using this tool. The results of the tool will highlight the areas of weakness among nurses and hence can be useful for structuring relevant handoff training. Furthermore, handoff competency changes based on different career lengths and can be used as evidence data for handoff training for clinical nurses and as foundational data for developing a systematic handoff education system.

Limitations

The nursing handoff competency measurement scale developed in this study is a self-assessment scale, thus the measurement result and the objective nursing handoff competency may be different depending on the participant’s perception. Therefore, the evaluation results of the receiving nurse, peers, nursing educators, and nursing managers should be considered together to objectively utilize the results of the nursing handoff competency measurement scale developed in this study. Additionally, more than 70% of the participants in this study were nurses from tertiary general hospitals and general hospitals and the number of care hospital nurses is low at 2.2%. Therefore, further study is needed to confirm whether it is appropriate to apply to care hospital nurses. Finally, the convergent validity verification results for this tool did not meet the validity criteria. Therefore, further research is needed to address this issue.

Conclusions

The nursing handoff competency scale developed in this study is a consistent and valid evaluation tool. It consisted of 4 factors and 25 items and was a self-assessment tool on a 1–4 point Likert scale. The scores range from 25 to 100, and higher scores indicate higher nursing handoff competency. A score of ≥ 72 can be interpreted as sufficient nursing handoff competency. Therefore, we recommend this scale to evaluate the competency level to perform nurse handover, determine the need for educational support, and check the effectiveness of education.

Data availability

The datasets used or analyzed during the current study are available from the corresponding author on reasonable request.

References

  1. Demiray A, Keçeci A, Açıl A, İlaslan N. A tool for evaluation of nurses handover: validity and reliability study of the handover evaluation scale. Int J Nurs. 2018;8:93–7. https://doi.org/10.5923/j.nursing.20180805.03.

    Article  Google Scholar 

  2. The Joint Commission. Sentinel Event Alert. Joint Comm. 2017;58:1–6.

    Google Scholar 

  3. Weingart C, Herstich T, Baker P, Garrett ML, Bird M, Billock J, Schwartz HP, Bigham MT. Making good better: implementing a standardized handoff in pediatric transport. Air Med J. 2013;32:40–6. https://doi.org/10.1016/j.amj.2012.06.005.

    Article  PubMed  Google Scholar 

  4. Lavoie P, Clarke SP, Clausen C, Purden M, Emed J, Cosencova L, Frunchak V. Nursing handoffs and clinical judgments regarding patient risk of deterioration: a mixed-methods study. J Clin Nurs. 2020;29:3790–801. https://doi.org/10.1111/jocn.15409.

    Article  PubMed  Google Scholar 

  5. Blouin AS. Improving hand-off communications: new solutions for nurses. J Nurs Care Qual. 2011;26:97–100. https://doi.org/10.1097/NCQ.0b013e31820d4f57.

    Article  PubMed  Google Scholar 

  6. Park SJ, Choi HS. The effect of case-based SBAR communication training program on critical thinking disposition, communication self-efficacy and communication competence of nursing students. JKAIS. 2018;19:426–34. https://doi.org/10.5762/KAIS.2018.19.11.426.

    Article  Google Scholar 

  7. Kim JH, Kim HY. Educational need assessment and development of scenarios on simulation-based education of nursing handoffs for new nurses. JLCCI. 2017;17:429–48.

    Google Scholar 

  8. Oh HS. The effects of communication competence, clinical competence and experience of handover on self-efficacy of handover reporting among nursing students. JKAIS. 2020;14:321–31. https://doi.org/10.21184/jkeia.2020.6.14.4.321.

    Article  Google Scholar 

  9. Cho HH, Nam KH, Park JS, Jeong HE, Jung YJ. The effect of simulation training applying SBAR for nursing students on communication clarity, self-confidence in communication, and clinical decision-making ability. JKAIS. 2020;21:73–81. https://doi.org/10.5762/KAIS.2020.21.7.73.

    Article  Google Scholar 

  10. Horwitz LI, Rand D, Staisiunas P, Van Ness PH, Araujo KL, Banerjee SS, Farnan JM, Arora VM. Development of a handoff evaluation tool for shift-to‐shift physician handoffs: the handoff CEX. J Hosp Med. 2013;8:191–200. https://doi.org/10.1002/jhm.2023.

    Article  PubMed  Google Scholar 

  11. O’Connell B, Hawkins M, Ockerby C. Construct validity and reliability of the single checking administration of medications Scale. Int J Nurs Pract. 2013;19:281–7. https://doi.org/10.1111/ijn.12076.

    Article  PubMed  Google Scholar 

  12. Hwang E, Do J, Shin S. Validation of the Perceived Self-efficacy of Hand-off reporting Korean Version Instrument. Health Nurs. 2017;29:25–33.

    Google Scholar 

  13. Jeoung YO, Bak YI, Sok SH, Lee JW. Tool development to evaluate effective communication in nursing handover. Seoul Natl Univ J Hum. 2015;72:507–42.

    Article  Google Scholar 

  14. Elo S, Kyngäs H. The qualitative content analysis process. J Adv Nurs. 2008;62:107–15. https://doi.org/10.1111/j.1365-2648.2007.04569.x.

    Article  PubMed  Google Scholar 

  15. Polit DF, Beck CT. The content validity index: are you sure you know what’s being reported? Critique and recommendations. Res Nurs Health. 2006;29:489–97. https://doi.org/10.1002/nur.20147.

    Article  PubMed  Google Scholar 

  16. Gorsuch RL. Common factor analysis versus component analysis: some well and little known facts. Multivar Behav Res. 1990;25:33–9. https://doi.org/10.1207/s15327906mbr2501_3.

    Article  CAS  Google Scholar 

  17. Liou SR, Liu HC, Tsai HM, Tsai YH, Lin YC, Chang CH, Cheng CY. The development and psychometric testing of a theory-based instrument to evaluate nurses’ perception of clinical reasoning competence. J Adv Nurs. 2016;72:707–17. https://doi.org/10.1111/jan.12831.

    Article  PubMed  Google Scholar 

  18. Hur GH. Construction and validation of a global interpersonal communication competence scale. KJJCS. 2003;47:380–408.

    Google Scholar 

  19. Floyd FJ, Widaman KF. Factor analysis in the development and refinement of clinical assessment instruments. Psychol Assess. 1995;7:286. https://doi.org/10.1037/1040-3590.7.3.286.

    Article  Google Scholar 

  20. Cizek GJ, Bunch MB. Standard setting: a guide to establishing and evaluating performance standards on tests. CA: Sage; 2007.

    Book  Google Scholar 

  21. Kline RB. Principles and practice of structural equation modeling. New York: Guilford; 2015.

    Google Scholar 

  22. Fornell C, Larcker DF. Evaluating structural equation models with unobservable variables and measurement error. J Mark Res. 1981;18:39–50.

    Article  Google Scholar 

  23. Woo JP. Structural equation model concept and understanding. Seoul: Hannarae Academy; 2012.

    Google Scholar 

  24. Kim S, Kim EM, Choi YK, Lee HY, Park MM, Cho EY, Kim ES. An exploration about current nursing handover practice in Korean hospitals. J Korean Clin Nurs Res. 2013;19:181–94. https://doi.org/10.22650/JKCNR.2013.19.2.181.

    Article  CAS  Google Scholar 

  25. Cho YS, Kwon SJ, Yun MY, Lee MH, An SH, Kong YJ. Development and evaluation of a nursing handoff protocol for Intensive Care Units. J Korean Crit Care Nurs. 2016;9:1–12.

    Google Scholar 

  26. Jeoung Y, Sok S, Bak Y, Park S, Jin J, Baek SJ, Lee HY, Lee JU, Park SY, Lee J. The handoff communication experience of nurses-focused on content analysis. Korean J Health Commun. 2014;9:61–71.

    Google Scholar 

  27. Malfait S, Eeckloo K, Van Biesen W, Deryckere M, Lust E, Van Hecke A. Compliance with a structured bedside handover protocol: an observational, multicentred study. Intern J Nurs Stud. 2018;84:12–8. https://doi.org/10.1016/j.ijnurstu.2018.04.011.

    Article  CAS  Google Scholar 

  28. Riesenberg LA, Leisch J, Cunningham JM. Nursing handoffs: a systematic review of the literature. Am J Nurs. 2010;110:24–34. https://doi.org/10.1097/01.NAJ.0000370154.79857.09.

    Article  PubMed  Google Scholar 

  29. Birmingham P, Buffum MD, Blegen MA, Lyndon A. Handoffs and patient safety: grasping the story and painting a full picture. West J Nurs Res. 2015;37:1458–78. https://doi.org/10.1177/0193945914539052.

    Article  PubMed  Google Scholar 

  30. Lockwood C. What is the best nursing handover style to ensure continuity of information for hospital patients? Intern J Nurs Stud. 2016;100:97–9. https://doi.org/10.1016/j.ijnurstu.2016.03.004.

    Article  Google Scholar 

  31. Shahid S, Thomas S. Situation, background, assessment, recommendation (SBAR) communication tool for handoff in health care–a narrative review. Saf Health. 2018;4:1–9. https://doi.org/10.1186/s40886-018-0073-1.

    Article  Google Scholar 

  32. Kim KJ. The influences of workplace violence and bystander type on handover error of nurses caring for adult patients. Korean J Adult Nurs. 2020;32:642–52. https://doi.org/10.7475/KJAN.2020.32.6.642.

    Article  Google Scholar 

  33. Kim SY, Kim HS. Effects of the SBAR training program in essential fundamental nursing skills on communication competence, critical thinking disposition and problem-solving ability of nursing students. JLCCI. 2020;20:1071–86. https://doi.org/10.22251/jlcci.2020.20.2.1071.

    Article  Google Scholar 

  34. Lee D, Park J. A review for Concept Clarification of critical thinking, clinical reasoning, and Clinical Judgment in nursing education. J Korean Acad Soc Nurs Educ. 2019;25:378–87. https://doi.org/10.5977/jkasne.2019.25.3.378.

    Article  Google Scholar 

  35. Pun J, Chan EA, Eggins S, Slade D. Training in communication and interaction during shift-to-shift nursing handovers in a bilingual hospital: a case study. Nur Educ Today. 2020;84:104212. https://doi.org/10.1016/j.nedt.2019.104212.

    Article  Google Scholar 

  36. Yeom EY, Seo K. Influences of interpersonal problems and character of nurses on quality of nursing service. J Korean Acad Nurs Adm. 2018;24:445–54. https://doi.org/10.11111/jkana.2018.24.5.445.

    Article  Google Scholar 

  37. Slade D, Pun J, Murray KA, Eggins S. Benefits of health care communication training for nurses conducting bedside handovers: an Australian hospital case study. J Contin Educ Nurs. 2018;49:329336. https://doi.org/10.3928/00220124-20180613-09.

    Article  Google Scholar 

  38. Lee K, Shin S. Validity of instrument development research in Korean nursing research. J Korean Acad Nurs. 2013;43(6):697–703.

    Article  PubMed  Google Scholar 

Download references

Acknowledgements

Not applicable.

Funding

This research did not receive any specific grant from funding agencies in the public, commercial, or not-for-profit sectors.

Author information

Authors and Affiliations

Authors

Contributions

J.Do: Conceptualization, Methodology, Validation, Investigation, Formal analysis, Data Curation, Writing - Original Draft; S. Shin: Conceptualization, Methodology, Validation, Writing - Review & Editing, Supervision.

Corresponding author

Correspondence to Sujin Shin.

Ethics declarations

Ethics approval and consent to participate

Ethical approval for this study was obtained from the institutional review board of Ewha Womans Univeristy (Approval no. ewha-202105-0028-02). Informed consent was obtained from all participants in the online survey by presenting a consent form. All methods were performed in accordance with the relevant guidelines and regulations.

Consent for publication

Not applicable.

Competing interests

The authors declare no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Electronic supplementary material

Below is the link to the electronic supplementary material.

Supplementary Material 1

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Do, J., Shin, S. Development of nursing handoff competency scale: a methodological study. BMC Nurs 23, 272 (2024). https://doi.org/10.1186/s12912-024-01925-w

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12912-024-01925-w

Keywords