Skip to main content
Download PDF

Development and validation of the Nurse Team Resilience Scale (NTRS) in the context of public health emergencies

BMC Nursing volume 22, Article number: 489 (2023) Cite this article

Abstract

Background

Team resilience can help nurse to respond positively to adversity at work and maintain normal team function in complex and unstable environments. However, much less research attention has been paid to team resilience than to individual resilience, and nurses lack reliable and valid tools to measure team resilience. This study aimed to develop and evaluate the psychometric properties of a scale that measures the nursing team resilience in the context of a public health emergency.

Methods

The study was conducted in three stages that item development, scale development, and scale evaluation. This scale was based on that of Morgan and Sharma et al. proposed four-factor team resilience model, and the draft scale was generated based on the literature review, existing scales, experts’ validations, and cognitive interviews. During July 2022 to August 2022, the construct validity and the internal consistency reliability of the NTRS were evaluated through an online survey of 421 nurses.

Results

The 8-item NTRS scale has good reliability and validity and is suitable for measuring the nurse team resilience. The EFA found a common factor solution and explained 72.33% of the common varianc and the CFA score showed construct validity. Reliability of the internal consistency of the scale with a good Cronbach alpha of 0.94.

Conclusion

This scale can assess team resilience in nurses that nursing education and management resources can be allocated to improve policies and training programs to provide effective positive support to nurses in challenging workplace situations and to enable greater health systems resilience in the future.

Peer Review reports

Background

In times of global development and change, emergencies and adverse events may be inevitable, such as accidents, emergencies, high work demands, and so on. These events not only take a toll on employees mentally and physically, but can also negatively impact employee and team performance [1]. Various studies have shown that team resilience is an essential protective factor for both team and employee that can help both sides cope with challenging situations positively and maintain normal team function in this volatility, uncertainty, complexity, and ambiguity environment [2]. It is reported by the World Health Organization [3] that the nursing team is a vital part of the healthcare system that accounts for 59% of health professionals. It is essential to know about the level of team resilience for nurses which has an impact on patient safety and even the operation of the medical system [4, 5]. But less attention has been paid to team resilience than to individual resilience, and there is a lack of relevant measurement instruments for team resilience in nurse teams. Hence, it is crucial to develop a reliable scale to test the resilience of nurses team.

The concept of team resilience is diverse and lacks consensus. Team resilience is known to be defined as the ability to help a team recover from failure, setback, conflict, or other threats to team well-being, as suggested by West et al. [6]. Besides Morgan et al. [7] describe it as a dynamic psychosocial process that protects a group of individuals from the potential negative effects of the stressors they experience together and highlights the dynamic properties of team resilience. Many researchers have developed measurement instruments for team resilience in the context of corporates and elite sports based on the above definitions [8,9,10,11,12,13], and only one scale is developed for the background of crisis rescue [14]. Rare scales on team resilience are developed for nursing staff. On the other hand, the extensive literature shows that there is a lack of brief assessment tool to measure team resilience while most of the existing scales have more than 30 items [10, 11, 14]. It is crucial to have a brief and easy-use instrument that served as a screening tool for improving team resilience.

Public health emergencies are regarded as major threats to the health system, including terrorist attacks, infectious disease epidemics, and natural disasters. In public health emergencies, the nursing staff is an essential response team, a robust nursing workforce is needed necessarily for hospitals to cope with public health emergencies [15, 16]. A studies in China showed that the moderate level of nurses were 63.77 ± 12.80 [17]. Studies in Iran and Lebanon show that the moderate level of nurses during the COVID-19 period were 63.8 ± 16.2 and 72 ± 13.5 respectively [18, 19]. An Australian study showed that operating room nurses have higher mean resilience levels were 75.90 ± 11.00 [20]. A study in the United States showed that U.S. Air Force registered nurses have higher mean resilience levels were 77.00 ± 12.03 [21]. Most nurses measure resilience using the Connor Davidson Resilience Scale, however, it is able to distinguish resilient individuals from non-resilient individuals [22]. Consider that nurses have different levels of individual resilience in different scenarios and events. Therefore, a team resilience scale is required to help nursing teams respond positively to workplace adversity, thereby serving as a starting point for improving team resilience and helping organizations develop strategies that may improve team efficiency and stability. To our knowledge, there is currently no team resilience scale applicable to the nursing field.

The purpose of this study was to develop the Nurse Team Resilience Scale (NTRS) based on the four-factor team resilience model by using previous scales, literature review, expert validation, and cognitive interviews, and to evaluate the psychometric properties of the scale.

Methods

Phases and Procedure

This methodological study was conducted in three phases [23,24,25]: (i) item development: the development of the NTRS through literature, existing scales, and group discussion; and content validation, by use of two-round expert consultation; (ii) development of the scales: pretest with cognitive interviews; and (iii) scale evaluation: psychometric testing of the scale by testing construct validity, criterion validity, and reliability (Fig. 1).

Fig. 1
figure 1

Overview of the three phases of scale development and validation

Full size image

Phase 1: Item Development

Identification of the Domain

After reviewing the literature, the framework proposed by Morgan et al. [23] is one of the most extensive theories for developing the scale of team resilience, which is comprised of four dimensions: team structure, approaches to dominance, social capital, and team effectiveness. Group structure means the rules for the formation of group norms and group roles, which consist of three structural characteristics: task design and composition, as well as group norms [10, 26]. Mastery approaches reflect how team members overcome difficulties and recover from adversity through their attitude and behavior [27, 28]. Social capital represents high-quality interaction and care relationships inside the team [29, 30]. Collective effectiveness reflects the team’s collective belief in its ability to get the job done [31].

Item generation

Searches were performed with keywords: ‘resilien*’ and ‘team’ in Pubmed, Web of Science, Scopus, CINAHL, PsycINFO, Business Source Complete, ProQuest Dissertations, CNKI, Wanfang Database, and VIP Database. Several scales [8, 10, 14] to measure team resilience were selected based on a literature review. Additionally, experts in mental health and nursing management were participated to help identify relevant issues and an initial set of items was selected to measure team resilience through focus group discussions. After developed, discussed, and refined possible designs, and then carefully selected 16 designs from the existing scale (Table 1). The questionnaire was evaluated using a 5-point Likert scale (from “strongly disagree” to “strongly agree”) [25].

Table 1 Initial development of the instrument
Full size table

Content validity

Content validity was used to identify whether the scale items adequately covered all aspects of the construct being measured [32]. Expert consultation is a suitable technique for evaluating the content validity of research instruments, which can convert individual viewpoints into consensus. Thus, we conducted double expert consultation to to assess the validity of the content of the initial NTRS. Nine experts were invited to take part in the consultation who had various clinical backgrounds and research fields that were closely related to team resilience, such as nursing psychology, nursing management, emergency nursing, and so on. Besides all experts were advanced professionals with graduate degrees. The experts’ detailed information is described in Table S1. The relevance, appropriateness, exhaustiveness, and disagreements of the items were consulted by mail. The experts were asked to evaluate whether each item is related to team resilience as well as to make ideas for components of NTRS with a 4 point Likert scale that ranged from “irrelevant” to “very relevant”. The scale-content validity index (S-CVI) and item-content validity index (I-CVI) were used to evaluated the degree of expert agreement [24]. In consideration of the number of experts, it is recommended in the literature that a minimum for the S-CVI and I-CVI were set at 0.90 and 0.78 [33].

Phase 2: Scale Development

Pre-testing

To identify ambiguities and linguistic issues from the perspective of the target population, a two-round cognitive interview in Chinese with 11 nurses was conducted as a pre-test through video chat using Tencent Meeting which offered a reliable online conferencing service. We adopted the maximum difference method and selected nurses for interviews with different educational levels, work experience, workplaces, and professional titles. Demographic characteristics were shown in Table S1. Participants were first asked to fill out a questionnaire at Wen Juan Xing (online survey tool, https://www.wjx.cn), which was used as a both data collector and timer. And then we adopted the thinking-aloud method to discover whether the participants understood the meaning of the questionnaire [34]. At the same time, the interviewer documented the comments. Based on the results, we corrected items that were too difficult and too abstract for the interviewees to understand. Then the second round was conducted, and no further revisions were made based on its positive feedback.

Phase 3: Scale Evaluation

Participants and sample size

A descriptive cross-sectional design was used in this stage. The study subject was comprised of nurses from a hospital in Shanghai collected as the study population by convenience sampling method. Participants who met the following criteria were included: (i) A nurse licensed to practice; (ii) working in this hospital for at least 1 year and have experienced or are experiencing a public health emergency event; (iii) agreeing to participate in this study.

The preview study has recommended sample size was 200–300 [23], whereas the required heterogeneous sample size required at least 300 participants as a basic requirement to support the analysis described.

Ethical considerations

All the procedures of this study were in accordance with the Declaration of Helsinki and were approved by the Ethics Committee of the Shanghai Jiao Tong University School of Medicine (NO: SJUPN-202,020). The purpose and procedure of the study is explained to all participants. All of them participated in this study voluntarily and were promised to assure the anonymity of the data. Informed consent was obtained from all study participants after the participants received a written explanation of the study objectives.

Data collection

From July 14, 2022, to August 15, 2022, we used a self-administered online questionnaire through Wen Juan Xing to collect data. The study population completed the questionnaire voluntarily and anonymously.

Assessing validity

The construct validity of items was determined by exploratory factor analysis (EFA) and confirmatory factor analysis (CFA). An EFA was performed to examine factor structure. The Kaiser-Meyer-Olkin (KMO) measure of sample adequacy (≥ 0.80) and the Bartlett’s sphericity test (P < 0.05) indicated the adequacy of factor extraction [24, 35, 36]. In the EFA, the number of extracted factors was determined using a scree plot, eigenvalues greater than 1, and factor weights greater than 0.40 [25, 37]. We then performed a CFA to assess construct validity and confirm factor structure. The goodness of fit index, adjusted goodness of fit index, normed fit index, comparative fit Index values above 0.90, and the root mean squared error of approximation values from 0.08 or less indicates good model fitness [25, 38]. Furthermore, construct validity was performed to test whether the items consistently measure the factors indicating that the extracted mean variance (AVE) is greater than 0.70 and the composite reliability (CR) is greater than 0.50 that the construct validity is good [39, 40].

Assessing reliability

In this study, the reliability of internal consistency was assessed using Cronbach’s alpha coefficients [35]. Cronbach’s alpha ranges from 0 to 1, with Cronbach’s alpha above 0.70 being considered “acceptable” and above 0.80 being “good” [23,24,25, 41].

Statistical analysis

The general characteristics of the participants were examined using descriptive analysis. First, a measurement of the adequacy of the KMO sample selection and Bartlett’s test for sphericity were performed to ensure that the data collected were suitable for factor analysis. Subsequently, EFA and CFA were performed to assess factor structure and construct validity as mentioned above. Finally, Cronbach’s alpha was calculated to assess the internal consistency of the scale items. All analyzes were performed using the IBM Statistical Package for the Social Sciences version 24.0 (IBM Corp: Armonk, New York).

Results

Phase 1: Item Development

The content validity of the 16 items generated was assessed by nine experts in two rounds of correspondence. In the first round, 1 of 16 items (6.25%) scored below 0.78 on the I-CVI (0.67-1.00). The mean S-CVI score was 0.92. Based on the above results, 5 items were eliminated, 3 items combined, 2 items corrected and adjusted to 8 items as shown in Table 2. No I-CVI elements were found after the second round was less than 0.78, and the mean S-CVI score was 0.99, showing very good validity as shown in Table 2. After two rounds of consultation, a first draft of the 8-item questionnaire was developed, as shown in Table S2.

Table 2 Content validity results and suggestions from a two-round expert consultation
Full size table

Phase 2: Scale Development

As a pretest, two-stage cognitive interviews were conducted with 11 nurses to identify ambiguities and language problems from the perspective of the target group. The demographic characteristics are shown in Table S1. The average time to complete the questionnaire was 3.5 min. Participants experienced no discomfort with each question and no recommendations for stair design, length, and placement, nor did they feel uncomfortable with each question. After confirming the results of the cognitive interview, the language problems of 2 items were corrected and the tone of all items was adjusted. The detailed information was displayed in Table S2. Finally, the 8-item questionnaire was developed and there are five possible answers by a 5 point Likert scale (from disagree’=1 to ‘strongly agree’=5). Total scores range from 8–40 and each item scores are 1–5, with higher scores indicating greater nurse team resilience. A total scores greater than 24 indicates that the nurse team has high resilience.

Phase 3: Scale Evaluation

Participant demographics

The sample included 421 nurses, of whom 409 (97.15%) were female, with a mean age of 32.57 years (SD 7.56) and more than half of the nurses were married. The average working experience was 11.10 years (SD 8.60 years). More than 75% of nurses had a bachelor’s degree or above. The detailed demographic characteristics were described in Table S3.

Validity

First, KMO (0.940) and Bartlett’s sphericity test (χ2 = 2818.254 and p < 0.0001) indicate that factor analysis is reasonable [40]. Then the EFA was performed and a common factorial solution was found. Figure S1 shows a screenshot of the characteristic values of the factors extracted in the EFA. The scree plot clearly showed curvature over a factor of 2. Only one factor had an eigenvalue greater than 1 (5.786). The extracted factor explained 72.330% of the common variance. Table 3 shows the factorial loadings of the eight NTRS elements for this single factor. The eight positions were loaded between 0.811 and 0.895 for the single factor extracted, as shown in Table 3. The CFA was then performed on the 8-item NTRS to test its fit to the data. The CFA presented the result as shown in Table 3, and the model shows a relatively good fit. All standardized factor loadings were greater than 0.40 [25, 37], and all paths were statistically significant (p < 0.05). The AVE of each factor was 0.679 and the CR was 0.944, indicating that the construct validity was determined as good.

Table 3 Description statistics and factor loading of 8 Items (n = 421)
Full size table

Reliability

The internal consistency reliability was assessed using Cronbach’s alpha coefficients (Table 3). In this study, the Cronbach’s alpha was 0.944, with values greater than 0.80 being considered “good” [23, 42].

Discussion

This study describes for the development and psychometric assessment of NTRS in the context of a public health emergency. The NTRS was based on that of Morgan and Sharma et al. proposed four-factor team resilience model and was developed using previous scales, the literature review, experts’ validations, and cognitive interviews. An eight items scale with one factor structure was developed and validity and reliability of the NTRS have been validated This sacle has shown a good validity and reliability.

It is shown that the results demonstrated NTRS was a reliable instrument to measure team resilience. There are many benefits and innovations of NTRS. Firstly, although many scales about team resilience have been validated, limited measures have been studied and applied to nursing staff. NTRS is the first specific instrument for nursing staff. According to the literature review, there are only one two scales that have been measured in nurse teams, the Crisis Rescue Team Resilience Questionnaire [14] and the Developing Adaptability and Performance in Teams to Enhance Resilience (ADAPTER) Scale [9]. The former measure has been developed in the context of emergencies for crisis rescue staff and applied it to nurse teams in the context of Covid-19 [43]. The ADAPTER scale is designed for company employees by van der Beek et al. from Netherlands [9] and has been translated into Chinese version to measure team resilience among nurses [13]. Secondly, most of the existing team resilience scale is so complex that has poor practicality. The Hierarchical and Multidimensional Team Resilience Scale (HMTRS) has four primary dimensions and 10 sub-dimensions with a total of 50 items. Although HMTRS has been applied by cancer healthcare professionals in France to evaluate their team resilience, it is too complex and time-consuming to complete in terms of nursing [10]. Besides Resilience at Work Team Scale is the same way [12]. Therefore, in consideration of the time-consuming and costly nature of psychometric research, the length of NTRS wasn’t as same as other scales about team resilience, we have combined similar content and compressed the length of the scale. The NTRS scale comprises eight items is a useful self-report questionnaire for measuring resilience of the nurse team. The score with higher scores indicating greater nurse team resilience. A total scores greater than 24 indicates that the nurse team has high resilience, and a total scores less than or equal to 24 indicates that it is low and needs to be improved. Team leaders can analyze the problems existing in the team’s resilience based on the specific scores of each item, and accurately improve the team’s resilience. Additionally, a team’s resilience is dynamic and can change over time as adversity is overcome, NTRS may help researchers find out the occasion when the nursing team resilience is at the lowest level. But our study hasn’t verified its validation in the longitudinal study, indicating that further study can start from this aspect.

Limitation and strengths

There are some limitations in NTRS development and validation. Firstly, in the scale evaluation process was limited the sample to a single hospital despite the high response rate and the large sample size. Secondly, this scale has not been verified for calibration validity because there is a lack of a gold standard for the evaluation of the resilience of the nurse team. Finally, besides this scale has not been verified its validation in the longitudinal study, indicating that further study can start from this aspect. Further testing of the scale on a wider variety of healthcare professionals in more study sites is important to gain more confidence in the scale’s reliability and validity for international use. Additional, to facilitate the clinical use of this scale, future research should also consider the visual development of the scale.

Although the epidemic has shown the important role of nurses in the healthcare system, we should consider the collective trauma that caregivers have experienced during the pandemic [44]. Thus, nurse team resilience, issues that need to be addressed particularly within global nursing workforce crisis. Developing a good team resilience scale will enable future more resilient in health systems as specific to nurse team in context of public health emergencies setting. The NTRS can assess team resilience in nurses that nursing education and management resources can be allocated to improve policies and training programmes to effectively support nurses. Moreover, this instrument able to help nursing teams respond positively to adversity at work, thereby serving as a starting point for improving team resilience and helping organizations develop strategies that may improve team efficiency and stability.

Conclusions

This study developed a scale with good reliability and validity to measure the resilience of nursing teams. This scale can be used as an assessment tool to identify team resilience and help nursing teams respond positively to adversity at work and improving team resilience, thereby helping organizations develop strategies that may improve team efficiency and stability.

Data availability

The datasets generated and/or analysed during the current study are not publicly available due to its ethical concerns, supporting data cannot be made openly available, but are available from the corresponding author on reasonable request.

References

  1. Hartwig A, Clarke S, Johnson S, Willis S. Workplace team resilience: a systematic review and conceptual development. Organizational Psychol Rev. 2020;10(3–4). https://doi.org/10.1177/2041386620919476. 169–200, Article 2041386620919476.

  2. Ambrose JW, Layne DM, Catchpole K, Evans H, Nemeth LS. A qualitative protocol to examine Resilience Culture in Healthcare teams during COVID-19. Healthc (Basel). 2021;9(9). https://doi.org/10.3390/healthcare9091168.

  3. World Health Organization. State of the world’s nursing 2020: investing in education, jobs and leadership. World Health Organization. 2020.https://apps.who.int/iris/handle/10665/331677.

  4. Lange SJ, Ritchey MD, Goodman AB, Dias T, Twentyman E, Fuld J, Schieve LA, Imperatore G, Benoit SR, Kite-Powell A. Potential indirect effects of the COVID‐19 pandemic on use of emergency departments for acute life‐threatening conditions: United States, January-May 2020. Am J Transplant. 2020;20(9). https://doi.org/10.1111/ajt.16239. 2612 – 1617.

  5. Rigamonti D, Rigamonti KH. Achieving and maintaining safety in Healthcare requires unwavering institutional and individual commitments. Cureus J Med Sci. 2021;13(2). https://doi.org/10.7759/cureus.13192. Article e13192.

  6. West BJ, Patera JL, Carsten MK. Team level positivity: investigating positive psychological capacities and team level outcomes. J Organizational Behav. 2009;30(2):249–67. https://doi.org/10.1002/job.593.

    Article  Google Scholar 

  7. Morgan PBC, Fletcher D, Sarkar M. Defining and characterizing team resilience in elite sport. Psychol Sport Exerc. 2013;14(4):549–59. https://doi.org/10.1016/j.psychsport.2013.01.004.

    Article  Google Scholar 

  8. Blatt R. Resilience in entrepreneurial teams: developing the capacity to pull through. Front Entrepreneurship Res. 2009;29(11):1–14. http://digitalknowledge.babson.edu/fer/vo129/iss11/1.

    Google Scholar 

  9. van der Beek D, Schraagen JM. ADAPTER: Analysing and developing adaptability and performance in teams to enhance resilience. Reliab Eng Syst Saf. 2015;141:33–44. https://doi.org/10.1016/j.ress.2015.03.019.

    Article  Google Scholar 

  10. Sharma S, Sharma SK. Team Resilience: Scale Development and Validation. Vision. 2016;20(1):37–53. https://doi.org/10.1177/0972262916628952.

    Article  Google Scholar 

  11. Decroos S, Lines RLJ, Morgan PBC, Fletcher D, Sarkar M, Fransen K, Boen F, Broek GV. Development and validation of the characteristics of resilience in sports teams inventory [Article]. Sport Exerc Perform Psychol. 2017;6(2):158–78. https://doi.org/10.1037/spy0000089.

    Article  Google Scholar 

  12. McEwen K, Boyd CM. A measure of Team Resilience: developing the resilience at Work Team Scale. J Occup Environ Med. 2018;60(3):258–72. https://doi.org/10.1097/jom.0000000000001223.

    Article  PubMed  Google Scholar 

  13. Wang Z, Liu H, Huang J, Li S, Yan Z, Luan X. Validation of a Chinese version of the Analysing and developing adaptability and performance in teams to Enhance Resilience Scale in nurses in China. J Nurs Manag. 2022;30(5):1324–36. https://doi.org/10.1111/jonm.13628.

    Article  PubMed  Google Scholar 

  14. Liang SH, Shi K, Liu Y, & Gao P. Structure and measurement of resilience of crisis rescue team in China. Chin J UESTC (Social Sci Edition). 2013;15(2):22–7. https://doi.org/10.14071/j.1008-81052013.02.002.

    Article  Google Scholar 

  15. National Academies of Sciences, Engineering, and Medicine; National Academy of Medicine; Committee on the Future of Nursing 2020–2030; Flaubert JL. Le Menestrel S, Williams DR, editors. The Future of Nursing 2020–2030: Charting a Path to Achieve Health Equity. Washington (DC): National Academies Press (US); Nurses in Disaster Preparedness and Public Health Emergency Response. 2021. Available from: https://www.ncbi.nlm.nih.gov/books/NBK573904/.

  16. Norful AA, Tucker S, Miller PS, Roberts H, Kelley MM, Monturo C, O’Mathúna D, Smith J, Zadvinskis IM, Zellefrow C, Chipps E. Nursing perspectives about the critical gaps in public health emergency response during the COVID-19 pandemic. J Nurs Scholarship: Official Publication Sigma Theta Tau Int Honor Soc Nurs. 2023;55(1):22–8. https://doi.org/10.1111/jnu.12795.

    Article  Google Scholar 

  17. Guo YF, Cross W, Plummer V, Lam L, Luo YH, Zhang JP. Exploring resilience in Chinese nurses: a cross-sectional study. J Nurs Adm Manag. 2017;25(3):223–30. https://doi.org/10.1111/jonm.12457.

    Article  Google Scholar 

  18. Parizad N, Soheili A, Powers K, Mohebbi I, Moghbeli G, Hosseingolipour K. Level of resilience in nurses working at COVID-19 referral centers in Iran. Nurs Forum. 2022;57(3):344–51. https://doi.org/10.1111/nuf.12685.

    Article  PubMed  Google Scholar 

  19. Alameddine M, Clinton M, Bou-Karroum K, Richa N, Doumit MAA. Factors Associated with the Resilience of nurses during the COVID-19 pandemic. Worldviews on evidence-based Nursing. 2021;18(6):320–31. https://doi.org/10.1111/wvn.12544.

    Article  PubMed  PubMed Central  Google Scholar 

  20. Gillespie BM, Chaboyer W, Wallis M, Grimbeek P. Resilience in the operating room: developing and testing of a resilience model. J Adv Nurs. 2007;59(4):427–38. https://doi.org/10.1111/j.1365-2648.2007.04340.x.

    Article  PubMed  Google Scholar 

  21. Hernandez SH, Morgan BJ, Parshall MB. Resilience, stress, Stigma, and barriers to Mental Healthcare. Air Force Nursing Personnel Nursing Research. 2016;65(6):481–6. https://doi.org/10.1097/NNR.0000000000000182.

    Article  PubMed  Google Scholar 

  22. Yu F, Raphael D, Mackay L, Smith M, King A. Personal and work-related factors associated with nurse resilience: a systematic review. Int J Nurs Stud. 2019;93:129–40. https://doi.org/10.1016/j.ijnurstu.2019.02.014.

    Article  PubMed  Google Scholar 

  23. Boateng GO, Neilands TB, Frongillo EA, Melgar-Quiñonez HR, Young SL. Best practices for developing and Validating Scales for Health, Social, and behavioral research: a primer. Front Public Health. 2018;6:149. https://doi.org/10.3389/fpubh.2018.00149.

    Article  PubMed  PubMed Central  Google Scholar 

  24. Desmet K, Duprez V, Deproost E, Beeckman D, Goossens PJJ, Vandewalle J, Van Hecke A, Verhaeghe S. The development and psychometric evaluation of the Mental Health nurse-sensitive patient outcome-scale (MH-NURSE-POS) for inpatient psychiatric hospital settings. Int J Ment Health Nurs. 2021;30(4):988–1000. https://doi.org/10.1111/inm.12853.

    Article  PubMed  Google Scholar 

  25. Chua WL, Tee A, Hassan NB, Jones D, Tam WWS, Liaw SY. The development and psychometric evaluation of the clinicians’ attitudes towards responding and escalating care of deteriorating patients scale. Australian Crit care: Official J Confederation Australian Crit Care Nurses. 2021;34(4):340–9. https://doi.org/10.1016/j.aucc.2020.08.008.

    Article  Google Scholar 

  26. Morgan PBC, Fletcher D, Sarkar M. Recent developments in team resilience research in elite sport. Curr Opin Psychol. 2017;16:159–64. https://doi.org/10.1016/j.copsyc.2017.05.013.

    Article  PubMed  Google Scholar 

  27. Dysvik A, Kuvaas B. Exploring the relative and combined influence of mastery-approach goals and work intrinsic motivation on employee turnover intention. Personnel Rev. 2010;39(5):622–38. https://doi.org/10.1108/00483481011064172.

    Article  Google Scholar 

  28. Poortvliet PM, Anseel F, Theuwis F. Mastery-approach and mastery-avoidance goals and their relation with exhaustion and engagement at work: the roles of emotional and instrumental support. Work Stress. 2015;29(2):150–70. https://doi.org/10.1080/02678373.2015.1031856.

    Article  Google Scholar 

  29. Lochner K, Kawachi I, Kennedy BP. Social capital: a guide to its measurement. Health Place. 1999;5(4):259–70. https://doi.org/10.1016/S1353-8292(99)00016-7.

    Article  CAS  PubMed  Google Scholar 

  30. Pitas N, Ehmer C. Social Capital in the response to COVID-19. Am J Health Promotion. 2020;34(8):942–4. https://doi.org/10.1177/0890117120924531.

    Article  Google Scholar 

  31. Tabernero C, Castillo-Mayén R, Luque B, Cuadrado E. Social values, self-and collective efficacy explaining behaviours in coping with Covid-19: self-interested consumption and physical distancing in the first 10 days of confinement in Spain. PLoS ONE. 2020;15(9):e0238682. https://doi.org/10.1371/journal.pone.0238682.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  32. Waltz CF, Strickland OL, Lenz ER. Measurement in nursing and health research. 3rd ed. New York, NY: Springer; 2004.

    Google Scholar 

  33. Polit DF, Beck CT. Nursing research: Generating and assessing evidence for nursing practice. 9th ed. Philadelphia, PA: Wolter Kluwer; 2012.

    Google Scholar 

  34. Drennan J. Cognitive interviewing: verbal data in the design and pretesting of questionnaires. J Adv Nurs. 2003;42(1):57–63. https://doi.org/10.1046/j.1365-2648.2003.02579.x.

    Article  PubMed  Google Scholar 

  35. Kim EY, Yeo JH, Park H, Sin KM, Jones CB. Psychometric evaluation of the environmental reality shock-related issues and concerns instrument for newly graduated nurses. Nurse Educ Today. 2018;61:106–11. https://doi.org/10.1016/j.nedt.2017.11.003.

    Article  PubMed  Google Scholar 

  36. Shrestha N. Factor analysis as a tool for survey analysis. Am J Appl Math Stat. 2021;9(1):4–11. https://doi.org/10.12691/ajams-9-1-2.

    Article  Google Scholar 

  37. Brown TA. Confirmatory factor analysis for applied research. Guilford publications; 2015.

  38. Hair JF, Black WC, Babin BJ, Anderson RE, Tatham RL. Multivariate data analysis. 7th ed. NJ: Prentice hall Upper Saddle River; 2009.

    Google Scholar 

  39. Anderson JC, Gerbing DW. Structural equation modeling in practice: a review and recommended two-step approach. Psychol Bull. 1988;103(3):411.

    Article  Google Scholar 

  40. Schmitt TA. Current methodological considerations in exploratory and confirmatory factor analysis. J Psychoeducational Assess. 2011;29(4):304–21. https://doi.org/10.1177/0734282911406653.

    Article  Google Scholar 

  41. Nunnally J, Bernstein I. Psychometric Theory 3rd edition (MacGraw-Hill, New York). In. 1994.

  42. Leemann L, Martelin T, Koskinen S, Härkänen T, Isola AM. Development and psychometric evaluation of the experiences of social inclusion scale. J Hum Dev Capabilities. 2022;23(3):400–24. https://doi.org/10.1080/19452829.2021.1985440.

    Article  Google Scholar 

  43. Shen HY, Zhou F, Liu WH, Wang HP, Deng L. Relationship between team resilience, social support, and mental health among medical staff against epidemic Diseases: the mediating role of individual resilience. Chin J Clin Psychol. 2020;28(4):747–50. https://doi.org/10.16128/j.cnki.1005-3611.2020.04.020.

    Article  CAS  Google Scholar 

  44. The Lancet. The future of nursing: lessons from a pandemic. Lancet (London England). 2023;401(10388):1545. https://doi.org/10.1016/S0140-6736(23)00958-3.

    Article  CAS  PubMed  Google Scholar 

Download references

Acknowledgements

We thank all the nurses’ participants for the involved and contributed to the procedure of data collection. We thank all the hospitals and managers for their cooperation and assistance.

Funding

This study is supported by the Shanghai Philosophy and Social Science Planning Project (No.2018BGL032), National Natural Science Foundation of China (No.72004137), Shanghai Jiao Tong University school of Medicine: Nursing Development Program, Shanghai Jiao Tong University school of Medicine: Nursing Development Program (SJTUHLXK2021, SJTUHLXK2022), and Innovative Research Team of High-Level Local Universities in Shanghai (SHSMU-ZDCX20212800).

Author information

Author notes

  1. Ya Su, Lin Wang, and Tangyu Chen have the same contribution to this study and are the first authors.

Authors and Affiliations

  1. School of Nursing, Shanghai Jiao Tong University, 227 S Chongqing Rd, Shanghai, 200025, China

    Ya Su, Lin Wang, Tangyu Chen & Liwen Liao

  2. Department of Nursing, Shanghai Jiao Tong University Affiliated Sixth People’s Hospital, 600 Yishan Rd, Xuhui District, Shanghai, China

    SanLian Hu

  3. Renji Hospital, Shanghai Jiao Tong University School of Medicine, No.1630 Dongfang Road, Pudong New District, Shanghai, China

    Yan Yang

Authors
  1. Ya Su
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Lin Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Tangyu Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Liwen Liao
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. SanLian Hu
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Yan Yang
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

Conceptualization: L.W., S.H., and Y.Y.; design of the study, L.W. and Y.S.;data collection, all authors; statistical analysis or interpretation of data: Y.S., and T.C.; first draft preparation, Y.S., and T.C.; manuscript revision Y.S., T.C., L.W., and Y.Y.; resources and supervision, S.H. and Y.Y.; funding acquisition, L.W.; all authors reviewed the manuscript and approved the final version.

Corresponding authors

Correspondence to SanLian Hu or Yan Yang.

Ethics declarations

Conflict of interest

All authors declare no actual or potential conflict of interest.

Ethics approval and consent to participate

All the procedures of this study were in accordance with the Declaration of Helsinki and were approved by the Ethics Committee of the Shanghai Jiao Tong University School of Medicine (NO: SJUPN-202020). The purpose and procedure of the study is explained to all participants. All of them participated in this study voluntarily and were promised to assure the anonymity of the data. Informed consent was obtained from all study participants after the participants received a written explanation of the study objectives.

Competing interests

The authors declare no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Electronic supplementary material

Below is the link to the electronic supplementary material.

Supplementary Material 1

: Table S1. Demographics information about experts and cognitive interview participants. Table S2. Final Development of the Instrument. Table S3. Distribution of demographic characteristics. Figure S1. Scree plot obtained from EFA for the scale.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Su, Y., Wang, L., Chen, T. et al. Development and validation of the Nurse Team Resilience Scale (NTRS) in the context of public health emergencies. BMC Nurs 22, 489 (2023). https://doi.org/10.1186/s12912-023-01627-9

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12912-023-01627-9

Keywords

BMC Nursing

ISSN: 1472-6955

Contact us