- Research article
- Open Access
Development and psychometric assessment of the triage nurses’ professional capability questionnaire in the emergency department
BMC Nursing volume 19, Article number: 82 (2020)
Evaluation of triage nurses’ professional capability is integral to identifying potentials for professional development and nurses’ educational needs, thus, there is a need for valid instruments to assess their professional capability. The present study was conducted to develop and measure the reliability and validity of a triage nurses’ professional capability questionnaire.
This exploratory research was conducted in two stages: in the first stage (the qualitative phase), the concept of professional capability in triage nurses was defined and the items of the questionnaire were developed through conventional content analysis. In the second stage (the quantitative phase), the psychometric properties of the questionnaire were assessed based on analyses of its face validity, content validity, construct validity, internal homogeneity, and consistency.
The initial item pool consisted of 90 items, while the final scale was comprised of 35 items. The S-CVI/Ave of the questionnaire was found to be 0.96.The exploratory factor analysis showed that the factor loading of the items was between 0.46–0.89, all of which were significant, and the three dimensions introduced in the main instrument were verified with acceptable values. The overall intraclass correlation coefficient of the instrument was calculated to be 0.90. The reliability of the instrument was assessed in terms of its internal homogeneity where the Cronbach’s alpha of the whole instrument was found to be 0.89.
The results showed that the questionnaire developed for assessment of triage nurses’ professional capability is sufficiently reliable and valid and can be employed by nurse administrators to evaluate triage nurses’ professional capability.
Today, triage is an integral part of the emergency management in the hospitals in the clinical care systems, and is regarded as an index in evaluations of the emergency . If, upon admittance, a patient is not triaged accurately and does not receive the necessary clinical care, even high-tech units and specialists’ efforts may not prove to be effective in helping the patient’s condition in the following hours or days . The process of triage in the hospitals is unpredictable and complicated . Triage nurses are likely to encounter the patients whose conditions are critical and quickly changing—obviously thus, they should possess the necessary professional capability to assess the patients’ conditions rapidly, determine the clinical priorities accurately, and make the right clinical decision in order to react properly to such quick changes . Lack of the expected professional capability results in the triage nurses’ errors in prioritization of the patients’ needs, which, in turn, results in overcrowding in the triage unit, patients’ dissatisfaction, and in some cases, deterioration of the patients’ conditions . Therefore, the evaluation of the nurses’ professional capability is essential to identify the areas which need to be improved, pinpointing the educational needs, ensuring the provision of optimum care, identifying the strengths and weaknesses of the educational programs, and professional development . An accurate identification of the areas where the nurses need to improve their professional performance and detecting the nurses’ educational needs necessitates an assessment of their professional capability using the valid instruments . Lack of the standardized tests has always been an issue in evaluating the triage in the hospitals . A review and analysis of the results of the studies conducted in the field of professional capability confirms the inadequacy of knowledge with regard to evaluation of the triage nurses’ professional capability, attributing to the fact that the nurses’ experiences and perceptions have not been addressed adequately enough . Professional capability is a broad concept and can be defined variously according to the context, individuals’ characteristics, situation, and perspective . Therefore, a comprehensive definition of the triage nurses’ professional capability, classification of the components of their professional capability, and identification of its indices is the first step toward development of an instrument for evaluation of the triage nurses’ professional capability.
Experts in the development of the psychometric instruments believe that the contents of an instrument must be extracted directly from the target population of the instrument . Accordingly, there is need for a qualitative approach to establish the concept of the professional capability and identify its dimensions and sub-dimensions. Qualitative studies contribute to the development of the clinical questionnaires by clarifying the concepts and providing the definitions and items .
There are not any standard instruments for evaluation of the triage nurses’ professional capability in the emergency departments of the hospitals, and the existing instruments only address the triage nurses’ knowledge. Professional capability is not limited to the professional knowledge and includes a variety of domains. Thus, the present study was performed to develop and assess the psychometric properties of an instrument for evaluation of the triage nurses’ professional capability in order to fill the gap in the current body of theoretical and practical knowledge. In the present study, an integrated research approach is used including a combination of the qualitative and quantitative approaches that can result in a better understanding regarding the subject in question,compensate for the shortcomings of the exclusively qualitative or quantitative approaches, increase the reliability and validity of the study results, and create a new outlook in the sciences . Also, an integrated approach enables the researcher to collect more comprehensive evidence for the research subject and consequently, provide a practical answer to the research question .
On the other hand, as the objective of the present study is the development and assessment of the psychometric properties of an instrument for evaluation of the triage nurses’ professional capability, an exploratory sequential mixed methods design would be the most appropriate method to execute the project. Such a design can enable the researchers to establish a theoretical framework for identifying the dimensions of the complex and multi-dimensional concepts; it can also prove to be useful when the variables are unknown, there is no framework or guiding theory, the researcher aims to extend the findings to different populations, or the objective of research is development of an instrument .
The present study was conducted using an exploratory sequential mixed methods design for development of an instrument . In the qualitative stage of the present study, the conventional content analysis approach (Graneheim & Lundman, 2004) was used to determine the triage nurses’ perceptions of the concept of professional capability, to identify relevant concepts, and to develop the items . In the present study, in addition to using a qualitative approach, the researchers carried out an extensive literature review to further verify the items. The validity of the questionnaire was measured in terms of its face validity, content validity, and construct validity. In the present study COSMIN (COnsensus-based Standards for the selection of health Measurement INstruments) criteria were used for assessing the psychometric properties of a triage nurses’ professional capability questionnaire. COSMIN criteria were used for assessing the psychometric properties of a triage nurses’ professional capability questionnaire. The COSMIN checklist was used for evaluating the methodological quality of the studies conducted on the measurement properties .
Subjects and setting
In the qualitative phase of the study, subjects were selected according to purposeful sampling and the inclusion criteria. Data were collected using the personal interviews, focus interviews, and observation. Accordingly, 24 in-depth, semi-structured interviews were conducted in which, 20 nurses (18 triage nurses and two triage head nurses), two general practitioners, and two emergency medicine specialists were interviewed face-to-face. In addition, two focus interview sessions were held with a group of five triage nurses and the triage unit was observed by the researcher for 48 h. The inclusion criteria for the nursing staff were having a bachelor’s degree in nursing and at least 1 year of professional practice; the emergency doctors were required to be at least a General Practitioner (GP) and have working experience of 6 months in the triage. Both nurses and doctors were included only if they were willing to participate in the study. The exclusion criteria were not being physically or emotionally fit for participation and having mental or cognitive disorders. Each individual interview lasted from approximately 60 to 90 min and each focus group interview lasted from approximately 90 to 120 min. All the interviews were conducted in the conference hall of the hospital. To make sure that the main subjects of the study were discussed during the interviews, the researchers devised and used an interview form: the first section of the form addressed the participants’ demographics and the second part was an interview guide. The guide stated that the participants should share their perspectives on and experiences of capabilities in triage. Explanations were provided if a participant found the concept of capability ambiguous. At the beginning of each interview, after the objective of the study had been explained, a few descriptive questions about the work experience, education, etc. of the respondent were asked. Subsequently, questions related to the subject of the study were asked, e.g. “Based on your experiences, what capabilities should triage nurses possess?”, and “As a triage nurse, have you ever had an experience which made you feel that you possess the necessary capabilities in a triage nurse? In addition, to increase the clarity of the information provided by the participants, the researchers included follow-up questions, e.g. “Can you explain that further? “What do you mean by that?, “Can you give an example or share one of your experiences?”. Overall, 12 observation sessions (48 h) were carried out in the present study. Each session lasted 4 h and all work shifts were included for observation. All the verbal and non-verbal communication of the triage nurses and their manner of interaction with the patients and their companions, their colleagues, and the emergency doctors, as well as their cooperation and participation in teamwork were monitored and recorded exactly as they were. In addition, the researchers observed and recorded the nurses’ manner of triaging and prioritizing patients, level of skill in documenting patients’ health status, measuring and recording patients’ vital signs, quick and accurate evaluation of patients’ conditions, manner of responding to the questions of patients and their companions, and observing work discipline. The researchers also monitored the triage nurses’ capacity for managing the situation and remaining calm at critical times when the triage unit was overcrowded. In the quantitative phase, subjects were selected via convenience sampling. The inclusion criteria for the triage nurses were having a bachelor’s degree in nursing and at least 1 year of professional practice. The exclusion criteria were incomplete answers on the questionnaire and having mental or cognitive disorders. (Table 1) shows the demographics of the participants for qualitative and quantitative phases.
The Institutional Review Board of the researchers’ university has verified that the study complies with research ethics (ethical code: IR.SUMS.REC.1396.S197). Before holding the interviews, the participants were asked to sign an informed consent form if they were willing to participate in the study. The participants were also informed that they were free to withdraw at any point of the research and the time of the interviews would be set by their agreement. For performing the observations in accordance with the ethical considerations, the participants were observed with prior notice and in an overt manner.
Assessment of the face and content validity
Fifteen triage nurses and emergency specialists were interviewed face-to-face and the difficulty level, relevance, and ambiguity were assessed to measure the qualitative face validity of the questionnaire. After the faulty items were revised, the quantitative method of item impact testing was employed to determine the quantitative face validity of the questionnaire and the significance of each item so that, the unsuitable items could be identified and eliminated. Accordingly, 15 experts were asked to score each item on a 5-point Likert scale, and the item impact score of each item was calculated . Content validity was measured both quantitatively and qualitatively. In the qualitative stage, 15 experts (8 triage nurses, 3emergency medicine specialists and 4 specialists in instrument development) who were familiar with the development of the instruments and nursing were asked to evaluate the questionnaire in terms of the syntax, use of proper vocabulary, necessity, significance, placement of the items, and scoring. The Content Validity Ratio (CVR), Content Validity Index (CVI), and Scale-level Content Validity Index (S-CVI/Ave) were used for quantitative assessment of the content validity . Item analysis was performed prior to factor analysis. The object of item analysis was determining the Cronbach’s alpha and initial reliability and identifying the items that have influenced the reliability of the questionnaire. Item analysis is also done to investigate the relationship between the correlation coefficients of the items so that, if an item does not have a correlation coefficient of at least 0.2–0.3 with at least another item, it is eliminated ; also, if the correlation coefficient of an item with another item is above 0.7, either one of them is eliminated or they are merged. Items whose total correlation coefficient score is below 0.3 can be omitted . Most studies have suggested a sample size of 30–50 subjects for item analysis . In the present study, sample size was determined by 40 subjects. An evaluation of the reliability of the questionnaire based on item analysis yielded a Cronbach’s alpha of 0.79.
Assessment of the construct and divergent validity
Construct validity was determined using the factor analysis. The recommended sample size is five to ten subjects per item of an instrument for factor analysis . In the present study, the number of the selected participants was ten times the number of the items of the questionnaire (350 nurses). The construct validity of the questionnaire was measured using the exploratory factor analysis, Kaiser-Meyer- Olkin (KMO) index test, Bartlett’s test of sphericity, analysis of the major indices, and Varimax rotation. The factor loading of every item in the factor matrix and rotation matrix must be at least 0.4 . In the present study, a factor loading of 0.4 was taken as the least acceptable degree of correlation between each item and the extracted factors. Evaluation of the divergent construct validity was conducted not only using the developed triage nurses’ professional capability questionnaire, but also the Liu’s Competency Inventory for the Registered Nurses (2007) . Both questionnaires were distributed simultaneously among 100 triage nurses; subsequently, the correlation between the scores was analyzed.
Assessment of the reliability
In the present study, the data were collected from 350 triage nurses. A Cronbach’s alpha of 0.7–0.8 indicates the satisfactory and adequate internal homogeneity for an instrument . The sample used to determine the consistency of the questionnaire was consisted of 50 triage nurses who completed the questionnaire twice with a 20-day interval. The subjects’ scores obtained from the two tests were compared using the Intraclass Correlation Coefficient (ICC) test. If the ICC index of an instrument is above 0.80, its consistency is considered as satisfactory .
In the first stage of the study, the concept of professional capability in the nurses was defined. According to the data collected from the unstructured and focus interviews with triage nurses and emergency room doctors as well as a review of the literature. Thus, according to the obtained definition, a capable triage nurse should not only possess the clinical competence, but also have psychological capabilities and be committed to his/her professional duties. Initially 85 possible items for the assessment tool were created from the qualitative data. Five further items were then included based on the literature review carried out for the development of the instrument. After several meetings and based on the comments of the experts, certain items were eliminated or merged and the number of the items was reduced to 43 items.
Psychometric properties (COSMIN criteria)
In the face validity assessment, two items were found to have the impact factor score of below 1.5 and therefore, were eliminated thus; the number of the items was reduced to 41.
Qualitative content validity
In the qualitative evaluation of the content validity of the questionnaire, six items were merged and 38 items remained.
Quantitative content validity (content validity index, content validity ratio)
Content validity index (CVI): In the 38 items content validity index was above 0.9, Therefore no further items were deleted.
Content validity ratio (CVR): In the 38 items content validity ratio was above 0.49, Therefore no further items were deleted.
The results of item analysis showed six items to have correlation coefficients of 0.75–0.92, which were merged and eventually, 35 items were kept for factor analysis.
Hypotheses testing for construct validity
The sample size was considered as 5–10 individuals per item in the scale. In the present study, ten subjects per item (350 subjects) were selected for the exploratory analysis of the construct validity of the questionnaire. In the first stage, the adequacy of the sample was tested using the Kaiser-Meyer-Olkin (KMO) method, the value of 0.91 was obtained, which was adequate and very satisfactory. In the next stage, Bartlett’s test of sphericity was used showing whether performing a factor analysis based on the matrix under study is justified and appropriate. The results of the test showed the Chi-Square to have an approximate value of 14,223.013 with a degree of freedom of 595 at p < 0.001. Based on the scree plot, three factors were confirmed for the questionnaire (Fig. 1).
The factor analysis yielded three factors for the triage nurses’ professional capability questionnaire accounting for 59.96% of variance. In the present study, the factors of the questionnaire were established using the exploratory factor analysis with initial eigenvalues of above one and a minimum factor loading of 0.4; in this stage, none of the items was eliminated and all the 35 remaining items were kept. At the end of this stage, the three factors were labeled according to the content of the items. The results of the exploratory factor analysis showed that the factor loading values of the items were between 0.46–0.89, all of which were significant, and the three major dimensions introduced in the main instrument were verified with the acceptable values.
The first factor, labeled as the clinical competence concerns about the professional knowledge, clinical skill, and clinical judgment and is consisted of 20 items (items one through 20). The second factor, labeled as the psychological empowerment concerns about the resiliency, emotional stability, and self-confidence and is consisted of six items (items 21 through 26). The third factor, labeled as the professional commitment concerns about the personal development, adherence to the ethical principles, and interaction and is consisted of nine items (items 27 through 35). (Table 2) shows the factor loading of each dimension after the Varimax rotation.
Divergent construct validity
Analysis of the divergent construct validity showed an insignificant correlation (r = 0.14) between the scores obtained by the triage nurses’ professional capability questionnaire and Liu’s Competency Inventory for the Registered Nurses (2007) indicating that the two questionnaires measure different constructs. Thus, divergent validity was confirmed.
Reliability (internal homogeneity, internal consistency)
The Cronbach’s alpha coefficient was calculated for each of the factors (subscales) and the whole questionnaire with a sample consisting of 350 subjects to determine the internal homogeneity of the questionnaire. A Cronbach’s alpha of above 0.7 was taken as satisfactory. The results showed that the present questionnaire had a Cronbach’s alpha of 0.89 and possessed a very high reliability. The Cronbach’s alpha values of the dimensions of clinical competence, psychological empowerment, and professional commitment were found to be 0.92, 0.87, and 0.89, respectively.
The consistency of the present questionnaire was tested using the test-retest method. The results showed that the ICC of the whole instrument was equal to 0.90, which was significant at p < 0.05. The ICC values of the dimensions of clinical competence, psychological empowerment, and professional commitment were found to be 0.89, 0.88, and 0.93, respectively (Table 3).
In the present study, absolute reliability was measured through a calculation of standard error of measurement (SEM)and standard error of mean (SEM). The results of standard error of measurement (SEM) for the three domains questionnaire were found to be 1.25, 0.65 and 0.89 respectively.
In the present study, in addition to consistency, alternatively called reliability, the researchers measured agreement. Consistency and agreement together constitute repeatability. By definition, agreement is considered to be positive when the minimal detectable change (MDC) or smallest detectable change (SDC) is greater than the minimal important change (MIC). The SDC/MDC values of the three domains questionnaire were found to be 3.45, 1.79 and 2.45 respectively.
Determination of the ease of use of the questionnaire
To measure the ease of use of the questionnaire, the researchers used the mean of time it takes to complete the instrument, which was calculated to be 9 min (in a range of 5 to 13 min). The mean was calculated based on the length of time the participants needed to complete the questionnaire. The rate of “no response” was between 0 and less than 5%.
Determination of the ceiling effect and floor effect of the questionnaire
The ceiling effect and floor effect of the questionnaire were measured with a sample size of 350 subjects. The number of subjects who got the minimum or maximum score in any of the domains and the entire questionnaire did not exceed 15%.
The final version of the triage nurses’ professional capability questionnaire included 35 items. The score range is between 35 and 175. Answers are scored on a 5-point Likert scale, ranging from one (Not important at all) to five (Very important) (Table 4).
The present study was carried out to develop and subsequently evaluate the psychometric properties of a triage nurses’ professional capability questionnaire. The questionnaire addresses a wide range of the triage nurses’ professional capabilities in the three domains of clinical competence (20 items), psychological empowerment (six items), and professional commitment (nine items). An evaluation of the psychometric properties of the questionnaire proved it to possess the satisfactory face, content, and construct validity and reliability for measuring the professional capability in the triage nurses. Initially, the questionnaire consisted of 85 items, which number was later raised to 90 based on the results of the researchers’ review of literature. After several meetings of the research team members and following experts’ comments, similar items were either eliminated or merged and eventually the number of items was reduced to 43. Next, the results of quantitative content validity evaluation showed the impact score of two of the items to be below 1.5 and those items were eliminated. Thus, the number of items fell to 41. In the qualitative content validity evaluation of the questionnaire, 6 items were merged. At this point, 38 items were left. In the item analysis phase, the correlation coefficients of 6 items were between 0.75 and 0.92 and those items were, as the research team members agreed, merged. Ultimately, 35 items made it to the factor analysis phase. Based on the results of factor analysis, 3 factors could determine 59.96% of the variance of the triage nurses’ professional capability questionnaire. In the present study, to determine the factors of the questionnaire, the researchers applied exploratory factor analysis with initial Eigenvalues of above 1 and a minimum factor load of 0.4 for an item to stay. Thus, in this stage, none of the items was eliminated and the 35 items remained in the questionnaire. One of the major indexes of the present questionnaire in the domain of clinical competence is clinical judgment skills. From the participants’ point of view, considering the complicated and unpredictable nature of triage in emergency departments, clinical judgment is an essential skill in triage nurses and has an impact on their diagnosis of patients’ problems and clinical decision-making. In other studies, the questionnaires which evaluate triage nurses’ performance only address their knowledge and, occasionally, clinical skills and do not measure the nurses’ clinical judgment skills. This is one of the strengths of the present questionnaire over similar instruments. Another important index of the present questionnaire in the domain of clinical competence is teamwork skills. According to the participants, work in the triage units of emergency departments is unpredictable and at critical times when there is overcrowding in the units, triage nurses have to deal with a large number of patients. In such circumstances, if triage nurses are not skilled at teamwork, they cannot manage and organize matters properly and, due to anxiety and hastiness, may commit clinical errors. According to Buljac-Samardzic, et al. (2020), teamwork skills as an important component of emergency nurses’ clinical competency . The instruments used in other studies mostly measure triage nurses’ knowledge and the important index of teamwork skills is ignored. One of the strengths of the present questionnaire is that it addresses more indexes. Emotional stability and resilience are another important index of the present questionnaire in the domain of psychological empowerment. The participants’ experiences show that triage nurses need to possess high resilience and emotional stability to be able to cope with difficult and stressful conditions. When patients and their companions enter an emergency department, they are experiencing high levels of tension and may behave aggressively toward triage nurses. Thus, the nurses should enjoy psychological empowerment, including being resilient and emotionally stable, to be able to remain patient, manage their emotions, and provide care in a peaceful and concentrated manner. According to Norouzinia, et al. (2020), emergency nurses must possess resilience and emotional stability so that they can effectively use their abilities and take effective clinical measures in the critical conditions of an emergency. Though such factors as fatigue due to work overload, lack of personnel, and stressful work conditions in emergency departments can adversely affect the performance of the emergency personnel, nurses who are resilient and emotionally stable can manage their emotions and anger . Most studies of triage nurses focus on the knowledge and clinical skills of this group of care givers. However, according to the participants of the present study, in addition to knowledge and clinical skills, triage nurses must possess psychological empowerment. Another important domain of the present questionnaire is professional commitment, one of the major indexes of which, as pointed out by the participants, is observance of the principles of communication. The participants of the present study stated that introducing oneself to the patients and their companions, answering the questions of the patients and their companions patiently and sincerely, and treating the patients and their companions with respect are the core principles of communication. According to Molina-Mula (2020), following the principles of communication is essential to providing care and facilitates the process of nursing. The ability to establish an effective relationship lies at the heart of caring for patients. A review of the questionnaires used in other studies of triage nurses shows that they do not address this aspect of nursing. Thus, one of the strengths of the present questionnaire is that it measures a wide range of triage nurses’ abilities and personal qualities .
Investigating the knowledge and skills of triage nurses in a hospital in South Africa, Phukubye et al. (2019) studied 150 nurses. The results of their study showed that the triage nurses did not possess sufficient knowledge and skill. Phukubye et al. use a researcher-made questionnaire in their study. However, no information is given about the number of the items, the content validity of the questionnaire, or the manner of measuring the reliability of the questionnaire. The content validity of the questionnaire was not measured either, which is another weakness of their study. Also, in developing the items of the questionnaire, the researchers did not consider the experiences and perspectives of triage nurses and only relied on a review of literature. In contrast, 80% of the items of the present questionnaire were developed based on triage nurses’ opinions with a content analysis approach and 20% were based on a review of literature. It is likely that the development of items according to the views of the participants has increased the reliability of the results of determining triage nurses’ professional capability. This is another strength of the present study .
In a similar study, Duko et al. (2019) investigated the knowledge and skill of emergency nurses in triaging patients in a hospital in Ethiopia. They reported the knowledge and skill of the subjects to be low. Duko et al. used a researcher-made questionnaire which comprised of 17 questions on knowledge and 37 questions on skill. The content validity and construct validity of the questionnaire were not measured. The reliability of the questionnaire was verified with a Cronbach’s alpha of 0.91. The questions were designed based on a review of literature and nurses’ views (qualitative approach) were not considered. Moreover, their questionnaire evaluated only the knowledge and skill of the nurses and the other aspects of the professional competence of triage nurses were ignored .. The present questionnaire, however, was developed using a combination of a qualitative approach and a review of literature and the items address a wider range of triage nurses’ professional capabilities. Also, unlike other studies, the present study conducts a thorough assessment of the psychometric properties of the researcher-made questionnaire, which is one of the strengths of the study.
Haghigh et al., (2017) used a researcher-made questionnaire to assess the knowledge of the triage nurses in Iran. The content validity of the questionnaire was verified by 10 nursing professors. A Cronbach’s alpha of 0.70 confirmed the reliability of the questionnaire. The construct validity of the questionnaire was not measured. The questions were designed based on a review of literature and nurses’ views (qualitative approach) were not considered. Moreover, their questionnaire evaluated only the knowledge of the nurses and the other aspects of the professional capability of triage nurses were ignored .
Javadi et al., (2016) employed a researcher-made questionnaire to assess the professional knowledge and performance of the triage nurses in Iran. The questionnaire was consisted of 15 4-point items for measuring the knowledge and 10 4-point items for measuring the performance. The reliability of the instrument was verified with a Cronbach’s alpha of 0.87. The findings showed that triage nurses’ professional knowledge and performance are less than the satisfactory level. The content validity and construct validity of the questionnaire was not measured. The items in this instrument have been developed based on the library research and do not reflect the triage nurses’ perceptions .
Aloyec et al., (2014) employed a researcher-made instrument to assess the professional knowledge and performance of the triage nurses in a hospital in Tanzania. The skills section was consisted of 35 items and the knowledge section was consisted of 30 4-point items. The reliability of the instrument was tested using the test-retest method and was verified with a Cronbach’s alpha of 0.78. The findings showed that the professional knowledge and performance of the triage nurses are unsatisfactory. The content validity and construct validity of the questionnaire was not measured. The questions were designed based on a review of literature and nurses’ views (qualitative approach) were not considered .
Fathoni et al., (2013) used a researcher-made questionnaire to measure the professional knowledge and skills of the nurses in triaging the patients. The skills section was consisted of 37 items and the knowledge section was consisted of 15 items. The content validity of the questionnaire was confirmed by three experts. The reliability of the instrument was tested using the test-retest method and was verified with a Cronbach’s alpha of 0.95.They showed that the knowledge and skills of the triage nurses are unsatisfactory. Moreover, they recommended conducting further researches to develop a standard instrument for evaluation of the triage nurses’ capabilities. The content validity and construct validity of the questionnaire was not measured. Moreover, their questionnaire evaluated only the knowledge and skills of the triage nurses and the other aspects of the professional capability of triage nurses were ignored . In the present study, the items of the questionnaire were developed according to triage nurses’ perspectives and experiences and an extensive review of literature to guarantee the relevance of the items (an inductive-deductive approach). In addition, all the psychometric properties of the designed instrument were tested. Thus, the present instrument more specifically addresses the professional capability of nurses. A reasonable number of items, ease of use, simple questions, and acceptable reliability and validity are the most important features of the present questionnaire which make it very practical.
This questionnaire was developed in an eastern culture and needs to undergo a psychometric assessment and a developed if it is to be used in other culture.
As the hospital triage nurses work in a complicated and unpredictable environment, they are expected to enhance their professional capabilities in this regard, the nurse administrators are expected to conduct regular evaluations of the nurses’ capabilities using the standard instruments. The questionnaire developed in the present study was found to be a valid and reliable instrument for assessment of the various aspects of the triage nurses’ professional capabilities. Thus, the nurse administrators can employ this instrument to measure the triage nurses’ professional capabilities and take measures in order to enhance their professional capabilities by identifying their weaknesses, and, in turn, improving the quality and effectiveness of the triage.
Availability of data and materials
The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.
COnsensus-based Standards for the selection of health Measurement Instruments
Content Validity Index
Content Validity Ratio
- S-CVI /Ave:
Scale-level content validity index/ Average
Intraclass Correlation Coefficient
Minimal Detectable Change
Smallest Detectable Change
Shen Y, Lee LH. Improving the wait time to triage at the emergency department. BMJ Open Quality. 2020;9(1):1–5.
Van der Linden MC, Meester BE, Van der Linden N. Emergency department crowding affects triage processes. Int Emerg Nurs. 2016;19:27–31.
Higginson L, Boyle A. What should we do about crowding in emergency departments? Br J Hosp Med. 2018;79(9):500–5003.
Reay G, MacDonald SL, Then LK, Hall M, Rankin AJ. Triage emergency nurse decision- making: incidental findings from a focus group study. Int Emerg Nurs. 2020;48:1–6.
Bijani M, Torabizadeh C, Rakhshan M, Fararouei M. Professional capability in triage nurses in emergency department: a qualitative study. Revista Latinoamericana de Hipertensión. 2018;13(6):554–60.
Scicluna HA, Grimm MC, O’Sullivan AJ, et al. Clinical capabilities of graduates of an outcomes-based integrated medical program. BMC Med Educ. 2012;12(1):23.
Kapoor R, Sandoval MA, Avendaño L, Cruz AT, Soto MA, Camp EA, et al. Regional scale-up of an emergency triage assessment and treatment (ETAT) training programme from a referral hospital to primary care health centers in Guatemala. BMJ Emerg Med J. 2016;33:601–2.
Brosinski CM, Riddell AJ, Valdez S. Improving triage accuracy: a staff development approach. Clin Nurse Spec. 2017;31(3):145–8.
Robert L, Ferrer MD. Capability and clinical success. Ann J Club Selection. 2010;8:454–60.
O'connell J, Gardner G, Coyer F. Beyond competencies: using a capability framework in developing practice standards for advanced practice nursing. J Adv Nurs. 2014;70(12):2728–35.
Zelt S, Recker J, Schmiedel T, vom Brocke J. Development and validation of an instrument to measure and manage organizational process variety. PLoS One. 2018;13(10):1–25.
Ebrahimi M, Heydari A, Mazlom R, Mirhaghi A. Reliability of the Australasian triage scale: meta-analysis. World J Emerg Med. 2015;6(2):94–5.
Schoonenboom J, Johnson BR. How to construct a mixed methods research design. Kolner Z Soz Sozpsychol. 2017;69(2):107–31.
Hanisko CL, Newman D, Dyess S, Piyakong D, Liehr P. Guidance for using mixed methods design in nursing practice research. Appl Nurs Res. 2016;31:1–5.
Halcomb EJ. Mixed methods research: the issues beyond combining methods. J Clin Nurs. 2018;7(3):499–501.
Creswell JW, Clark VLP. chapter 6. In: Designing and conducting mixed methods research. Sage; 2011. p. 171–203.
Granheim UH, Lundman B. Qualitative content analysis in nursing research: concepts, procedures and measures to achieve trustworthiness. Nurse Educ Today. 2004;24(2):105–12.
Mokkink LB, Terwee CB, Knol DL, Stratford PW, Alonso J, Patrick DL, et al. The COSMIN checklist for evaluating the methodological quality of studies measurement properties: a clarification of its content. BMC Med Res Methodol. 2010;10:22.
Newman I, Lim J, Pineda F. Content validity using a mixed methods approach: its application and development through the use of a table of specifications methodology. J Mixed Methods Res. 2013;7(3):243–60.
Hadian Jazi Z, Peyrovi H, Zareiyan A. Designing and psychometric evaluation of nurses’ social responsibility instrument: a mixed-method study. Iranian J Nurs Midwifery Res. 2020;25:166–74.
Polit DF, Yang F. chapter5. In: Measurement and the measurement or change: a primer for the health professions. Philadelphia: Wolters Kluwer; 2016. p. 5.
Rodrigues IB, Adachi JD, Beattie KA, MacDermid JC. Development and validation of a new tool to measure the facilitators, barriers and preferences to exercise in people with osteoporosis. BMC Musculoskelet Disord. 2017;18:540.
Bolarinwa OA. Principles and methods of validity and reliability testing of questionnaires used in social and health science researches. Nigerian Postgraduate Med J. 2015;22(4):195.
Torabizadeh C, Bahmani T, Molazem Z, Moayedi SA. Development and psychometric evaluation of a professional communication questionnaire for the operating room. Health Commun. 2018;14:1–7.
Watkins MW. Exploratory factor analysis: a guide to best practice. J Black Psychol. 2018;44(3):219–46.
Liu M, Yin L, Ma E, Lo S, Zeng L. Competency Inventory for Registered Nurses in Macao :instrument validation. J Adv Nurs. 2009;65(4):893–900.
Mohammadnejad F, Asadizaker M, Molavynejad S, Saki-Malehi A. Development and psychometric assessment of nursing student’s satisfaction with first clinical practical education questionnaire: modified version. Iran J Nurs Midwifery Res. 2020;25:325–32.
Sattarzadeh-Pashabeig M, Atashzadeh-Shoorideh F, Sadoughi M, et al. Development and validation of the shared governance feasibility instrument in nursing schools in Iran. BMC Nurs. 2020;19(42):2–12.
Buljac-Samardzic M, Doekhie KD, Wijngaarden JDH. Interventions to improve team effectiveness within health care: a systematic review of the past decade. Hum Resour Health. 2020;18(2):1–42.
Norouzinia R, Yarmohammadian MH, Ferdosi M, Masoumi G, Ebadi A. Professional resilience among trauma emergency department nurses in Iran: a qualitative study. Adv J Emerg Med. 2020;4(3):1–9.
Molina-Mula J, Gallo-Estrada J. Impact of nurse-patient relationship on quality care and patient autonomy in decision-making. Int J Environ Res Public Health. 2020;17(3):1–24.
Phukubye TA, Mbombi MO, Mothiba TM. Knowledge and practices of triage amongst nurses working in the emergency departments of rural hospitals in Limpopo Province. The Open Public Health J. 2019;12:439–48.
Duko B, Geja E, Oltaye Z, Belayneh F, Kedir A, Gebire M. Triage knowledge and skills among nurses in emergency units of specialized Hospital in Hawassa, Ethiopia: cross sectional study. BMC Res Notes. 2019;12(1):21.
Haghigh SH, Ashrafizadeh H, Mojaddami F, Kord B. A survey on knowledge level of the nurses about hospital Triage. JNE. 2017;5(6):46–52 Persian.
Javadi S, Salimi T, Taghi M, Ali Dehghani M. Knowledge and Practice of Nurses Regarding Patients’ Triage in Emergency Department. Iranian J Emerg Med. 2016;3(1):15–22 Persian.
Aloyce R, Leshabari S, Brysiewicz P. Assessment of knowledge and skills of triage amongst nurses working in the emergency centres in Dar Es Salaam. Tanzania African J Emerg Med. 2014;4(1):14–8.
Fathoni M, Sangchan H, Songwathana P. Relationships between Triage Knowledge, Training, Working Experiences and Triage Skills among Emergency Nurses in East Java, Indonesia. Nurse Media J Nurs. 2013;1:511–25.
This paper was extracted from a research project with the ethical code (IR.SUMS.REC.1396.S197) in Shiraz University of Medical Sciences, Shiraz, Iran. The authors appreciate Shiraz University of Medical Sciences for financially supporting this research and triage nurses’ who participated in the study.
This research did not receive any specific grant from funding agencies in the public, commercial, or not for profit sectors.
Ethics approval and consent to participate
This article was supported by the Vice Chancellor for Research, Shiraz, University of Medical Sciences, Shiraz, Iran (ethical code: IR.SUMS.REC.1396.S197) and written informed consent was obtained from the participants.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Bijani, M., Rakhshan, M., Fararouei, M. et al. Development and psychometric assessment of the triage nurses’ professional capability questionnaire in the emergency department. BMC Nurs 19, 82 (2020). https://doi.org/10.1186/s12912-020-00476-0
- Psychometric assessment