- Open Access
Psychometric evaluation of medication safety competence scale for clinical nurses
BMC Nursing volume 20, Article number: 165 (2021)
Nurses are the most important members of the health care system for medication safety, there are few tools to evaluate their medication safety competence. This study aimed to translate the Medication Safety Competence Scale into Chinese and validate its reliability and validity among clinical nurses.
A total of 894 clinical nurses were recruited from three cities in China. The original version of the Medication Safety Competence Scale was translated into Chinese using the backward and forward translation procedure. The reliability of the scale was measured by internal consistency, split-half reliability, and stability. The validity of the scale was assessed by the content validity index, exploratory factor analysis and confirmatory factor analysis.
The Cronbach’s coefficient of the scale was 0.940, and the coefficient values for the six domains ranged between 0.843 and 0.948. The split-half reliability and stability were 0.671 and 0.703, respectively. The content validity index of the scale was 0.952. The 6-factor structure, supported by the eigenvalues, total variance explained, and scree plot accounted for 71.485 % of the total variance. Moreover, as a result of the confirmatory factor analysis, the average variance extracted values were 0.55 to 0.70, and the model fitting indexes were all in the acceptable range.
The Chinese version of the Medication Safety Competence Scale had ideal reliability and validity among clinical nurses. The evaluation results of the scale can provide a reference for nursing managers to formulate education plans and intervention measures to improve clinical nurses’ safe medication competence.
Medication is the largest area in the course of treatment, and it is also the area with the most medical errors. The World Health Organization (WHO) reported that medication errors, as a preventable event, account for 20 % of medical errors and launched global effort to halve medication-related errors in 5 years . Adverse medication safety events may occur in the links of medical advice, nursing medication and patient health education [2, 3]. The investigation showed that drug use errors in medication errors accounted for 50.0 %, followed by drug configuration errors accounted for 18.0 % . Moreover, according to the practice for medication safety issued by the Federal University of Sao Paulo, medication errors or adverse events account for 7.0 % of hospitalizations in the health system, and at least 44,000 to 98,000 deaths per year are caused by medication errors in the United States, which cost 17 billion to 29 billion dollars . Medication safety has become a key topic of global concern.
Medication safety is defined as the protection from accidental injury and the avoidance of any preventable and adverse events during drug use, realising the maximum therapeutic effect and producing the minimum adverse reactions . Meanwhile, it puts forward the operational concept for establishing medication safety through effective assessment, accurate medication selection and use in the right method, dose and time, paying attention to drug contraindications, adverse reactions, interactions, etc., to achieve the purpose of safety, rationality, effectiveness and economy [7, 8]. The purpose of safe medication is to take patients as the center, provide comprehensive medication service for patients, ensure the rationality of medication and improve the health level of patients . Nurses are recognized as the most important group for clinical medication safety globally [10, 11]. In addition, medication safety is an important part of patient safety [12, 13]. Therefore, we should focus on nurses’ positive role in patient safety and medication safety competence under the high prevalence of medication errors.
Medication safety education programs have been developed and implemented among nursing students [14,15,16,17]. However, there are few studies on nurses’ medication safety competence in clinical nursing practice, and relevant measurement tools have not been developed in China. Based on the eight stages of scale development and verification , Korean scholar Seomun recently combined patient safety with clinical medication nursing in the development of the Medication Safety Competence Scale (MSCS) for nurses in July 2020 . The development of the MSCS has arisen out of this need to assess nurses’ competence on the relevant knowledge, skills, and attitudes for medication safety that can contribute to clinical practice, research, and education. In addition, the scale supported by a six-factor structure provides a comprehensive and effective assessment of medication safety competence from multiple levels and perspectives, which makes up for the deficiency of a single dimensional measurement tool. This study aimed to translate the MSCS into Chinese and validate its reliability and validity among clinical nurses in the context of the high prevalence of medication errors.
Study design and participants
The design of this study was a methodological approach to translate the Medication Safety Competence Scale and to evaluate its psychometric properties with a multicentric cross-sectional survey from March 2021 to May 2021. The sample size was determined using the general rule for factor analytic procedure that requires a minimum of 10 respondents per item , but a larger sample is desirable. In this study, 20 respondents per item were required to ensure the accuracy of exploratory factor analysis and confirmatory factor analysis. Participants were recruited by convenience sampling with the assistance of nursing directors from different hospitals. A total of 894 nurses involved in clinical nursing practice were included in the study.
General Demographic Characteristics Questionnaire
A thorough literature review was conducted, after which the team designed the General Demographic Characteristics Questionnaire. Participants were required to complete the questionnaire consisting of six items by self-reporting: age, gender, educational level, marital status, site, and professional experience.
Medication Safety Competence Scale
Medication safety competence was measured through the Medication Safety Competence Scale developed by Seomun . The scale includes thirty-six items measured on a Likert scale from 1 to 5, corresponding to (1) definitely no, (2) rather no, (3) hard to say, (4) rather yes, and (5) definitely yes. Six domains were evaluated: medication management and patient assessment, improvement of safety problems in the medication process, management of effecting factors, management of safety risks, multidisciplinary collaboration, and responsibility as a professional nurse. The Cronbach’s α coefficient of the scale was 0.96, with those of domains ranging from 0.77 to 0.91.
Scale translation procedure
Our translation work has obtained professor Seomun’s permission. First, the Medication Safety Competence Scale was translated into Chinese by two Chinese professors majoring in English language. Then, two Chinese teachers who are native English speakers did the reverse translation. Psychological experts made further adjustments for the translated scale. A preliminary survey using the translated scale was conducted with 12 nurses to verify the clarity and understanding of the scale.
Data collection procedure
After receiving appropriate training, researchers went to three cities respectively and recruited participates with the assistance of nursing directors. According to the pre-investigation, we were able to contact about 1200 nurses from the three same-level hospitals in the three cities of Northeast China during the study period. 1042 eligible nurses were invited to participate in the cross-sectional survey through convenience sampling, of which 955 agreed to participate. The participants were placed in a quiet classroom to fill out questionnaires anonymously. A total of 894 completed questionnaires were eventually obtained after the removal of invalid ones (Fig. 1).
Statistical analysis was performed using the SPSS software (v. 22.0) and AMOS (v. 21.0). Continuous data were described as mean (standard deviation), categorical data were expressed as percentages. Mardia’s Skewness & Kurtosis tests were used to determine whether the data have a multivariate normal distribution. When the results of skewness and kurtosis tests are significant (P > 0.05) and the standardized multivar -iate kurtosis coefficient is less than 5, the data can be considered to have a multivari -ate normal distribution .
For items analysis, the total score of the translated scale was ranked from high to poor, and the relationship between the first 27 % (high-score group) and the last 27 % (poor-score group) was analyzed to judge whether the translated scale has an ideal discrimination ability. The correlation between items and the translated scale and the Cronbach’s α coefficient if item deleted were analysed to evaluate whether each item of the translated scale can be retained.
Seven experts were invited to evaluate the content validity of the translated scale using the Delphi method. The content validity index of the items (I-CVI) and the content validity index of the scale (S-CVI) were calculated using the Lawshe’s evaluation method. According to the correlation between each item and the theme, each item was given four ratings of “no correlation” (0 point), “somewhat correlated” (0 point), “quite correlated” (1 point), and “high correlation” (1 point). I-CVI is the ratio of the number of experts who ranked each item with 1 point to the total number of experts. S-CVI is the mean of I-CVI for all items.
To explore and validate the underlying factor structure of the translated scale, an exploratory factor analysis (EFA) and a confirmatory factor analysis (CFA) were performed. The sample of 894 cases was randomly subdivided into two groups, one (n = 447) for EFA and the other (n = 447) for CFA. Kaiser-Meyer-Olkin (KMO) measurement and Bartlett test of sphericity were used to judge the rationality of using principal component analysis (PCA) with varimax rotation in EFA. Varimax rotation is the most commonly used orthogonal technique that minimizes factor complexity with a maximized variance of factor loading. Only when the Bartlett test of sphericity was significant (P < 0.05) and the KMO was > 0.60, the dataset was considered appropriate for PCA. The factors were extracted based on the comprehensive consideration of eigenvalues, explained total variance, and the visual inspection of the scree plot. Analysis of Moment Structure (AMOS) was used to confirm the hypothesized factor model in CFA. Convergent validity and discriminant validity were also analyzed for assessing construct validity among item measures.
The Cronbach’s α coefficients of the translated scale and its dimensions were calculated to assess the internal consistency reliability. The items were divided according to the order of oddness and evenness, the split-half reliability was evaluated by testing the correlation between divided items. Two weeks later, the translated scale was used to assess its stability among 70 nurses. Test-retest correlation analysis was performed to assess the stability and consistency of the scale across the entire period of time during which data were collected. The Intraclass Correlation Coefficient (ICC) was calculated to assess intra- and interrater reliability of the scale.
All participants were informed of the objectives and the scope of the study and provided their informed consent for participation. All procedures were performed according to the Helsinki declaration of 1964 and its further modifications. The study protocol was approved by the Ethics Committee of the Jinzhou Medical University (LLSC2021213).
This study included 894 nurses: 233 males (24.9 %) and 671 females (75.1 %). Participants aged 25 to 34 years accounted for 51.8 %. More than half (61.1 %) of the participants were married; 45.7 % of the participants had an undergraduate education. The proportion of participants who came from Jinzhou city was the largest (36.7 %); for the years of professional experience, 35.0 % of participants have been in clinical care for 6 to10 years. The data have a multivariate normal distribution according to the result of Mardia’s Skewness & Kurtosis tests (P > 0.05 and standardized multivaria -te kurtosis coefficient is 3.946). Other sociodemographic informations are shown in Table 1.
The critical ratio > 3.000 indicated the higher discriminability of items. In this study, the critical ratio of 36 items were 9.818 to 26.010, which indicating that the discrimination ability of each item was good. The scores of each item were positively correlated with the total score (r = 0.434 to 0.722, P < 0.001), indicated that each item was moderately correlated with the scale. After deleting each item, the Cronbach’s α coefficients value of the translated scale were 0.936 to 0.939, which does not exceed Cronbach’s α value of the scale, indicating that the 36 items could be retained. (Table 2)
Content validity analysis
Seven experts independently were invited to evaluate the content validity of the translated scale. The I-CVI and S-CVI of the translated scale were calculated by using the Lawshe’s evaluation method. The results showed that the I-CVIs obtained were 0.857 to 1.000 and the S-CVI was 0.952.
Exploratory factor analysis
The Kaiser-Meyer-Olkin Measure of Sampling Adequacy was 0.853, and the Bartlett test of sphericity was significant (χ2 = 32217.515; P < 0.001). Therefore, the matrix is not an identity matrix and is appropriate for factor extraction. As a result, 6 factors that explained a total of 71.485 % of the variance had initial eigenvalues > 1 each. The 6-factor structure was further confirmed by the scree plot, as the descending tendency became weak after the sixth point (Fig. 2). After varimax rotation, the six factors explained 6.350 %, 8.495 %, 10.499 %, 12.161 %, 15.928 %, and 18.052 % of the variance. The factor loadings are displayed in Table 3.
Confirmatory factor analysis
The results of confirmatory factor analysis are shown in Fig. 3. According to the modification indices (MI), the initial model was modified in consecutive steps: e3 and e7, e7 and e14, e10 and e15, e12 and e17, e19 and e22, e19 and e23, e25 and e29, respectively. In the final model fitness index (original model fitness index), the chi-square degree of freedom (χ2/df) was 2.939 (5.568), the goodness-of-fit index (GFI) was 0.915 (0.774), the adjusted goodness-of-fit index (AGFI) was 0.901 (0.708), the root mean square error of approximation (RMSEA) was 0.047 (0.084), the tucker lewis index (TLI) was 0.962 (0.795), the comparative fit index (CFI) was 0.969 (0.821), the incremental fit index (IFI) was 0.969 (0.821), the parsimonious goodness-of-fit index (PGFI) was 0.704 (0.612), and the parsimonious normed-of-fit index (PNFI) was 0.775 (0.717). The results of correlation analysis between factors are shown in Table 4. The construct reliability (CR) ranged between 0.87 and 0.94, and the average variance extracted (AVE) values were 0.51–0.77. The correlation between factors ranged from 0.141 to 0.378.
The Cronbach’s α coefficient of the translated scale was 0.940, the Cronbach’s α coefficients of the dimensions ranged from 0.843 to 0.948. The split-half reliability was 0.671. After two weeks, 70 nurses were randomly selected for retesting, the test-retest reliability was 0.703 and the ICC was 0.688 (Table 5).
The Chinese version of the scale has the suitable distinction
The Chinese version of the Medication Safety Competence Scale was obtained in accordance with Chinese guidelines and common expressions. The preliminary survey and the main survey showed that the translated scale was clear and easy to understand. Furthermore, the critical ratio of the items is much better than the standard value . The score of each item was positively correlated with the total score of the scale. The Cronbach’s α coefficient did not exceed the original value of the translated scale after deleting each item, suggesting that all the 36 items should be retained.
The Chinese version of the scale has suitable validity
Validity refers to the extent to which the measured tool accurately corresponds to the real world . We evaluated the validity of the scale by content and structure analyses. The Delphi method showed that I-CVI and S-CVI were higher than the reference values . It is generally believed that the ideal structure validity can be achieved by two different ways: (1) the factors extracted by exploratory analysis explain 40.00 % or more of the total variation; (2) each item has a high load value of a single factor (> 0.400) and low values of the other factors. In this study, the six factors equivalent to the domains of the scale were extracted by exploratory factor analysis and explained 71.485 % of the total data variation. Moreover, the CFA results confirmed the measurement validity of the translated scale . The construct reliability ranged between 0.87 and 0.94, which was higher than the reference value of 0.70, demonstrating convergent validity . Discriminant validity was also demonstrated because the squares of correlation coefficients between latent variables were smaller than the average variance extracted values . Overall, the Chinese version of the scale showed optimal validity among clinical nurses.
The Chinese version of the scale has the suitable reliability
Reliability analysis reflects the fact that a scale should consistently reflect the construct it is measuring . We evaluated the reliability of the Chinese version of the scale for three aspects: internal consistency reliability, split-half reliability, and stability. The results showed that the Cronbach’s α coefficient of the translated scale was higher than the original version , while the stability of the translated scale was found to be at a very favorable level. Overall, the Chinese version of the scale showed optimal reliability among clinical nurses.
There are some limitations to this study, which should be noted and discussed. First, we did not investigate factors influencing the medication safety competence among clinical nurses, which will be of importance for our future studies. Additionally, self-reporting data contain several potential sources of bias that should be taken into account. Finally, principal component analysis (CFA) was used to extract the common factors in this study, and the results may be overestimated.
The English version of the Medication Safety Competence Scale has sound psychometric properties and has been successfully introduced into China. The scale will contribute to clinical practice by providing evidence to guide education of nurses in medication safety.
Most medication errors are committed by nurses. To solve this problem, it is of great significance for nursing managers to conduct the comprehensive and effective assessment for clinical nurses’ medication safety competence. The developed scale will evaluate the medication safety competence of Chinese clinical nurses, providing an opportunity for development of targeted educational plans.
Availability of data and materials
The data garnered during the current study and the final dataset used for statistical analysis are available from the corresponding author on reasonable request. The Chinese version of the Medication Safety Competence Scale are available from the corresponding author on reasonable request.
WHO. WHO launches global effort to halve medication-related errors in 5 years. March 29, 2017. http://www.who.int/mediacentre/news/releases/2017/medication-related-errors/en/ (accessed 10 Apr 2017).
Tinkler L, Smith V, Yiannakou Y, Robinson L. Professional identity and the Clinical Research Nurse: A qualitative study exploring issues having an impact on participant recruitment in research. J Adv Nurs. 2018;74(2):318–28. https://doi.org/10.1111/jan.13409.
Bennie M, Kurdi A, MacBride-Stewart S, Avery T. Medication safety in primary care-from measurement to action. Drug Ther Bull. 2021;59(2):24–8. https://doi.org/10.1136/dtb.2020.000010.
Cousins DH, Gerrett D, Warner B. A review of medication incidents reported to the National Reporting and Learning System in England and Wales over 6 years (2005–2010). Br J Clin Pharmacol. 2012;74(4):597–604. https://doi.org/10.1111/j.1365-2125.2011.04166.x.
Mendes JR, Lopes MCBT, Vancini-Campanharo CR, Okuno MFP, Batista REA. Types and frequency of errors in the preparation and administration of drugs. Einstein (Sao Paulo). 2018;16(3):eAO4146. doi:https://doi.org/10.1590/S1679-45082018AO4146
Bakhshi F, Mitchell R, Nasrabadi AN, Varaei S, Hajimaghsoudi M. Behavioural changes in medication safety: Consequent to an action research intervention. J Nurs Manag. 2021;29(2):152–164. doi:https://doi.org/10.1111/jonm.13128
Brandt NJ, Lee M. Medication Safety in Older Adults: Learning From 2020 as We Launch into 2021. J Gerontol Nurs. 2021;47(1):7–11. doi:https://doi.org/10.3928/00989134-20201208-02
Bengtsson M, Ekedahl AI, Sjöström K. Errors linked to medication management in nursing homes: an interview study. BMC Nurs. 2021;20(1):69. doi:https://doi.org/10.1186/s12912-021-00587-2
Vaismoradi M, Griffiths P, Turunen H, Jordan S. Transformational leadership in nursing and medication safety education: a discussion paper. J Nurs Manag. 2016;24(7):970–980. doi:https://doi.org/10.1111/jonm.12387
Choo J, Hutchinson A, Bucknall T. Nurses’ role in medication safety. J Nurs Manag. 2010;18(7):853–861. doi:https://doi.org/10.1111/j.1365-2834.2010.01164.x
Smeulers M, Onderwater AT, van Zwieten MC, Vermeulen H. Nurses’ experiences and perspectives on medication safety practices: an explorative qualitative study. J Nurs Manag. 2014;22(3):276–285. doi:https://doi.org/10.1111/jonm.12225
Ganaden RE, Mitchell L. Implementing a Comprehensive Unit-Based Safety Program (CUSP) to Enhance a Culture of Patient Safety and Improve Medication Safety in a Regional Home Care Program. Qual Manag Health Care. 2018;27(3): 130–135. doi:https://doi.org/10.1097/QMH.0000000000000180
Ridelberg M, Roback K, Nilsen P. Facilitators and barriers influencing patient safety in Swedish hospitals: a qualitative study of nurses’ perceptions. BMC Nurs. 2014;13:23. doi:https://doi.org/10.1186/1472-6955-13-23
Jose J, van Eekeren R, Jimmy B. Medication safety education through games: a potential approach to educate healthcare students on adverse drug reactions. Int J Pharm Pract. 2021;29(1):91–92. doi:https://doi.org/10.1111/ijpp.12657
Musharyanti L, Haryanti F, Claramita M. Improving Nursing Students’ Medication Safety Knowledge and Skills on Using the 4 C/ID Learning Model. J Multidiscip Healthc. 2021;14:287–295. doi:https://doi.org/10.2147/JMDH.S293917
Davis M, Coviello J. Development of a Medication Safety Science Curriculum for Nursing Students. Nurse Educ. 2020;45(5):273–276. doi:https://doi.org/10.1097/NNE.0000000000000783
Khatony A, Soroush A, Andayeshgar B, Abdi A. Nursing students’ perceived consequences of self-medication: a qualitative study. BMC Nurs. 2020;19:71. doi:https://doi.org/10.1186/s12912-020-00460-8
DeVellis, RF. Scale development: Theory and applications (4th ed.). SAGE Publications: 2016.
Park J, Seomun G. Development and Validation of the Medication Safety Competence Scale for Nurses [published online ahead of print, 2020 Nov 6]. West J Nurs Res. 2020;193945920969929. doi:https://doi.org/10.1177/0193945920969929
Wolf EJ, Harrington KM, Clark SL, Miller MW. Sample Size Requirements for Structural Equation Models: An Evaluation of Power, Bias, and Solution Propriety. Educ Psychol Meas. 2013;76(6):913–934. doi:https://doi.org/10.1177/0013164413495237
Kline, RB. Principles and practice of structural equation modeling (2nd ed.). New York: Guilford: 2005
Huang F, Wang H, Wang Z, et al. Psychometric properties of the perceived stress scale in a community sample of Chinese. BMC Psychiatry. 2020;20(1):130. doi:https://doi.org/10.1186/s12888-020-02520-4
Zhou CL, Wang SQ, Wang YF, Ou JX, Wu YN. A Chinese version of the Patient Perceptions of Patient-Empowering Nurse Behaviours Scale: Reliability and validity assessment in chronically ill patients. J Clin Nurs. 2019;28(3–4):444–457. doi:https://doi.org/10.1111/jocn.14613
Waltz, C.F.; Strickland, O.L.; Lenz, E.R. Measurement in Nursing and Health Research (4th ed.). 2016;New York, US: Springer Publishing Company: 87–89
Devellis RF. Scale development: theory and applications (applied social research methods). 4th ed. Los Angeles, CA: SAGE publication; 2016. p. 137.
Koo TK, Li MY. A Guideline of Selecting and Reporting Intraclass Correlation Coefficients for Reliability Research. J Chiropr Med. 2016;15(2):155–163. doi:https://doi.org/10.1016/j.jcm.2016.02.012
The authors are grateful to clinical nurses who participated in this study, and also to the nursing directors for their strong support in collecting samples. Furthermore, we thank the reviewers from the bottom of our hearts for their useful feedback and valuable editorial suggestions on our manuscript. We also thank TopEdit (www.topeditsci.com) for its linguistic assistance during the preparation of this manuscript.
No funding was obtained for this study.
Ethics approval and consent to participate
Prior to the investigation, participants were informed of the purpose and significance of this study and signed informed consent. All data were protected throughout the study. All procedures were performed with the 1964 Helsinki declaration, and the study protocol was approved by the Ethics Committee of the Jinzhou Medical University (LLSC2021213).
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Yang, Z., Chen, F., Lu, Y. et al. Psychometric evaluation of medication safety competence scale for clinical nurses. BMC Nurs 20, 165 (2021). https://doi.org/10.1186/s12912-021-00679-z
- Medication safety competence
- Factor analysis
- Medication errors
- Psychometric properties