Diabetes knowledge in nursing homes and home-based care services: a validation study of the Michigan Diabetes Knowledge Test adapted for use among nursing personnel
© The Author(s). 2016
Received: 11 November 2015
Accepted: 30 May 2016
Published: 29 June 2016
Providing high-quality diabetes care in nursing homes and home-based care facilities requires suitable instruments to evaluate the level of diabetes knowledge among the health-care providers. Thus, the aim of this study was to examine the psychometric properties of the Michigan Diabetes Knowledge Test adapted for use among nursing personnel.
The study included 127 nursing personnel (32 registered nurses, 69 nursing aides and 26 nursing assistants) at three nursing homes and one home-based care facility in Norway. We examined the reliability and content and construct validity of the Michigan Diabetes Knowledge Test.
The items in both the general diabetes subscale and the insulin-use subscale were considered relevant and appropriate. The instrument showed satisfactory properties for distinguishing between groups. Item response theory-based measurements and item information curves indicate maximum information at average or lower knowledge scores. Internal consistency and the item-total correlations were quite weak, indicating that the Michigan Diabetes Knowledge Test measures a set of items related to various relevant knowledge topics but not necessarily related to each other.
The Michigan Diabetes Knowledge Test measures a broad range of topics relevant to diabetes care. It is an appropriate instrument for identifying individual and distinct needs for diabetes education among nursing personnel. The knowledge gaps identified by the Michigan Diabetes Knowledge Test could also provide useful input for the content of educational activities. However, some revision of the test should be considered.
KeywordsDiabetes Elderly Nursing personnel Michigan Diabetes Knowledge Test
Registered nurses, nursing aides and nursing assistants who report experiencing their diabetes knowledge as sufficient, will obtain higher scores on both the MDKT general diabetes subscale and the insulin-use subscale than those who report experiencing their diabetes knowledge as insufficient in relation to their work tasks.
Registered nurses will obtain higher scores than nursing aides and nursing assistants on both MDKT subscales.
Those who report being delegated to administer insulin will report higher scores on both MDKT subscales than those who have not been delegated.
Design and participants
We invited six experts to participate in translating the MDKT into Norwegian, including adaptation for use among nursing personnel. In addition, we pilot tested the Norwegian version among eight nursing personnel to assess the face validity.
Demographic characteristics for 127 nursing personnel in three Norwegian nursing homes and one home-based care facility
Profession (n = 127)
Employment (n = 125)
Work experience (n = 127)
In addition to the MDKT, the study questionnaire included demographic data, items about the participants’ employment status (“full-time work”, “temporary employment status” and “hourly based”), work experience in a nursing home or home-based care (“<1 year”, “1–5 years” and “>5 years”), delegation to administer insulin (yes/no) and a single item about the participants’ perception of their diabetes knowledge being sufficient or not in relation to given work tasks (yes/no).
The original MDKT included 23 items divided into two subscales: the general diabetes subscale with 14 items (items 1–14) (e.g. “Which should not be used to treat low blood glucose?”) and the insulin-use subscale with nine items (items 15–23) (e.g. “If you are sick with the flu, which of the following changes should you make?”) (http://www.med.umich.edu/borc/profs/documents/svi/dkt5answers.pdf). Each item has three or four answer categories; one is correct. Before analysis, we recoded the answer categories into two categories, correct (=1) or wrong (=0), and calculated a sum score for each participant as the percentage of correct answers. The MDKT, which was developed for use among adults with type 1 or type 2 diabetes, has previously shown appropriate reliability and validity . The test was translated into Norwegian for this study using the academic translation procedure recommended by WHO (www.who.int/substance_abuse/research_tools/translation/en). To adapt the MDKT for use among nursing personnel, pronouns were adjusted (e.g. “If you are sick with the flu …” was changed to “If a person with diabetes is sick with the flu …”). The originator of the MDKT at the Michigan Diabetes Research and Training Center approved both the back-translation of the MDKT and the adaptation for use among nursing personnel. The MDKT was adjusted previously in a study among mothers of children with diabetes . Additional file 1 shows the Norwegian version of the adapted MDKT.
Ethics committee approval was not required for this study, but the Data Protection Official for Research approved the study, which was performed according to the guidelines for research ethics prepared by the Norwegian National Committees for Research Ethics. The participants received both oral and written information about the study, and the completed questionnaire was considered as informed consent. The questionnaires were completed at work, and the participants were encouraged to not collaborate with colleagues.
In all analyses, we analysed the MDKT general diabetes subscale and the MDKT insulin-use subscale separately. We report descriptive statistics as counts, proportions, means and standard deviation (SD) to characterize the sample and their scores on the MDKT subscales and measure the internal consistency reliability of the subscale scores by using standardized Cronbach’s alpha, which is equivalent to the Kuder-Richardson Formula 20 (KR-20) for binary items [13, 14]. To identify items that are not consistent with the rest of the instrument, we calculated corrected item-total correlations by correlating each single item score with the total score obtained by summing all the other items in the subscale, not including the item in question.
We used independent sample t-tests to test our first hypothesis regarding differences in MDKT subscale scores between those who experience their own diabetes knowledge as sufficient versus insufficient. We used analysis of variance (ANOVA) to test the second hypothesis regarding the subscales’ ability to distinguish between the three professions. We also analysed this by analysis of covariance (ANCOVA) and included the duration of the participants’ work experience within the nursing home or home-based care setting as a covariate. We analysed the third hypothesis regarding the subscales’ ability to distinguish between those who administered insulin and those who did not by independent sample t-test.
We defined statistical significance as P < 0.05 and used SPSS version 22 (IBM SPSS, Armonk, NY, USA). We performed analysis and item characteristic curves in the program R (R Foundation for Statistical Computing, Vienna, Austria) using the ltm-package .
Item-total correlations for the MDKT subscales among 127 nursing personnel in nursing homes and home-based care
Item difficulty (Rasch analysis)
General test (items 1–14)
n = 127
Insulin use (items 15–23)
n = 127
The expert group experienced the items in the general diabetes subscale as relevant and suitable independent of diabetes treatment regimen. The knowledge required in the insulin-use subscale items was considered relevant for nursing personnel working with insulin users. The participants in the pilot study experienced the items in the MDKT as being relevant and appropriate. They presented some minor remarks on the wording, and we made some minor changes. The authors of the MDKT confirmed a back-translated version.
Differences in the mean percentage of correct answers on the MDKT between groups of professions, groups related to experienced own diabetes knowledge and groups related to insulin administration (n = 127a) in nursing homes and home-based care
General diabetes subscale (items 1–14)
Insulin-use subscale (items 15–23)
Mean % correct answers (SD)
Mean % correct answers (SD)
P-value for differences between the groupsb
Experience of own diabetes knowledge as sufficient
P-value for differences between the answer categoriesc
Delegation to administer insulin
P-value for differences between the answer categoriesc
Table 3 indicates statistically significant differences between nurses, nursing aides and nursing assistants in both general diabetes subscale scores and insulin-use subscale scores, in accordance with our second hypothesis. The registered nurses had the highest percentage of correct answers and the nursing assistants the lowest percentage of correct answers in both subscales. The differences between the groups remained significant also after adjustment for the duration of work experience. Regarding our third hypothesis, we also identified significant differences between those who had been delegated to administer insulin and those who had not for the general diabetes subscale (P < 0.01) (Table 3). Those who had been delegated to administer insulin also scored higher on the insulin-use subscale than those who had not, but the difference was not statistically significant.
The results indicate that both the MDKT general subscale and the insulin-use subscale adapted for nursing personnel can be recommended for further use, but some modification of the subscales should be considered based on the results from the measurements performed in this study.
Both the expert group and the participating nursing personnel in this study experienced the knowledge required in the MDKT as relevant. The topics included in the general diabetes subscale were considered to be relevant for all types of diabetes and treatment regimens related to both type 1 and type 2 diabetes. Further, the items in the insulin-use subscale were considered to be relevant to insulin treatment. The subscale requires knowledge that nursing personnel should have when working with people taking insulin. These findings are in contrast with previous research that claimed that MDKT is an outdated instrument . A potential weakness, however, is that the MDKT does not include questions related to specific new treatment regimens such as insulin pump treatment or various types of glucose-lowering medications for type 2 diabetes. A suggestion could be to develop additional subscales focusing on insulin-pump use, newer types of insulin, various types of glucose-lowering medications for type 2 diabetes and maybe also questions related to blood pressure and lipid-lowering actions. However, in accordance with Benetos et al. , we emphasize the need for essential and basic knowledge related to high and low blood glucose among nursing personnel in nursing homes and home-based care as being among the most important knowledge to secure satisfactory diabetes management and subsequently the best possible daily life for older people with diabetes. A study among 100 nursing home residents with diabetes  indicated and highlighted unsatisfactory recognition of especially low blood glucose and its negative consequences for the residents’ quality of life. Accordingly, Garcia & Brown  also highlight in their review of the literature the high prevalence of adverse events among nursing home residents with diabetes such as hypoglycaemia, hospitalization, skin ulcers, infections and amputations, but they indicate that the literature unfortunately does not associate these with diabetes management characteristics.
Regarding the psychometric properties of the MDKT, we identified relatively weak internal consistency and item-total correlations for both subscales. A Cronbach’s alpha of at least 0.70 is generally recommended in developing psychometric instruments . One could, however, question whether Cronbach’s alpha and item-total correlations are appropriate measures for this kind of knowledge test. The use of Cronbach’s alpha as a measure of internal consistency has been criticized . It has also been argued that a high Cronbach’s alpha would not be expected for index-type questionnaires in which the items themselves define the construct and can include unrelated items, in contrast to questionnaires in which the items measure a single underlying construct such as anxiety or depression . When an index is defined to measure a construct such as knowledge, it might be of interest to select items that are related to the construct of interest but not necessarily to each other. The general diabetes subscale is meant to capture a broad range of topics relevant to diabetes (e.g. dietary concerns and the effect of nutrition on blood glucose control, how to measure blood glucose regulation, how to treat hypoglycaemia, physical activity and long-term complications). The insulin-use subscale includes items on essential aspects critical for administering insulin treatment (e.g. how to treat diabetes when people have infections, signs of ketoacidosis, blood glucose–lowering effect of insulin, reasons for hyperglycaemic events and what to do when insulin doses are forgotten). Nursing personnel may have knowledge about some of the required topics without having knowledge about other topics. Thus, in our opinion, considering knowledge as a single underlying construct of the MDKT subscales is difficult. It is more reasonable to classify the MDKT as an index-type questionnaire according to the definition used by Streiner . Lack of a single underlying construct is probably the main reason for the weak consistencies and correlations identified for the MDKT subscales in this study.
Related to the construct of the MDKT subscales, the total test information curves showed maximum information at about 2 standard deviations below the average knowledge level, indicating that the MDKT is a rather easy test that is best suited to distinguish between respondents on the lower end of the knowledge scale. This may indicate that the MDKT could be an appropriate instrument for use in community care to identify individual and distinct needs for diabetes education among nursing personnel. Knowledge gaps identified by the MDKT could also provide useful input for planning and implementing educational activities and training courses. Although publications on educational activities for nursing home employees are scarce, such activities have been shown to improve the quality of diabetes care in nursing homes .
In accordance with the MDKT’s property of distinguishing between respondents on the lower end of the knowledge scale, it might be more important to achieve satisfactory quality of diabetes care by identifying the nursing personnel lacking basic diabetes knowledge rather than instruments that are more sophisticated at differentiating between those at the upper level of the scale. Nevertheless, we recommend some modification of the MDKT. Based on our results, we suggest removing item 6 (general diabetes subscale) and item 19 (insulin-use subscale). These items seem to be too easy, since almost all participants answer them correctly. The model-fit (the goodness-of-fit test) also improved when these items were removed. Further, items 7 and 9 (general diabetes subscale) seem to be quite easy and do not contribute significantly to differentiating between groups of respondents.
The original MDKT subscales were developed for use among adults with diabetes. It is reasonable to claim that nursing personnel working with people with diabetes should have at least the same theoretical diabetes knowledge as the patients and preferably a higher level of knowledge. Nevertheless, we could not compare our results with other studies since we did not find any others that have validated the psychometric properties of the MKDT among nursing personnel. In nursing homes and home-based care, the nursing personnel must often take over the patients’ self-care. Basic knowledge is sufficient to do this satisfactorily. The scores on the MDKT subscales in this study indicate a knowledge gap related to several important topics. For example, the registered nurses, nursing aides and nursing assistants lack knowledge about the signs of ketoacidosis. The registered nurses scored correctly on 76 % of the questions in the general diabetes subscale and 79 % of the questions in the insulin-use subscale. This indicates potential for improvement. As hypothesized, registered nurses scored higher than nursing aides and nursing assistants on both subscales, which could contribute to a discussion of the distribution of the professionals employed in nursing homes and home-based care facilities. Further, discussing the diabetes knowledge required in nursing homes and home-based care is strongly needed, since this study indicated that 41 % of the respondents experienced their own diabetes knowledge as insufficient in relation to their given work tasks. For the general diabetes subscale, own experience of diabetes knowledge was significantly correlated with the subscale score. In this study, the insulin-use subscale did not show the same properties of differentiating between groups as the general diabetes subscale.
This study has some limitations. The sample was relatively small and limited the possibilities for further subgroup analyses to explore the reliability and validity of the MDKT in different groups of professionals, separately. Further, we did not test whether the MDKT subscales are sensitive and appropriate scales to measure the effect of educational interventions. As commented also by the developers of the scale , the test may not be sensitive for all aspects and components of diabetes education and care, although the test includes several important topics. Further research and further discussions are needed related to the topics and items included in the subscales, their psychometric properties and how to use the MDKT subscales appropriately.
The MDKT, including the general diabetes subscale and the insulin-use subscale, is perceived as a relevant and appropriate instrument for measuring diabetes knowledge among nursing personnel in nursing home and home-based care. The MDKT is an appropriate instrument for identifying individual and distinct needs for diabetes education. Further, the design and implementation of educational activities and training courses could be adapted to target the specific needs of knowledge revealed by the MDKT. However, some revision of the MDKT should be considered.
MDKT, Michigan Diabetes Knowledge Test
We thank all the nursing personnel who participated. We especially thank nurses Linda Heimvik and Ann Kristin Akselberg, who carried out important parts of the data collection.
Bergen University College, Bergen Municipality and the Norwegian Research Council funded the study.
Availability of data and materials
Due to ethical and legal restrictions related to confidentiality, the data is not deposited online as the study participants have not explicitly been informed about, nor approved data sharing when informed consent were gathered.
AH designed the study, collected the data, analysed the data and drafted the manuscript; MA and JI assisted in the statistical analysis and contributed to the final manuscript; TL and MG contributed to designing the study, collecting the data and drafting the manuscript. All authors read and approved the final manuscript.
The authors declare that they have no competing interests.
Ethics approval and consent to participate
The Norwegian Data Protection Official for Research approved the study. Ethics committee approval was not required. The participants gave written consent and approved publication of results.
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
- International Diabetes Federation (IDF). IDF Diabetes Atlas. Sixth edition. 2014. Available at http://www.idf.org/diabetesatlas; last Accessed 11 Apr 2016.
- Kirkman MS, Briscoe VJ, Clark N, Florez H, Haas LB, et al. Diabetes in older adults. Consensus report Diabetes Care. 2012;35:2650–64.View ArticleGoogle Scholar
- Shaw JE, Sicree RA, Zimmet PZ. Global estimates of the prevalence of diabetes for 2010 and 2030. Diabetes Res Clin Pract. 2010;87:4–14.View ArticlePubMedGoogle Scholar
- Bourdel-Marchasson I, Berrut G. Caring the elderly diabetic patient with respect to concepts of successful aging and frailty. Diabetes Metab. 2005;31(Spec No 2):5S13–9.PubMedGoogle Scholar
- Sinclair A, Dunning T, Colagiuri S, International Diabetes Federation (IDF) Working Group. IDF Global Guideline for Managing Older People with Type 2 Diabetes. 2012. Available from http://www.idf.org/sites/default/files/IDF-Guideline-for-Type-2-Diabetes.pdf; last Accessed 11 Apr 2016.
- Ödegård S, Andersson DK. Knowledge of diabetes among personnel in home-based care: how does it relate to medical mishaps? J Nurs Manage. 2001;9:107–14.View ArticleGoogle Scholar
- Berlowitz DR, Young GJ, Hickey EC, Joseph J, Anderson JJ, Ash AS, et al. Clinical practice guidelines in the nursing home. Am J Med Quality. 2001;16:189–95.View ArticleGoogle Scholar
- Garcia TJ, Brown SA. Diabetes management in the nursing home: a systematic review of the literature. Diabetes Educ. 2011;37:167–87.View ArticlePubMedGoogle Scholar
- Vajen BM, Holt R, Marx T, Schwartz FL, Shubrook Jr JH. How well are we managing diabetes in long-term care? J Fam Pract. 2012;61:467–72.PubMedGoogle Scholar
- Francisco MA. Instruments that measure nurses’ knowledge about diabetes: an integrative review. J Nurs Measure. 2013;21:137–52.View ArticleGoogle Scholar
- Fitzgerald JT, Funnell MM, Hess GE, Barr PA, Anderson RM, Hiss RG, et al. The reliability and validity of a brief diabetes knowledge test. Diabetes Care. 1997;21:706–11.View ArticleGoogle Scholar
- Tahirovic H, Toromanovic A. Glycemic control in diabetes children: role of mother’s knowledge and socioeconomic status. Eur J Pediatrics. 2010;169:961–4.View ArticleGoogle Scholar
- Streiner DL. Starting at the beginning: An introduction to coefficient alpha and internal consistency. J Pers Assess. 2003;80:99–103.View ArticlePubMedGoogle Scholar
- Field A. Discovering statistics using SPSS (and sex, drugs and rock’n’roll). London: SAGE Publications; 2012.Google Scholar
- Furr RM, Bacharach VR. Psychometrics: an introduction. 2nd ed. Los Angeles: SAGE Publications; 2014.Google Scholar
- DeVellis RF. Scale development: theory and applications. 3rd ed. Los Angeles: SAGE Publications; 2012.Google Scholar
- Rizopoulos D. An R package for latent variable modelling and item response theory analyses. J Stat Software. 2006;17(5):1–25. Available from http://www.jstatsoft.org/v17/i05; last accessed 11 April 2016.View ArticleGoogle Scholar
- Quandt SA, Ip EH, Kirk JK, Saldana S, Chen S-H, Nguyen H, et al. Assessment of a short diabetes knowledge instrument for older and minority adults. Diabetes Educ. 2014;40:68–76.View ArticlePubMedGoogle Scholar
- Benetos A, Novella JL, Guerci B, Blickle JF, Boivin JM, Cuny P, et al. Pragmatic diabetes management in nursing homes: individual care plan. J Am Med Dir Assoc. 2013;14:791–800.View ArticlePubMedGoogle Scholar
- Andreassen LM, Sandberg S, Kristensen GBB, Solvik UO, Kjome RLS. Nursing home patients with diabetes: prevalence, drug treatment and glycemic control. Diabetes Res Clin Pract. 2014;105:102–9.View ArticlePubMedGoogle Scholar
- Sijtsma K. On the use, the misuse, and the very limited usefulness of Cronbach’s alpha. Psychometrika. 2009;74:107–20.View ArticlePubMedGoogle Scholar
- Streiner DL. Being inconsistent about consistency: when coefficient alpha does and doesn’t matter. J Pers Assess. 2003;80:217–22.View ArticlePubMedGoogle Scholar
- Hager KK, Loprinzi P, Stone D. Implementing diabetes care guidelines in long-term care. J Am Med Dir Assoc. 2013;14:851e7–851e15.View ArticleGoogle Scholar