Competency, confidence and conflicting evidence: key issues affecting health visitors' use of research evidence in practice
© Hilton et al; licensee BioMed Central Ltd. 2009
Received: 05 June 2008
Accepted: 20 April 2009
Published: 20 April 2009
Health visitors play a pivotal position in providing parents with up-to-date evidence-based care on child health. The recent controversy over the safety of the MMR vaccine has drawn attention to the difficulties they face when new research which raises doubts about current guidelines and practices is published. In the aftermath of the MMR controversy, this paper investigates the sources health visitors use to find out about new research evidence on immunisation and examines barriers and facilitators to using evidence in practice. It also assesses health visitors' confidence in using research evidence.
Health visitors were recruited from the 2007 UK Community Practitioners' and Health Visitors' Association conference. All delegates were eligible to complete the questionnaire if in their current professional role they advise parents about childhood immunisation or administer vaccines to children. Of 228 who were eligible, 185 completed the survey (81.1%).
These health visitors used a wide range of resources to find out about new research evidence on childhood immunisation. Popular sources included information leaflets and publications, training days, nursing journals and networking with colleagues. A lack of time was cited as the main barrier to searching for new evidence. The most common reason given for not using research in practice was a perception of conflicting research evidence. Understanding the evidence was a key facilitator. Health visitors expressed less confidence about searching and explaining research on childhood immunisation than evidence on weaning and a baby's sleep position.
Even motivated health visitors feel they lack the time and, in some cases, the skills to locate and appraise research evidence. This research suggests that of the provision of already-appraised research would help to keep busy health professionals informed, up-to-date and confident in responding to public concerns, particularly when there is apparently conflicting evidence. Health visitors' relative lack of confidence about research on immunisation suggests there is still a job to be done in rebuilding confidence in evidence on childhood immunisation. Further research on what makes evidence more comprehensible, convincing and useable would contribute to understanding how to bridge the gulf between evidence and practice.
Increasingly health practitioners are expected to keep up-to-date with a growing body of research to ensure that they are providing patients with the latest evidence-based information http://www.rcn.org.uk/__data/assets/pdf_file/0008/78569/001998.pdf. Moreover, the increasing availability of health information means that patients' needs often extend beyond wanting information, to seeking help in the interpretation and clarification of information . Health visitors (HV) play a pivotal role in providing up-to-date and accurate information on child health matters. Despite extensive efforts to encourage health visitors to view research evidence as useful for informing decision-making, the extent to which it is actually transferred into clinical practice remains unclear . Further, the expanding role of health visitors, along with the need to retain and refresh their knowledge on a wide range of child health care topics, may pose challenges made all the more difficult when new research appears to contradict current practice.
Childhood immunisation is a good example of a public health intervention for which there is strong evidence of effectiveness and safety, and on which health visitors regularly give advice. Despite a substantial body of evidence supporting vaccine safety, recent studies have consistently reported that health visitors are poorly informed about the contraindications and adverse effects of vaccines [3–6]. The recent debate over the safety of the MMR vaccine following the publication in 1998 of a paper which was interpreted as suggesting a putative link with autism  highlighted a lack of knowledge and confidence in the MMR vaccine among practitioners, including health visitors. Although parents' satisfaction with health visitors with respect to immunisation visits is generally high , during the MMR debate some parents reported a lack of trust and confidence in information and advice offered by health professionals . During this time MMR uptake declined  leading to an increase in confirmed cases of measles which is still apparent 
In 2003 the Department of Health commissioned a survey of health professionals to assess their information needs in relation to childhood immunisation . Through this survey health professionals expressed a need for more up-to-date information, despite a high awareness and use of immunisation leaflets. However, an earlier survey found that many practitioners either did not know of or use the range of written resources that exist .
Ensuring that practice concurs with best evidence is necessary to prevent patients receiving ineffective, unnecessary or potentially harmful treatments, as has happened in the past [13, 14]. Whilst it is suggested that effective practitioners should be able to critically appraise the research literature, assess the findings and decide whether to integrate the results into patient care, translating research into practice is a demanding task and many barriers exist. These barriers have been explored through qualitative and quantitative studies [15–17] and include: not having the necessary skills to critically appraise the original literature nor the time to apply these skills to clinical practice [16, 18]; and a lack of interest and motivation to appraise research [19, 20]. Even motivated practitioners who are interested in updating their practice may encounter organisational and peer group barriers or lack access to resources. In view of these findings, it has been argued that practitioners cannot be expected to independently appraise and apply the best evidence to practice from the original sources but pre-appraised sources can help them to be effective evidence-based practitioners . This argument also reflects the growing need for practitioners to use their time increasingly efficiently.
More than a decade has passed since the publication of Wakefield's paper and the MMR controversy has largely abated. In the aftermath of the controversy, this paper aims to explore the sources of information health visitors use to find out about new research evidence on childhood immunisation and examine barriers and facilitators to using evidence in practice. We also examine health visitors' confidence in searching the literature and explaining the latest research evidence on childhood immunisation to parents in comparison with two other issues on which they commonly offer advice: weaning and a baby's sleeping position.
This survey is part of a larger study (Communicating Health Information & Research into Practice & Policy, CHIRPP) of health professionals' engagement with research evidence.
All health visitors attending the 2007 UK Community Practitioners' and Health Visitors' Association (CPHVA) annual conference were eligible to take part in the survey if they advise parents about childhood immunisation or administer vaccines to children in their current professional role. Each attendee received a questionnaire and written information about the study in their conference pack and instructions on how to return completed questionnaires. In addition, one of the researchers (SH) was available to discuss the study at a stall set up for the 3 day event.
Example of themes and references identified from literature in questionnairea development in relation to barriers to searching and using scientific research evidence in practice. a The questionnaire is available from the authors on request
Key themes identified from literature
Question asked in questionnaire
Barriers to searching and using new research findings
Lack of time
What barriers are there to searching and using scientific research evidence in your practice?
Grimshaw et al (2002)
Hutchinson et al (2004)
Bryar et al (2002)
Lack of IT skills
Thompson et al (2005)
McKenna et al (2004)
Lack of access to computer
Thompson et al (2005)
McKenna et al (2004)
Lack of access to databases
Thompson et al (2005)
McKenna et al (2004)
Not a priority
Lack of skills in assessing the evidence
Hutchinson et al (2004)
Bryar et al (2002)
Evidence not seen as credible
Difficulty in applying evidence to patient
Gyatt et al (2000)
Lack of interest
To assess the construct and content validity the questionnaire was piloted on 37 health professionals in the presence of one of the researchers (SH) enabling her to investigate respondents' understanding of the questions, identify any difficulties they experienced in completing it and any issues or sub-themes they felt were missing from the questionnaire based on their clinical experiences. The questionnaire was revised in the light of this pilot. An additional small pilot of the revised questionnaire with a further five health professionals did not suggest that any further revisions were necessary. The final questionnaire is available from the researchers on request. Questions on HVs' experiences of the barriers and facilitators to using research in practice and about communicating with parents about research evidence were presented as closed questions (including some as Likert scale questions). To thank respondents for taking part, respondents' names were entered into a £50 voucher prize draw.
Ethical approval for the study was obtained from the NHS National Research Ethics Committee. Data were entered into SPSS 14.0 and descriptive statistics of the sample were produced.
Characteristics of the sample
Respondents were asked to identify which nursing and medical journals or magazines they read. All but two of the respondents said that they read the Community Practitioner Journal (n = 183) and just under half the British Medical Journal (n = 80), Nursing Standard (n = 78), or British Journal of Community Nursing (n = 77). Just under a third said they read Public Health Practitioner (n = 59) and a quarter read Practice Nurse (n = 43). Other journals cited included the British Journal of Nursing (n = 36), Journal of Advanced Nursing (n = 31) and Family Practice (n = 31). The sections of the journal reported to be most read were editorials (n = 173), news items (n = 168), research (n = 146), reviews (n = 129) and letters (n = 127).
Respondents were also asked about other sources of information about new research findings on childhood immunisation. Almost all respondents (n = 183) cited NHS or Department of Health leaflets and publications. Other key sources included training days (n = 169), nursing journals (n = 155) and work colleagues (n = 146). More than three quarters mentioned the internet (n = 143) and email alerts (n = 141) and more than two thirds (n = 125) cited TV/radio/newspapers as sources. Medical journals were cited by 116 respondents, locally produced newsletters by 109 respondents, parents by 78 respondents, support groups by 53 respondents and telephone help lines by 40 respondents.
Barriers and facilitators to searching and using new research evidence
The questions about barriers and facilitators to searching for and using new research evidence in practice elicited more missing data compared to other questions in the questionnaire. One explanation for this is that high levels of missing data may reflect the difficulties that respondents had in knowing what impedes them from searching for and using new research in practice. 162 respondents (78%) identified time as a barrier to searching for research evidence. About a quarter (23%; n = 47) felt they lacked IT skills (a further 75% did not respond). Lack of access to databases or a computer was cited by 22% (n = 46, missing 75%) and 18% (n = 38, missing 79%) respectively. Only eleven respondents indicated that they thought searching for new research was not a priority (5%, missing 91%).
Around half of the respondents (49%; n = 103, missing 48%) thought that the existence of conflicting evidence was the main barrier to using research evidence, whilst just less than a half (n = 90, 43%, missing 55%) felt that parents did not accept the evidence. About a third of respondents (32%; n = 68, missing 66%) indicated that they were unable to use research in practice because of their difficulty in keeping up-to-date with research evidence. Other barriers were cited: one fifth (18%; n = 37, missing 80%) of respondents considered that they lacked the skills to assess evidence, 30 (14%, missing 82%) cited doubts about the credibility of the evidence and 20 (10%; missing 88%) felt that they had difficulty in knowing how to apply research in practice.
There was less missing data in response to a question asking respondents to identify what helped them change their practice in light of new research evidence. 'Understanding new evidence' was cited by most (75%; n = 156, missing 24%) respondents. 'Seminars and training courses' were considered to be a facilitator by 130 respondents (62%, missing 34%) and 'trusting new evidence' by 114 (55%, missing 43%). Over half (51%; n = 106, missing 48%) thought that feeling confident in explaining the evidence to others helped change practice and less than a third (32%; n = 66, missing 62%) had found that colleagues helped them change their practice. A quarter (22%; n = 46, missing 68%) felt that there being little or no conflicting evidence helped them change their practice in response to new research evidence.
Confidence about research evidence on childhood immunisation
Respondents were asked to rate how confident they felt about searching the literature for the latest findings relevant to three different child health issues (childhood immunisation, weaning and sleep position) and about explaining the latest research findings on these issues to parents.
The strength of respondents' confidence in searching literature and explaining research findings on childhood immunisation, weaning and baby's sleeping position to parents
Neither agree nor disagree
"I feel confident about searching the scientific literature for the latest research findings relevant to childhood immunisation"
"I feel confident about searching the scientific literature for the latest research findings relevant to the timing of weaning"
"I feel confident about searching the scientific literature for the latest research findings relevant to a baby's sleeping position"
"I feel confident about explaining the latest scientific research findings about childhood immunisation to parents"
"I feel confident about explaining the latest scientific research findings about timing of weaning to parents"
"I feel confident about explaining the latest scientific research findings about a baby's sleeping position to parents"
Whilst previous work has suggested that some practitioners lack the interest or motivation to appraise research [19, 20] only a small number of health visitors in this study did not prioritise research in practice. The majority, however, experienced difficulty in finding the time to manage the increasing availability of information to keep up-to-date with new evidence. This supports Guyatt's argument for providing health practitioners with information which draws upon pre-appraised sources, since expecting even the most motivated health professionals to keep up-to-date with the original sources may be unrealistic given other time pressures and priorities .
However, the findings also raise the issue about what counts as evidence for HVs, and where that evidence is obtained. In line with findings from a Department of Health survey , our study found that practitioners used a wide range of resources on childhood immunisation. To find out about new research on immunisation health visitors reported using information leaflets and publications, training days, nursing journals and networking with colleagues. With respect to journals, comparisons with a UK survey of paediatricians  reveal the importance of a few key journals and the dominance of the main professional membership journals, in this case the (CPHVA) Community Practitioner journal. In the current study editorials and news articles were the most popular sections of journals for health visitors. This suggests that key journals are particularly important information sources when there is conflicting research evidence and they can thus help guide practitioners by offering appraisals of existing evidence alongside recommendations for practice. Although more than three quarters of our respondents said that they used the internet and email alerts to find new information on childhood immunisation, a quarter reported a lack of IT skills or access to databases or a computer. Other studies have reported a lack of access to a computer and relevant databases to be a barrier to evidence-based practice.[17, 2, 24] Of some concern, given doubts about the balance of media reporting on MMR, [25, 26] was the finding that more than two-thirds of health visitors used the popular media as a source of evidence and over one-third found out about new research developments from parents. The challenge now is to gain a better understanding of how health visitors decide what counts as reliable sources on new evidence and what makes some research evidence credible and others not.
Increasingly, for health visitors to be viewed as effective and confident evidence-based practitioners they need to be adept at finding, appraising and providing parents with up-to-date information on a broad range of health issues. Our study questioned an experienced group of health visitors, more than half of whom had over a decade of experience as a health visitor. Three child health issues they will have often had to discuss with parents are childhood immunisation, weaning and a baby's sleep position. Of these topics HVs expressed least confidence in searching for and explaining research findings on childhood immunisation. This resonates with previous work on immunisation [3–6] and suggests that efforts to disseminate evidence on the safety and efficacy of childhood immunisation to health visitors have not been entirely successful. It also suggests that there is still a job to be done rebuild HVs' confidence about childhood immunisation evidence in the aftermath of the MMR controversy. The finding that one in 7 of these experienced and motivated health visitors had delayed, or opted not to vaccinate their own children with MMR because of concerns about its safety perhaps demonstrates most clearly the lack of confidence some health visitors have had in the evidence.
Many respondents thought that the existence of conflicting evidence was a barrier to using research in practice. Thus, the conflicting evidence circulating during the MMR debate may explain why respondents expressed lower confidence in searching and explaining research on childhood immunisation. This finding has relevance for all those involved in the dissemination of research evidence to health professionals. Our findings that health visitors expressed greater confidence about searching and explaining research on sleep position indicates that the 'Back to Sleep' campaign in the early 1990s to reduce cot deaths is a good example of practice which was helped by the dissemination of evidence. However, the inevitable lag between the accumulation of evidence and change in practice is particularly problematic for those health professionals working on the front line and future research efforts should attempt to explore this issue in greater detail.
It is important that, when new research which raises doubts about existing guidelines and practice is published, appraisals of the scientific rigour of the study and its significance for practice accompany it, so that health professionals can feel confident in understanding new evidence and its implications for patient care. As Swinglehurst suggests in relation to patients, health professionals' needs often extend beyond that of receiving evidenced-based information per se, to help in the interpretation and clarification of information especially when there is conflicting evidence . The fact that some practitioners had difficulty in knowing how to apply research to practice may affect how effectively and confidently they can guide and engage with patients and parents to help them understand their care choices and reach decisions.
Our findings must be interpreted with some caution as the study relies on self-reported behaviour which can be prone to reporting biases, although our findings on barriers and facilitators resonate well with findings from other studies. Although the study might have benefited from triangulation, combining observational, interviews and self-report methods to obtain a fuller understanding, this would have been prohibitively costly and placed a heavy burden on this busy group of health professionals. Nevertheless, further qualitative studies with a smaller sample could provide useful insights into the process of translating evidence into practice. A second limitation of the study concerns its generalisability to the wider health visiting profession. This study reports the views of health visitors attending the CPHVA annual conference. It is possible that these health visitors are not representative of the wider profession; indeed it is likely that they represent some of the more motivated, proactive members of their profession who play an important role in cascading research findings to their professional colleagues. We would argue that this makes their views of particular interest.
The findings from this study have a number of implications. First, even health visitors who are motivated to be evidence-based practitioners are busy and may lack the time, skill and confidence in appraising research. This study suggests that there is a need for a constant stream of already-appraised research to keep busy health professionals informed and up-to-date. Helpful formats which recognize these barriers and offer evaluative comment on research evidence and recommendations for practice are a valuable source for translating research evidence to health professionals. Professional membership journals, alongside email alerts and other regularly updated resources, can play a vital role in equipping health visitors to respond effectively to public concerns when public health controversies arise. Research should explore how well these key resources do in translating evidence in a comprehensible form for health professionals and in exploring the kinds of formats health professionals find most helpful in their understanding of research evidence. However, passive dissemination alone is not enough as a means of getting evidence into practice. This study highlights the need for further research aimed at developing a better understanding of what works and for whom. The challenge now is to gain a better understanding of how health visitors decide what counts as reliable sources of new evidence and what makes some research evidence credible and others not.
Secondly, the inevitable lag between the publication of research which sparks a controversy and the accumulation of evidence to refute or support that research (which may give rise to subsequent changes in best practice) is particularly problematic for health professionals working on the front line. The fact that health visitors in this study still felt less confident about the research evidence on childhood immunisation compared to that on weaning and baby's sleep position is evidence of the continuing impact of the MMR controversy. There is no "quick fix" to rebuilding confidence in evidence on childhood immunisation. The MMR debate provides a useful case study in which to explore the process of creating and modifying guidelines for health professionals on how to deal with and communicate about controversial evidence.
We would like to thank Professor Mark Petticrew, London School of Hygiene and Tropical Medicine, for his helpful comments on drafts of the manuscript. We warmly thank the CPHVA conference organisers and their stewards for help in distributing and collecting completed questionnaires and the health practitioners who took part in this study. Shona Hilton and Kate Hunt are funded by the UK Medical Research Council (MRC). Helen Bedford and Mike Calnan are funded by the Higher Education Council Funding for England. This project was funded by the MRC's Population Health Sciences Research Network. Shona Hilton and Kate Hunt are funded by the UK Medical Research Council (MRC).
- Swinglehurst D: Information needs of United Kingdom primary care clinicians. Health Information Libraries Journal. 2005, 22 (3): 196-204. 10.1111/j.1471-1842.2005.00579.x.View ArticlePubMedGoogle Scholar
- Thompson C, McCaughan D, Cullum N, Sheldon T, Raynor P: Barriers to evidence-based practice in primary care nursing-why viewing decision-making as a context is helpful. Journal of Advanced Nursing. 2005, 52: 432-444. 10.1111/j.1365-2648.2005.03609.x.View ArticlePubMedGoogle Scholar
- Peckham C, Bedford H, Senturia Y, ades A: The Peckham Report: National Immunisation Study: factors influencing immunisation uptake in childhood. 1989, Horsham: Action for the Crippled Child, 14-Google Scholar
- Pugh E, Hawker R: Measles immunisation: professional knowledge and intention to vaccinate. Community Medicine. 1986, 8 (4): 340-347.PubMedGoogle Scholar
- Harris T, Gibbons CR, Churchill M, Copping J: Primary care professionals' knowledge of contraindications. Community Practitioner. 2001, 74 (2): 66-67.Google Scholar
- Petrovic M, Roberts R, Ramsay M: Second dose measles, mumps, and rubella vaccine: Questionnaire survey of health professionals. British Medical Journal. 2001, 322: 82-85. 10.1136/bmj.322.7278.82.View ArticlePubMedPubMed CentralGoogle Scholar
- Wakefield AJ, Murch SH, Anothony A, Linnell J, Casson DM, Malik M, Berelowitz M, Dhillon AP, Thomson MA, Harvey P: IIeal-lymhoid-nodular hyerplasia, non-specific colitis, and pervasive developmental disorder in children. The Lancet. 1998, 351: 637-641. 10.1016/S0140-6736(97)11096-0.View ArticleGoogle Scholar
- Yarwood J, Noakes K, Kennedy D, Campbell H, Salisbury DM: Tracking mothers attitudes to childhood immunisation 1991–2001. Vaccine. 2005, 23: 5670-5687. 10.1016/j.vaccine.2004.11.081.View ArticlePubMedGoogle Scholar
- Hilton s, Petticrew M, Hunt K: Parents' champions vs. vested interests: Who do parents believe about MMR? A qualitative study. BMC Public Health. 2006, 7: 42-10.1186/1471-2458-7-42.View ArticleGoogle Scholar
- Health Protection Agency: COVER programme: Jan to Mar 2003. CDR weekly (online) 91. 2003, 465-468.Google Scholar
- Eaton L: Measles cases in England and Wales rise sharply in 2008. BMJ. 2009, 338: b5533-Google Scholar
- Department of Health: Health Professionals Childhood Immunisation Survey Report. London. 2003Google Scholar
- Grol R, Grimshaw J: From best evidence to practice: effective implementation of change in patients' care. The Lancet. 2003, 362: 1225-1230. 10.1016/S0140-6736(03)14546-1.View ArticleGoogle Scholar
- Miller E, Waight P, Laurichesse H, Andrews N, Thorton C, Sesardic D, Corbel M: Immunogencity and reactogenicity of acellular diphtheria/tetanus/pertussis vaccines given as a pre-school booster: effect of simultaneous administration of MMR. Vaccine. 2001, 19: 3904-3911. 10.1016/S0264-410X(01)00123-2.View ArticlePubMedGoogle Scholar
- Rycroft-Malone J, Harvey G, Seers K, Kitson A, McCormack B, Titchen A: An exploration of the factors that influence the implementation of evidence into practice. Journal of Clinical Nursing. 2004, 13 (8): 913-924. 10.1111/j.1365-2702.2004.01007.x.View ArticlePubMedGoogle Scholar
- Hutchinson A, Johnston L: Bridging the divide: a survey of nurses' opinions regarding barriers to and facilitators of. research utilization in the practice setting. Journal of Clinical Nursing. 2004, 13: 304-315. 10.1046/j.1365-2702.2003.00865.x.View ArticlePubMedGoogle Scholar
- McKenna H, Ashton S, Keeney S: Barriers to evidence-based practice in primary care. Journal of Advanced Nursing. 2004, 45: 178-189. 10.1046/j.1365-2648.2003.02879.x.View ArticlePubMedGoogle Scholar
- Bryar R, Closs J, baum G, Cooke J, Griffiths J, Hostick T, Kelly S, Knight S, Marshall K, Thompson D: The Yorkshire barriers project: diagnostic analysis of barriers to research utilization of nursing research. International Journal of Nursing Studies. 2002, 40: 73-84. 10.1016/S0020-7489(02)00039-1.View ArticleGoogle Scholar
- Parahoo K: Barriers to and facilitators of research utlilzation among nurses in Northern Ireland. Journal of Advanced Nursing. 2000, 31: 89-98. 10.1046/j.1365-2648.2000.01256.x.View ArticlePubMedGoogle Scholar
- Retsas A: Barriers to using research evidence in nursing practice. Journal of Advanced Nursing. 2000, 31: 599-606. 10.1046/j.1365-2648.2000.01315.x.View ArticlePubMedGoogle Scholar
- Gyatt G, Meade M, Jaeschke R, Cook D, Haynes R: Practitioners of evidence based care: Not all clinical needs to appraise evidence from scratch but all need some skills. British Medical Journal. 2000, 320: 954-955. 10.1136/bmj.320.7240.954.View ArticleGoogle Scholar
- Lincoln YS, Guba EG: Naturalistic Inquiry. 1985, Beverly Hill, CA: SageGoogle Scholar
- Jones T, Hanney S, Buxton M: The information sources and journals consulted or read by UK paediaticians to inform their clinical practice and those which they consider important: a questionnaire survey. BMC Pediatrics. 2007, 7: 1-10.1186/1471-2431-7-1.View ArticlePubMedPubMed CentralGoogle Scholar
- Brenner M: Children's nursing in Ireland: barriers to and facilitation of, research utilization. Paediatric Nursing. 2005, 17 (4): 40-45.PubMedGoogle Scholar
- Hargreaves I, Lewis J, Speers T: Towards a better map: Science, the public and the media. 2003, Cardiff: Cardiff UniversityGoogle Scholar
- Goldacre B: Bad Science. The Media's MMR Hoax. 2008, London: Fourth Estate, Chapter 15:Google Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1472-6955/8/4/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.