Implementation of evidence on the nurse-patient relationship in psychiatric wards through a mixed method design: study protocol
© The Author(s). 2017
Received: 13 July 2016
Accepted: 12 December 2016
Published: 11 January 2017
Psychiatric nurses are aware of the importance of the therapeutic relationship in psychiatric units. Nevertheless, a review of the scientific evidence indicates that theoretical knowledge alone is insufficient to establish an adequate therapeutic alliance. Therefore, strategies are required to promote changes to enhance the establishment of the working relationship. The aims of the study are to generate changes in how nurses establish the therapeutic relationship in acute psychiatric units, based on participative action research and to evaluate the effectiveness of the implementation of evidence through this method.
The study will use a mixed method design. Qualitative methodology, through participative action research, will be employed to implement scientific evidence on the therapeutic relationship. A quasi-experimental, one-group, pre-test/post-test design will also be used to quantitatively measure the effectiveness of the implementation of the evidence. Participants will consist of nurses and patients from two psychiatric units in Barcelona. Nurses will be selected by theoretical sampling, and patients assigned to each nurses will be selected by consecutive sampling. Qualitative data will be gathered through discussion groups and field diaries. Quantitative data will be collected through the Working Alliance Inventory and the Interpersonal Reactivity Index. Qualitative data will be analysed through the technique of content analysis and quantitative data through descriptive and inferential statistics.
This study will help to understand the process of change in a nursing team working in an inpatient psychiatric ward and will allow nurses to generate knowledge, identify difficulties, and establish strategies to implement change, as well as to assess whether the quality of the care they provide shows a qualitative improvement.
KeywordsPsychiatric nursing Nursing care Therapeutic Relationship Mixed method design Quality of care Participatory action research
The Therapeutic Relationship (TR) is one of the most important tools at nurses’ disposal, especially in mental health nursing. Indeed, the concept of the therapeutic relationship emerged in parallel to the professionalization of nursing care  and is considered the cornerstone of psychiatric and mental health nursing . Adequate establishment of the therapeutic relationship increases the efficacy of any nursing intervention in the acute mental health setting .
Multiple terms are used to describe the same concept. The TR is also called the helping relationship, the nurse-patient relationship, the trusting relationship, and the therapeutic alliance. Nevertheless, the central focus of all these concepts is the helping working relationship . Likewise, the concept of the TR has been enriched by diverse perspectives and paradigms, including the psychodynamic perspective originating with Freud, the pantheoretical model, and the humanist or person-centred approach. Consequently, some authors have stated that personal qualities rather than theoretical orientation take centre stage in the TR .
Psychiatric nurses are aware of the concept of the TR and its importance [2, 4–10]. However, they are also aware that specific skills are required to develop and maintain a TR with patients , which involves a huge effort and, moreover, implies difficulty in its achievement. Factors such as consistency, empathy, the ability to listen, making a positive first impression, a safe and comfortable environment, and teamwork are basic pillars, encouraging and aiding the development of a TR .
For their part, patients perceive attitudes, values and a trusting relationship as being more important than technical skills in the therapeutic relationship . Service users expect to receive individual attention as part of their treatment plan . Having a feeling of control and of self-determination is highly important, and this sense of meaning and control is provided by interpersonal relationships . So much so, that what patients want most are empathetic nurses, ie, those able to identify what the patient expects or needs from the nurse at any given moment . Patients value nurses who are patient and imaginative and have a sense of humour , who listen and are empathetic . The greater the chronicity, the more patients lose interest in their physical needs and the more they value relational aspects of care .
Despite evidence of the greater effectiveness of the TR and psychodynamic training in clinical practice , mental health nursing has been strongly influenced by the biomedical model and has become increasingly depersonalized . There is no recognition of the need for the care of emotions, or of the importance of the emotional work required to develop and maintain a quality TR . In this regard, routine tasks and administrative duties, as well as the time they consume, hamper the provision of individual attention and consequently the effectiveness of the TR . Nevertheless, some evidence suggests that staff spend increasingly less time with patients, despite an increase in the staff-to-patient ratio in some units .
For some patients, inaccessibility and lack of communication-and therefore a lack of information provided by some staff-are factors that limit the TR . Likewise, lack of availability, inequality, and differences in values and experience are factors that distance nurses from patients and hamper the development and maintenance of the therapeutic alliance. Often, patients feel they are given little opportunity to collaborate in their care , perceive that they spend most of their time alone and that they have little relationship with the care team . Some patients feel like prisoners and report that staff who are themselves insecure adopt intimidating and condescending attitudes .
According to nurses, the elements that most frequently hamper the therapeutic relationship are the amount of time spent on administrative duties, patients’ negative attitudes and unrealistic expectations, nurses’ inability to confront these issues with patients, and feeling inadequately trained to provide the individual attention required by patients . Also important are nurses’ perception that socially unacceptable factors such as segregation, coercion and social control are working norms and that this situation is, moreover, experienced as demotivating and routine, as if working life were dominated by functions of social control .
In this regard, and although nurses are aware of the importance of the TR and how to foster such an alliance, the scientific evidence shows that theoretical knowledge of communicative and interpersonal skills alone is insufficient to develop these skills effectively, and hence to establish an effective therapeutic relationship and provide high-quality nursing care [3, 9, 15–17, 20–23].
Therefore, if knowledge of these skills does not necessarily lead to their use in daily clinical practice, it seems necessary to devise strategies to promote these competencies. Effecting change for action and through action is characterised by participation and reflection, which encourages both learning through action and about the action taking place.
Participatory Action Research (PAR) is a method that encourages participatory and reflective change at the same time as it increases an understanding and transformation of practices . Thus, PAR aims to achieve reliable, effective and efficient results to improve group or collective situations. PAR is a research method because it aims to increase knowledge and understanding of phenomena through exploratory scientific techniques. Moreover, PAR is also an action because it aims to intervene in the phenomenon being explored by effecting change in that phenomenon. Finally, PAR is participatory since it encourages collaboration and cooperation among all the persons involved throughout the process.
To generate change in how nurses establish the therapeutic relationship in an acute psychiatric unit, based on PAR.
To evaluate the effectiveness of the implementation of scientific evidence through PAR, in terms of improving the therapeutic relationship, as perceived by nurses and patients, and enhancing empathy, as perceived by nurses.
To describe how nurses in an acute psychiatric unit perceive the establishment of the therapeutic relationship with patients.
To identify nursing professionals’ difficulties and limitations when establishing a therapeutic relationship with a patient.
To identify the elements of change and improvement in the establishment of the therapeutic relationship, based on contrasting the evidence with real-world clinical practice.
To qualitatively evaluate the effects of the implementation of evidence on the development of the therapeutic relationship between nurses and patients.
To analyse the impact of the implementation of scientific evidence on the establishment of the therapeutic relationship on:
Measurement of the therapeutic relationship, evaluated by staff before and after the PAR process.
Measurement of the therapeutic relationship, evaluated by patients before and after the PAR process.
Measurement of empathy, evaluated by staff before and after the PAR process.
Therefore, to achieve the first objective, a qualitative design will be used in the form of PAR, within the constructivist paradigm and following the model of Kemmis and McTaggart  in cycles and stages. PAR is a method that integrates research and social action  and, during its implementation, includes the following stages: a) analysis of the situation, b) identification of problems and design of strategies for the proposed action, c) implementation of the strategies designed, and d) observation and systematic reflection on their implementation.
To achieve the second objective, a quasi-experimental study of a single pre-test/post-test group is proposed, with evaluation of the implementation of the evidence through PAR .
Setting and participants
The study will be conducted in the acute psychiatric admissions ward of the Institute of Neuropsychiatry and Addictions (Institut de Neuropsiquiatria i Addiccions [INAD]) of Parc de Salut Mar de Barcelona (Spain): the Institute consists of 4 units with 107 in-patient beds for patients with acute psychiatric disorders. These units cover a population of approximately 650,000 inhabitants in the City of Barcelona, Badalona and Santa Coloma de Gramanet.
Study participants will consists of nurses working in the acute-stay units and patients admitted to these units. Theoretical sampling will be carried out in nurses. The sample will be composed of 9–10 participants representing the distinct socio-occupational profiles in the units. Thus, the group will be composed of nurses from each of the three shifts, by specialist and generalist nurses, and by staff and supply nurses. The aim is to guarantee the principles of heterogeneity and accessibility .
We estimate that about 30 patients will be allocated to each participating nurse in the phase prior to the start of the groups, and consequently, accepting an alpha risk of 0.05 and a beta risk of 0.2 in the bilateral contrast, nine participants will be needed to detect a difference equal to or higher than 10 units in the Working Alliance Inventory-Short (WAI-S). A standard deviation of 10 will be accepted, and a loss to follow-up rate of 10%. Consecutive sampling will be performed. Inclusion criteria will consist of the following: a) Being assigned to a participating nurse, b) Having established a link with the participating nurse during a hospital stay longer than 3 days, b) voluntarily accepting to participate in the project and providing signed informed consent.
Exclusion criteria will consist of a) showing signs of the initial stages of psychomotor agitation, and b) being subjected to physical restraint, either currently or within the last 24 h.
Qualitative data collection
Qualitative data will be generated through discussion groups and field diaries kept by participating nurses and researchers.
Due to the importance of team work and the consequent collective social discourse distinct from individual discourse , it is useful for nurses to debate the objectives of the research as a group. Four group sessions will be held to cover the distinct PAR stages.
Participating nurses will construct a narrative of their own observations of the establishment of the therapeutic relationship with patients and will conduct a reflective analysis of these observations . To help aid self-observation and subsequent reflection, the nurses will be provided with a dossier-guideline specifying how to conduct the self-observation and subsequent reflection.
The researcher’s field diary will help to monitor the research process , both descriptively and methodologically, and will help to integrate theory and practice.
Quantitative variables and data collection
The following variables and measurement instruments will be used for quantitative data.
Sociodemographic and occupational variables in nurses, and sociodemographic and clinical variables in patients.
- 2.Dependent variables
The nurse-patient relationship, from the nurse’s perspective, evaluated through the WAI-S scale, therapist version .
The nurse-patient relationship, from the patient’s perspective, evaluated through the WAI-S scale, client version .
Nurse empathy, from the nurse’s perspective, measured with the Interpersonal Reactivity Index .
- 3.Independent variables:
Implementation of evidence through PAR.
The Working Alliance Inventory (WAI short). This inventory measures the working alliance and therefore the nurse-patient relationship (Horvath & Greenberg 1989). The short version of this scale contains 12 items, and each item is evaluated by the health professional and patient through a scale ranging from 1 (never) to 7 (always). The higher the score, the greater the therapeutic alliance. The Spanish version of the WAI-S has good reliability and validity, with a Cronhbach’s alpha of .91 .
The interpersonal reactivity Index (IRI). The most important element in establishing the therapeutic relationship is possibly empathy. For this reason, empathy will be specifically measured through the instrument designed by Davis . This index has 28 items in a Likert scale (1 = not good at all and 5 = very good). Crohnbach’s alpha for the Spanish version ranges from .73 to .71 among the 4 factors composing the IRI .
Qualitative data analysis
The content analysis method will be used, which is an appropriate approach to the analysis and categorization of qualitative data according to empirical and theoretical criteria . Data from the discussion groups and diaries will be transcribed literally. After verification of the authenticity of the transcriptions, the text will be fragmented in descriptive codes assigned on the basis of its content. In a second stage of the analysis, these codes will be grouped into interpretative categories, bearing in mind their similarities and differences and relating them to the main themes identified in the theoretical framework and the study objectives. This process is not linear or sequential but is rather constant, cyclic, recursive and complex, demanding the construction of data for their subsequent reconstruction and interpretation of their meaning [35, 36]. The NVivo platform, version, 10 will be used in the analysis.
Quantitative data analysis
The analysis will focus on numerical differences, obtained in the WAI-S and IRI, observed before and after the group phases of the PAR. Descriptive statistics will be used for sample description and evaluation of the scores. Differences between baseline scores and the post-group assessment will be estimated through the application of a parametric test (Student’s t-test for paired data) in the case of quantitative variables after confirmation of the normality and homogeneity of their variance; for data that do not follow a normal distribution), non-parametric tests will be used: the Wilcoxon test will be used for quantitative variables and the chi-square test or Fisher’s exact test for qualitative variables. To interpret the results, statistical significance will be set at p < 0.05 for a 95% confidence interval (95% CI) in the case of a bidirectional hypothesis. The analysis will be performed with the IBM SPSS Statistics 21 package.
Ethical considerations and measures to preserve participants’ confidentiality and anonymity
The project has been approved by the Clinical Research Ethics Committee. Moreover, in compliance with Spanish Law 15/1999 of 13th December on the Protection of Personal Data, authorization for dissemination of the results of the project will be sought from all participants, guaranteeing their anonymity and strict confidentiality. All participants’ names will be codified and assigned a number. The data obtained will be added to an archive named “MERTCEATE DATA” and the information provided by the questionnaires will be completely confidential. Any data or names that could be used to identify the participants will be eliminated. The data will be stored for the purposes of this research project. Participation among patients and health professionals will be voluntary and all participants will be required to provide their written informed consent indicating their acceptance of the study conditions and will retain the right to withdraw from the study at any point.
The criteria of trustworthiness and authenticity will be taken into account . Trustworthiness will be provided by elements such as the study duration and the use of triangulation of techniques and researchers, while the transferibility of the results will be facilitated by the diversity of the sampling and description of the context. Compliance with the criteria of confirmability will be ensured by audio recording of discussion groups. Authenticity will be provided by the dynamics of the process, which will involve constant interaction between the realities of the observers and the realities observed. Moreover, the central quality criteria, and that forming the basis of the project, will be reflectiveness, understood as a process of returning to allow critical contrasts to be made of the processes occurring during the development of the research .
This study will help to understand the process of change in a nursing team in an inpatient psychiatric unit. The aim is that the nurses themselves will evaluate and reflect on their own interventions so that they will subsequently be able to use the scientific evidence provided by the study to assess whether the quality of the care they provide shows a qualitative improvement. To do this, we hope to learn how participants perceive the establishment of the nurse-patient relationship. As previously mentioned, the concept of the therapeutic relationship can by understood very differently by the distinct actors providing healthcare in acute-stay units and its conceptualization and contextualization is advisable as a prior step to understanding the scientific evidence. Subsequently, difficulties in implementing the evidence, both in nurses individually and in the rest of the team, will allow the planning of strategies for change. Lastly, the study aims to identify the effects of the interventions proposed and conducted by the nurses themselves so that, through a final group reflective session, a definitive report can be drawn up on proposed improvements. The use of validated measurement instruments will help to analyse, contrast, and demonstrate the change produced.
The duration and intensity of the research is a factor to be considered, as some participants may be lost. Therefore, it was decided to increase the size of the group sample. In addition, difficulties may appear that are specific to discussion groups, such as differences among the functioning of the groups, or limitations related to the reflective diaries, such as irregular entries or subjective interpretations by participations of situations that are foreign to their experience. The strategies that will be used to minimize difficulties and limitations are as follows: the use of known but neutral spaces to hold the groups, avoidance of simultaneous note-taking, placement of the recording device in a barely-visible area, and a priori determination of the maximum duration of the group session. The group interviewer and facilitator will be an expert in individual and group interviews and trained in communication skills. Participants will also be given documented tools to help them keep a reflective diary. Other limitations concern those inherent to a quasi-experimental design, such as the lack of a control group and the non-randomization of the sample.
The same nurses that generate knowledge of the therapeutic relationship will establish the recommendations and strategies for its application and will identify deficiencies that form the basis for future training.
Nurses will be able to participate in adapting the strategies to implement changes and may even anticipate demands; this democratic and participative process will contribute to the efficiency of the intervention.
Facilitate the identification of difficulties in the therapeutic relationship and areas requiring exploration, which may open new lines of research.
Improvement in the therapeutic relationship in psychiatric inpatient wards will help to increase patient satisfaction, a fundamental indicator in current health policies.
Institut de Neuropsiquiatria i Addiccions
Participatory Action Research
This study is funded by the College of Nurses of Barcelona as part of the Research Projects Grants (PR- 1915-14/2014).
Availability of data and materials
No data are available as this paper is a study protocol.
All authors contributed to the design of the study. ARMP is the principal investigator of the study. RSP drafted the paper, which was modified and supplemented by all other authors. RSP, RAD and RCS will be involved in recruiting participants. PMC will also take care of the logistics of the study and data collection. PDH contributed specifically to the design of the costeffectiveness and budget impact analyses. PDH and JMLM contributed specifically to the qualitative analysis plan. TLLC and JRM contributed specifically to the statistical analysis plan. All authors read and approved the final manuscript.
The authors declare that they have no competing interests.
Consent for publication
Ethics approval and consent to participate
The project has been approved by the Clinical Research Ethics Committee of Parc de Salut Mar. Participation in the project will be voluntary and requires providing signed informed consent.
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
- O’Brien AJ. The therapeutic relationship: historical development and contemporary significance. J Psychiatr Ment Health Nurs. 2001;8(2):129–37.View ArticlePubMedGoogle Scholar
- Scanlon A. Psychiatric nurses’ perceptions of the constituents of the therapeutic relationship: a grounded theory study. J Psychiatr Ment Health Nurs. 2006;13(3):319–29.View ArticlePubMedGoogle Scholar
- McAndrew S, Chambers M, Nolan F, Thomas B, Watts P. Measuring the evidence: reviewing the literature of the measurement of therapeutic engagement in acute mental health inpatient wards. Int J Ment Health Nurs. 2014;23:212–20.View ArticlePubMedGoogle Scholar
- Hewitt J, Coffey M. Therapeutic working relationships with people with schizophrenia: literature review. J Adv Nurs. 2005;52(5):561–70.View ArticlePubMedGoogle Scholar
- Hem MH, Heggen K. Being professional and being human: one nurse’s relationship with a psychiatric patient. J Adv Nurs. 2003;43(1):101–8.View ArticlePubMedGoogle Scholar
- Chiovitti RF. Nurses’ meaning of caring with patients in acute psychiatric hospital settings: a grounded theory study. Int J Nurs Stud. 2008;45(2):203–23.View ArticlePubMedGoogle Scholar
- Dziopa F, Ahern K. What Makes a Quality Therapeutic Relationship in Psychiatric/Mental Health Nursing : A Review of the Research Literature. Internet J Adv Nurs Pract [Internet]. 2009;10(1):15236064. Available from: http://ispub.com/IJANP/10/1/7218
- Clark L. The therapeutic relationship and Mental Health Nursing: it is time to articulate what we do! J Psychiatr Ment Health Nurs. 2012;19(9):839–43.View ArticleGoogle Scholar
- Cleary M, Hunt GE, Horsfall J, Deacon M. Nurse-patient interaction in acute adult inpatient mental health units: a review and synthesis of qualitative studies. Issues Ment Health Nurs. 2012;33(2):66–79.View ArticlePubMedGoogle Scholar
- Hawamdeh S, Fakhry R. Therapeutic relationships from the psychiatric nurses’ perspectives: An interpretative phenomenological study. Perspect Psychiatr Care. 2014;50(3):178–85.View ArticlePubMedGoogle Scholar
- Hopkins JE, Loeb SJ, Fick DM. Beyond satisfaction, what service users expect of inpatient mental health care: a literature review. J Psychiatr Ment Health Nurs. 2009;16(10):927–37.View ArticlePubMedGoogle Scholar
- Binnema D. Interrelations of psychiatric patient experiences of boredom and mental health. Issues Ment Health Nurs. 2004;25(8):833–42.View ArticlePubMedGoogle Scholar
- Megens Y, Van Meijel B. Quality of life for long-stay patients of psychiatric hospitals: a literature study. J Psychiatr Ment Health Nurs. 2006;13(6):704–12.View ArticlePubMedGoogle Scholar
- Cameron D, Kapur R, Campbell P. Releasing the therapeutic potential of the psychiatric nurse: a human relations perspective of the nurse-patient relationship. J Psychiatr Ment Health Nurs. 2005;12(1):64–74.View ArticlePubMedGoogle Scholar
- Duxbury J, Wright K, Bradley D, Barnes P. Administration of medication in the acute mental health ward: perspective of nurses and patients. Int J Ment Health Nurs. 2010;19(1):53–61.View ArticlePubMedGoogle Scholar
- Sharac J, McCrone P, Sabes-Figuera R, Csipke E, Wood A, Wykes T. Nurse and patient activities and interaction on psychiatric inpatients wards: a literature review. Int J Nurs Stud. 2010;47(7):909–17.View ArticlePubMedPubMed CentralGoogle Scholar
- Bee P, Playle J, Lovell K, Barnes P, Gray R, Keeley P. Service user views and expectations of UK-registered mental health nurses: a systematic review of empirical research. Int J Nurs Stud. 2008;45(3):442–57.View ArticlePubMedGoogle Scholar
- Schroeder R. The seriously mentally ill older adult: perceptions of the patient-provider relationship. Perspect Psychiatr Care. 2013;49(1):30–40.View ArticlePubMedGoogle Scholar
- Hall JE. Restriction and control: the perceptions of mental health nurses in a UK acute inpatient setting. Issues Ment Health Nurs. 2004;25(5):539–52.View ArticlePubMedGoogle Scholar
- Coffey M, Hewitt J. “You don”t talk about the voices’: voice hearers and community mental health nurses talk about responding to voice hearing experiences. J Clin Nurs. 2008;17(12):1591–600.View ArticlePubMedGoogle Scholar
- McCann TV, Baird J, Clark E, Lu S. Mental health professionals’ attitudes towards consumer participation in inpatient units. J Psychiatr Ment Health Nurs. 2008;15(1):10–6.View ArticlePubMedGoogle Scholar
- Ahmead MK, Rahhal A, Baker J. The attitudes of mental health professionals towards patients with mental illness in an inpatient setting in Palestine. Int J Ment Health Nurs. 2010;19(5):356–62.View ArticlePubMedGoogle Scholar
- Cahill J, Paley G, Hardy G. What do patients find helpful in psychotherapy? Implications for the therapeutic relationship in mental health nursing. J Psychiatr Ment Health Nurs. 2013;20(9):782–91.PubMedGoogle Scholar
- Kemmis S, Mctaggart R. In: Norman K, Denzin YSL, editors. Participatory Action Research. 3rd ed. London: Strategies of Qualitative Inquiry; 2008. p. 271–330.Google Scholar
- Abad Corpa E, Delgado Hito P, Cabrero GJ. La investigación-acción-participativa. Una forma de investigar en la práctica enfermera. (The Participatory-Action-Research. A way to research in the nursing practice). Rev Investig y Educ en Enfermería. 2010;28(3):464–74.Google Scholar
- Tashakkori A, Teddlie C, editors. Handbook of mixed methods in social and behavorial research. Thousand Oaks: Sage Publications; 2003.Google Scholar
- Abad-Corpa E, Cabrero-García J, Delgado-Hito P, Carrillo-Alcaraz A, Meseguer-Liza C, Martínez-Corbalán JT. Effectiveness of participatory-action-research to put in practice evidence at a nursing onco-hematology unit. Rev Lat Am Enfermagem. 2012;20(1):59–67.View ArticlePubMedGoogle Scholar
- Valles MS. Técnicas cualitativas de investigación social. Reflexión metodológica y práctica profesional. In: Qualitative social research techniques. Methodological reflection and professional practice. 3rd ed. Madrid: Sintesis Editorial; 2003.Google Scholar
- Callejo J. Observación, entrevista y grupo de discusión: El silencio de tres prácticas de investigación. (Observation, Interview and Discussion group: the Silence of Three Research Practices). Rev Esp Salud Publica. 2002;76:409–22.View ArticleGoogle Scholar
- Atkins S, Murphy K. Reflection: a review of the literature. J Adv Nurs. 1993;18(8):1188–92.View ArticlePubMedGoogle Scholar
- Taylor SJ, Bogdan R. Introducción a los métodos cualitativos de investigación. (Introduction to qualitative research methods). Ediciones Paidós Básica: Barcelona; 1987.Google Scholar
- Horvath AO, Greenberg LS. Development and validation of the Working Alliance Inventory. J Couns Psychol. 1989;36(2):223–33.View ArticleGoogle Scholar
- Davis MH. Measuring individual differences in empathy: Evidence for a multidimensional approach. J Pers Soc Psychol. 1983;44(1):113–26.View ArticleGoogle Scholar
- Corbella S, Botella L, Gómez AM, Herrero O. Características psicométricas de la versión española del Working Alliance Inventory-Short (WAI-S). (Psychometric propierties of Spanish versión of Working Alliance Inventory-Short (WAI-S)). An Psicol. 2011;27(2):298–301.Google Scholar
- Pérez-Albéniz A, De PJ, Etxeberría J, Montes MP, Torres E. Adaptación de Interpersonal Reactivity Index (IRI) al español. (Spanish adaptation of the Interpersonal Reactivity Index). Psicothema. 2003;15(2):267–72.Google Scholar
- Mayring P. Qualitative Content Analysis. Forum Qualitative Sozialforschung (Forum: Qualitative Social Research)[Internet]. 2000; 1(2), 20. Available from: http://nbn-resolving.de/urn:nbn:de:0114-fqs0002204
- Campos CJG, Turato ER. Content analysis in studies using the clinical-qualitative method: application and perspectives. Rev Lat Am Enfermagem. 2009;17(2):259–64.View ArticlePubMedGoogle Scholar
- Carrillo-González GM, Gómez-Ramírez OJ, Vargas-Rosero E. Meta-synthesis: a research methodology. Rev Salud Pública Instituto de Salud Publica, Facultad de Medicina - Universidad Nacional de Colombia. 2007;9(4):609–17.Google Scholar