Table 2 Appraising of the selected studies based on Mixed Method Appraisal Tool (MMAT); Version 18

Selected

Studies

Appraisal Quality

Quantitative non-randomized Criteria

Are the participants representative of the target population?

Are measurements appropriate regarding both the outcome and intervention (or exposure)?

Are there complete outcome data?

Are the confounders accounted for in the design and analysis?

During the study period, is the intervention administered (or exposure occurred) as intended?

Nowak. 2015 [19]

H

Y

Y

Y

N

Y

Lubbers et al. 2016 [20]

H

Y

Y

Y

N

Y

Lubbers et al. 2017 [21]

H

Y

Y

Y

N

Y

Higgins.2020 [22]

H

Y

Y

Y

N

Y

Cheng et al. 2020 [23]

H

Y

Y

Y

N

Y

Quantitative descriptive Criteria

Is the sampling strategy relevant to address the research question?

Is the sample representative of the target population?

Are the measurements appropriate?

Is the risk of nonresponse bias low?

Is the statistical analysis appropriate to answer the research question?

De Villiers et al. 2004 [24]

H

Y

Y

Y

Y

Y

Ibrahim.2010 [12]

H

Y

C

Y

Y

C

Wee et al. 2010 [25]

H

C

C

Y

Y

Y

Mixed methods Criteria

Is there an adequate rationale for using a mixed-methods design to address the research question?

Are the different components of the study effectively integrated to answer the research question?

Are the outputs of the integration of qualitative and quantitative components adequately interpreted?

Are divergences and inconsistencies between quantitative and qualitative results adequately addressed?

Do the different components of the study adhere to the quality criteria of each tradition of the methods involved?

Street et al. 2007[26]

H

Y

Y

Y

Y

Y

Mwanika et al. 2011 [27]

H

N

Y

Y

Y

Y

Parry et al. 2018 [28]

H

Y

Y

Y

Y

Y

Lestari et al. 2020

[29]

H

Y

Y

Y

Y

Y

Qualitative Criteria

Is the qualitative approach appropriate to answer the question?

Are the qualitative data collection methods adequate to address the research question?

Are the findings adequately derived from the data?

Is the interpretation of results sufficiently substantiated by data?

Is there coherence between qualitative data sources, collection, analysis and interpretation?

Baglin et al. 2010

[11]

H

Y

Y

Y

Y

Y

Bassi. 2011 [30]

H

Y

Y

Y

Y

Y

Peters et al. 2015 [31]

H

Y

Y

Y

Y

Y

Stricklin. 2016 [32]

H

Y

Y

Y

Y

Y

Fereidouni et al. 2017 [33]

H

Y

Y

Y

Y

Y