Table 6 Research findings for psychometric properties of PS and NM

Validity

Validity is questionable: face validity is fine, but concerns exist about content, construct, and other elements of validity.

Evidence supports acceptability of content, construct, and unitary concepts of validity

Reliability

Acceptable internal reliability (Cronbach’s alpha 0.77 HEI 1: 0.78 HEI 2)

Excellent internal reliability: (Cronbach’s alpha 0.94)

Consistency

Responses indirect and unsupervised, criteria are not well defined, and scoring is subjective, and inconsistent inter-marker

Responses are direct, value criteria clear and scoring is automated.

Standardisation

Administration is standardised and systematic but there are issues with test completion and marking

Administration is invigilated standardised and systematic and includes test completion and immediate scoring

Scaling, norming, and scoring

No direct response scales. Text scored subjectively. 5 category (0–4) ordinal scores on criteria. Scores cluster, many tied scores occur, distribution non- normal.

SDS scale. Direct response, automated score calculations. Interval score distributions typically approximate normality, tied scores highly unlikely.