Skip to main content

Table 4 Point estimates of inter-rater reliability tests per NIC domain

From: Assessing time use in long-term institutional care: development, validity and inter-rater reliability of the Groningen Observational instrument for Long-Term Institutional Care (GO-LTIC)

Domain labels (number of observationsa)

Number of residents

Occurrence (CI)b

Non-occurrence (CI)b

Cohen’s Kappa (CI)b

ICC Single (CI)b

Physiological: basic, 47 interventions

     

 Observers 3 & 4 (47*11 = 517)

11

0.97 (0.96–0.98)

0.97 (0.95–0.98)

0.78 (0.67–0.89)

0.64 (0.14–0.89)

 Observers 2 & 4 (470)

10

0.99 (0.98–1.00)

0.99 (0.97–1.00)

0.92 (0.84–0.99)

0.94 (0.54–0.99)

 Observers 3 & 1 (517)

11

0.96 (0.94–0.97)

0.96 (0.93–0.97)

0.67 (0.54–0.81)

0.97 (0.88–0.99)

 Observers 1 & 2 (846)

18

0.99 (0.99–1.00)

0.99 (0.98–1.00)

0.83 (0.69–0.97)

0.87 (0.69–0.95)

 Observers 1 & 2 (658)

14

0.98 (0.97–0.99)

0.98 (0.96–0.99)

0.79 (0.69–0.90)

0.95 (0.83–0.99)

 Observers 3 & 4 (987)

21

0.99 (0.98–1.00)

0.99 (0.98–1.00)

0.82 (0.70–0.94)

0.99 (0.99–1.00)

 Observers 3 & 4 (1081)

23

0.99 (0.99–1.00)

0.99 (0.99–1.00)

0.76 (0.60–0.93)

0.82 (0.63–0.92)

Physiological: complex, 20 interventions

     

 Observers 3 & 4 (20*11 = 220)

11

0.99 (0.97–1.00)

0.99 (0.97–1.00)

0.90 (0.77–1.00)

0.81 (0.33–0.95)

 Observers 2 & 4 (200)

10

0.99 (0.97–1.00)

0.99 (0.97–1.00)

0.94 (0.82–1.00)

0.67 (0.16–0.91)

 Observers 3 & 1 (220)

11

0.98 (0.95–0.99)

0.98 (0.95–0.99)

0.70 (0.42–0.99)

0.58 (0.05–0.87)

 Observers 1 & 2 (360)

18

0.98 (0.97–0.99)

0.98 (0.97–0.99)

0.81 (0.64–0.98)

0.48 (0.07–0.76)

 Observers 1 & 2 (280)

14

0.98 (0.96–0.99)

0.98 (0.96–0.99)

0.70 (0.43–0.96)

0.93 (0.81–0.98)

 Observers 3 & 4 (420)

21

0.99 (0.98–1.00)

0.99 (0.98–1.00)

0.88 (0.74–1.00)

0.59 (0.23–0.81)

 Observers 3 & 4 (460)

23

0.99 (0.98–1.00)

0.99 (0.98–1.00)

0.89 (0.77–1.00)

0.72 (0.44–0.87)

Behavioral, 28 interventions

     

 Observers 3 & 4 (28*11 = 308)

11

0.99 (0.98–1.00)

0.99 (0.98–1.00)

0.50 (0.00–1.00)

0.99 (0.95–1.00)

 Observers 2 & 4 (280)

10

0.99 (0.97–1.00)

0.99 (0.97–1.00)

0.40 (0.00–1.00)

0.47 (−0.09–0.83)

 Observers 3 & 1 (308)

11

1.00 (0.98–1.00)

1.00 (0.98–1.00)

0.86 (0.57–1.00)

0.43 (−0.25–0.81)

 Observers 1 & 2 (504)

18

0.99 (0.98–1.00)

0.99 (0.98–1.00)

0.78 (0.58–0.97)

0.89 (0.73–0.96)

 Observers 1 & 2 (392)

14

0.99 (0.97–1.00)

0.99 (0.97–1.00)

0.75 (0.50–0.99)

0.93 (0.80–0.98)

 Observers 3 & 4 (588)

21

1.00 (0.99–1.00)

1.00 (0.99–1.00)

0.75 (0.40–1.00)

0.21 (−0.22–0.58)

 Observers 3 & 4 (644)

23

1.00 (0.99–1.00)

1.00 (0.99–1.00)

1.00 (1.00)

0.00 (−0.40–0.40)

Safety, 6 interventions

     

 Observers 3 & 4 (6*11 = 66)

11

0.98 (0.92–1.00)

0.98 (0.92–1.00)

0.66 (0.00–1.00)

0.29 (−0.33–0.74)

 Observers 2 & 4 (60)

10

1.00 (0.94–1.00)

1.00 (0.94–1.00)

—c

0.00 (−0.60–0.60)

 Observers 3 & 1 (66)

11

1.00 (0.95–1.00)

1.00 (0.95–1.00)

—

—

 Observers 1 & 2 (108)

18

1.00 (0.97–1.00)

1.00 (0.97–1.00)

—

—

 Observers 1 & 2 (84)

14

0.99 (0.94–1.00)

0.99 (0.94–1.00)

0.00 (0.00–1.00)

—

 Observers 3 & 4 (126)

21

1.00 (0.97–1.00)

1.00 (0.97–1.00)

—

—

 Observers 3 & 4 (138)

23

0.99 (0.96–1.00)

0.99 (0.96–1.00)

0.00 (0.00–1.00)

0.00 (−0.40–0.40)

Family, 1 intervention

     

 Observers 3 & 4 (1*11 = 11)

11

0.91 (0.62–0.98)

0.83 (0.44–0.97)

0.82 (0.48–1.00)

0.43 (−0.14–0.80)

 Observers 2 & 4 (10)

10

0.70 (0.40–0.89)

0.40 (0.12–0.77)

0.40 (0.00–0.97)

0.41 (−0.13–0.80)

 Observers 3 & 1 (11)

11

0.82 (0.52–0.95)

0.67 (0.30–0.90)

0.65 (0.20–1.00)

0.80 (0.38–0.94)

 Observers 1 & 2 (18)

18

1.00 (0.82–1.00)

1.00 (0.77–1.00)

1.00 (1.00)

0.99 (0.97–1.00)

 Observers 1 & 2 (14)

14

0.93 (0.69–0.99)

0.80 (0.38–0.96)

0.84 (0.53–1.00)

0.94 (0.82–0.98)

 Observers 3 & 4 (21)

21

1.00 (0.85–1.00)

1.00 (0.74–1.00)

1.00 (1.00)

0.24 (−0.18–0.60)

 Observers 3 & 4 (23)

23

0.87 (0.68–0.96)

0.84 (0.62–0.95)

0.64 (0.27–1.00)

1.00 (−)

Health System, 14 interventions

     

 Observers 3 & 4 (14*11 = 154)

11

0.99 (0.95–1.00)

0.99 (0.95–1.00)

0.66 (0.19–1.00)

0.38 (−0.20–0.78)

 Observers 2 & 4 (140)

10

0.94 (0.89–0.97)

0.94 (0.89–0.97)

0.30 (0.00–0.77)

0.96 (0.85–0.99)

 Observers 3 & 1 (154)

11

0.94 (0.89–0.97)

0.94 (0.89–0.97)

0.65 (0.20–1.00)

0.12 (−0.48–0.65)

 Observers 1 & 2 (252)

18

0.99 (0.97–1.00)

0.99 (0.97–1.00)

0.57 (0.08–1.00)

0.03 (−0.38–0.46)

 Observers 1 & 2 (196)

14

0.93 (0.89–0.96)

0.93 (0.88–0.96)

0.63 (0.44–0.82)

0.84 (0.57–0.95)

 Observers 3 & 4 (294)

21

0.99 (0.97–1.00)

0.99 (0.97–1.00)

0.40 (0.00–1.00)

0.73 (0.44–0.88)

 Observers 3 & 4 (322)

23

0.97 (0.94–0.98)

0.96 (0.94–0.98)

0.76 (0.62–0.90)

0.64 (0.33–0.83)

  1. NH nursing home, CC care centre, combining psycho-geriatric, somatic, and residential care units, RC residential care home, NA nursing assistant, PCG primary caregiver, NA with additional training, RN registered nurse
  2. aIncluding occurrence + non-occurrence + disagree
  3. b CI95 % confidence interval
  4. c— = not possible to calculate due to too many zero’s caused by a limited number of observations
Back to article page

BMC Nursing

ISSN: 1472-6955

Contact us