|
Size: 680
Comment:
|
Size: 798
Comment:
|
| Deletions are marked like this. | Additions are marked like this. |
| Line 1: | Line 1: |
| == Intraclass correlations == | |
| Line 6: | Line 7: |
| Line 7: | Line 9: |
| MS(subjects) + (k-1)MS(subjects x raters) | |
| Line 9: | Line 10: |
| Examples of its use in SPSS are given at http://www.nyu.edu/its/statistics/Docs/intracls.html | MS(subjects) + (k-1)MS(subjects x raters) where MS is the Mean square from the repeated measures analysis of variance. Examples of its use in SPSS [http://www.nyu.edu/its/statistics/Docs/intracls.html are available.] |
Intraclass correlations
An alternative, to the kappa statistic, which uses an analysis of variance output to estimate rater reliability is the intraclass correlation coefficient (ICC).
For a repeated measures anova involving k raters it follows
ICC = MS(subjects) – MS(subjects x raters)
MS(subjects) + (k-1)MS(subjects x raters)
where MS is the Mean square from the repeated measures analysis of variance.
Examples of its use in SPSS [http://www.nyu.edu/its/statistics/Docs/intracls.html are available.]
An overview of approaches to inter rater reliability including the ICC is given by Darroch and McCloud(1986).
Reference:
Darroch JN, McCloud PI (1986) Category distinguishability and observer agreement Australian Journal of Statistics 28 371-88.