Stata Help

Inputting Interrater Reliability Data: Kappa versus Kap

There are two ways to enter your data when running interrater reliability. The first method has each variable as one rater's ratings. Thus var1 is rater1, var2 is rater2, etc. If this is the case, your data should look as follows. In this case, you will use the kap command.

The second case uses frequencies. Thus, variable1 is the number of times the first rating option was assigned, variable2 is the frequency with which the second rating was assigned and all subsequent variables are the frequencies with which their respective ratings were assigned. In this second case, you will use the kappa command and your data should look as follows:

Note that these techniques are two ways of representing the exact same data. In both cases, each line is one instance of observation.