[R] Different approach to set up Cohen Kappa

[Daniel Malter]

The kappa2() function in the irr library takes an n x 2 matrix as input,
where the two columns are the ratings by two raters. Let x and y below be
the ratings of the two raters:

x<-sample(c(0,1,2),100,replace=T)
x

o<-sample(c(0,0,0,1),100,replace=T)
y<-x+o
y

 #Then kappa is computed as:

kappa2(cbind(x,y))

Otherwise, your post suggest that you should start with the basics and pick
up an R manual to get acquainted with R.

HTH,
Daniel


gavfung wrote:
> 
> Hi, I just started learning R, and one of the most frequent thing that I
> need to calculate is cohen kappa in my psychology lab and I figure being
> able to do inter rater reliability is a great way for me to explore R. 
> There are two different scenario in which I need help with. (By the way, I
> have installed irr and concord.)
> 
> 1) In the lab I am working in, we go through transcripts and find certain
> words to code, and we usually compare the codes between two raters. In
> this case, the two rater can agree (both rater coded "apple" with "A"),
> have a mismatch (one rater coded "apple" with "A" but another coded it as
> "B") or a miss (a rater coded "apple" with "A" but the other rater did not
> code it at all). There are several codes with similar procedures and as
> the codes are tallied together, a chart is constructed, similar to the one
> attached( http://r.789695.n4.nabble.com/file/n3732320/example1.xls
> example1.xls ) title "example1.xls." The maroon color represents the cells
> with data, and the lavender cells is just the total in each row/column.
> 
> My question in this case is How would I calculate the Cohen Kappa for the
> cell shaded in maroon?
> 
> 2)I helped run participants over the summer for a psych summer internship
> and after coding them, I will enter the data as shown in the attachment
> title "example2.xls (
> http://r.789695.n4.nabble.com/file/n3732320/example2.xls example2.xls )
> There is also another research assistant that entered the data and I want
> to find a way to check whether we are reliable or not, and want to
> calculate reliability for the following:TimeI, TimeA, TriesI, and TriesA.
> 
> Once again, i would need to convert the excel file into csv, but aside
> from that, I am lost as to what I need to do.  Any help is appreciated! 
> Thank you!
> 

--
View this message in context: http://r.789695.n4.nabble.com/Different-approach-to-set-up-Cohen-Kappa-tp3732320p3732388.html
Sent from the R help mailing list archive at Nabble.com.