See also section 6.4 of http://www.psych.upenn.edu/~baron/rpsych/rpsych.html which also points to a few packages that have kappa code in them. -- Jonathan Baron, Professor of Psychology, University of Pennsylvania Home page: http://www.sas.upenn.edu/~baron