can anyone give me an opinion
I am trying to render interrater and intrarater kappa reliability scores
with data derived from a content analysis procedure
questions about SAS kappa
Is it possible to derive a kappa interrater/intrarater reliability score
from this content analysis protocol/procedure and 3 raters using SAS
6.10.2 ?
Is a Cohen's kappa possible, accurate, or feasible, with SAS 6.10.2
Macintosh in trying to derive an interrater/intrarater reliability score
?
The text/content from 70 research subjects' written responses is coded
using a content analysis protocol/procedure with 60 (discrete) categories
there are 3 independent raters /coders
- 3 independent raters code the written response of each research subject
(each research subjects' written response is coded 3 x )
- each category (D0 - H12) identifies a specific concept used to code
each research subject's written response
subject#1 subject#2--- subject#70
D0
D1
D2
|
D 9
F0
F1
F 2
|
|
H 12
coding the text involves recording a code (D1) every time a particular
category is identified in the text of the research subject's written
response
scoring a research subjects written response entails assigning a tally
mark for each category coded and summing them up
so that each cell (category and research subject) can have a
(potentially) unlimited number of tally marks (whereas in practice none is
over 15) depending on the nature of the written response
Is it possible/feasible/accurate to derive a kappa interrater/intrarater
reliability score with this content analysis protocol/procedure and 3
raters using SAS 6.10.2 ?
--
Robert Kujda Purdue University
Division of Art and Design - Department of Visual and Performing Arts
Curriculum and Instruction CA-1 West Lafayette, IN 47907
765 494-3058 [EMAIL PROTECTED]
have an Aesthetic Experience
/\__/|
(\ ____ \ , , \______ _
\\_/ __ = _ o= _____ o/ /o
===========================================================================
This list is open to everyone. Occasionally, people lacking respect
for other members of the list send messages that are inappropriate
or unrelated to the list's discussion topics. Please just delete the
offensive email.
For information concerning the list, please see the following web page:
http://jse.stat.ncsu.edu/
===========================================================================
