Dear Tipsters, Reminds me of these very interesting papers on examiner error in the WAIS:
Ryan, J. J., Prifitera, A., & Powers, L. (1983). Scoring reliability on the WAIS-R. Journal of Consulting and Clinical Psychology, 51(1), 149-150. Ryan, J. J., & Schnakenberg-Ott, S. D. (2003). Scoring reliability on the Wechsler adult intelligence scale-third edition (WAIS-III). Assessment, 10 (2), 151-159. There was greater variation among experienced examiners than among graduate students. Sincerely, Stuart ______________________________ "Recti Cultus Pectora Roborant" Stuart J. McKelvie, Ph.D., Department of Psychology, Bishop's University, 2600 rue College, Sherbrooke (Borough of Lennoxville), QC J1M 1Z7, Canada. (819)822-9600X2402 "Floreat Labore" ______________________________ From: Mike Wiliams [mailto:jmicha5...@aol.com] Sent: Sunday, July 06, 2014 2:32 AM To: Teaching in the Psychological Sciences (TIPS) Subject: [tips] Whose IQ Is It? Paul A. McDermott, P A, Watkins, M W & Rhoad, A M (2014). Whose IQ Is It?-Assessor Bias Variance in High-Stakes Psychological Assessment, Psychological Assessment, Vol. 26, No. 1, 207-214 http://edpsychassociates.com/Papers/IQassessorBias(2014).pdf<http://edpsychassociates.com/Papers/IQassessorBias%282014%29.pdf> This is a remarkable paper. If you need to discuss the advantages and disadvantages of IQ tests, here is a new angle. From the point of view of clinical assessment, my summary is that the findings indicate how the Wechsler Scales are so poorly designed. This exposes some big holes in the scoring of the tests that could be easily remedied by design changes. Take the examiner out of the scoring. Subtests in multiple choice format did not suffer from examiner defects in scoring. I was surprised by the magnitude of error. The examiners were probably just expressing the uncertainty in assigning scores that apply to any group of examiners. The first sentence of the Discussion (see below) is a compelling indictment of the profession and the Wechsler scales. Maybe we can get the blinders off and fix the tests. It is unlikely we can fix the examiners. "The degree of assessor bias variance conveyed by FSIQ and VCI scores effectively vitiates the usefulness of those measures for differential diagnosis and classification, particularly in the vicinity of the critical cut points ordinarily applied for decision making." Mike Williams --- You are currently subscribed to tips as: smcke...@ubishops.ca<mailto:smcke...@ubishops.ca>. To unsubscribe click here: http://fsulist.frostburg.edu/u?id=13510.2cc18398df2e6692fffc29a610cb72e3&n=T&l=tips&o=37468 (It may be necessary to cut and paste the above URL if the line is broken) or send a blank email to leave-37468-13510.2cc18398df2e6692fffc29a610cb7...@fsulist.frostburg.edu<mailto:leave-37468-13510.2cc18398df2e6692fffc29a610cb7...@fsulist.frostburg.edu> --- You are currently subscribed to tips as: arch...@jab.org. To unsubscribe click here: http://fsulist.frostburg.edu/u?id=13090.68da6e6e5325aa33287ff385b70df5d5&n=T&l=tips&o=37470 or send a blank email to leave-37470-13090.68da6e6e5325aa33287ff385b70df...@fsulist.frostburg.edu
