Organizational Research Methods

 

Advanced Search

Journal Navigation

Journal Home

Subscriptions

Archive

Contact Us

Table of Contents

Register here to gain access to SAGE's 500+ Journals Online

Click here to sign up for SAGE Journal Email Alerts today!

Sign In to gain access to subscriptions and/or personal tools.
This Article
Right arrow Full Text (PDF)
Right arrow References
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Right arrow Citation Map
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Alert me to new issues of the journal
Right arrow Add to Saved Citations
Right arrow Download to citation manager
Right arrowRequest Permissions
Right arrow Request Reprints
Right arrow Add to My Marked Citations
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Craig, S. B.
Right arrow Articles by Kaiser, R. B.
Right arrow Search for Related Content
Social Bookmarking
Add to CiteULike   Add to Connotea   Add to Del.icio.us   Add to Digg   Add to Reddit   Add to Technorati  
What's this?
Organizational Research Methods, Vol. 6, No. 1, 44-60 (2003)
DOI: 10.1177/1094428102239425

Applying Item Response Theory to Multisource Performance Ratings: What are the Consequences of Violating the Independent Observations Assumption?

S. Bartholomew Craig

North Carolina State University Kaplan DeVries Inc., bart_craig{at}ncsu.edu

Robert B. Kaiser

Kaplan DeVries Inc., rkaiser{at}kaplandevries.com

Multisource performance ratings involve multiple raters of a common target, thus violating the statistical assumption of independent observations. This study investigated the consequences of that violation on item response theory–based analyses of ratings in two domains of managerial performance. Using a differential item functioning framework, the authors found no significant differences in item parameters attributable to the violation. This finding suggests that item response theory can be applied to multisource ratings without discarding data in order to meet the independence assumption.


Add to CiteULike CiteULike   Add to Connotea Connotea   Add to Del.icio.us Del.icio.us   Add to Digg Digg   Add to Reddit Reddit   Add to Technorati Technorati    What's this?


This article has been cited by other articles:


Home page
 J Atten DisordHome page
R. Gomez
Australian Parent and Teacher Ratings of the DSM-IV ADHD Symptoms: Differential Symptom Functioning and Parent-Teacher Agreement and Differences
J Atten Disord, July 1, 2007; 11(1): 17 - 27.
[Abstract] [PDF]

Home page
 Organizational Research MethodsHome page
J. T. Kulas and L. M. Finkelstein
Content and Reliability of Discrepancy-Defined Self-Awareness in Multisource Feedback
Organizational Research Methods, July 1, 2007; 10(3): 502 - 522.
[Abstract] [PDF]

Home page
 Organizational Research MethodsHome page
J. M. Lebreton, J. R. D. Burgess, R. B. Kaiser, E. K. Atchley, and L. R. James
The Restriction of Variance Hypothesis and Interrater Reliability and Agreement: Are Ratings from Multiple Sources Really Dissimilar?
Organizational Research Methods, January 1, 2003; 6(1): 80 - 128.
[Abstract] [PDF]