Advanced Search

Journal Navigation

Journal Home

Subscriptions

Archive

Contact Us

Table of Contents

Click here to sign up for SAGE Journal Email Alerts today!

Sign In to gain access to subscriptions and/or personal tools.
Organizational Research Methods
This Article
Right arrow Full Text (PDF)
Right arrow All Versions of this Article:
1094428106296642v1
11/4/815    most recent
Right arrow References
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Right arrow Citation Map
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Alert me to new issues of the journal
Right arrow Add to Saved Citations
Right arrow Download to citation manager
Right arrowRequest Permissions
Right arrow Request Reprints
Right arrow Add to My Marked Citations
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via Web of Science (10)
Right arrow Citing Articles via Google Scholar
Right arrow Citing Articles via Scopus
Google Scholar
Right arrow Articles by LeBreton, J. M.
Right arrow Articles by Senter, J. L.
Right arrow Search for Related Content
Social Bookmarking
Add to CiteULike   Add to Complore   Add to Connotea   Add to Del.icio.us   Add to Digg   Add to Reddit   Add to Technorati   Add to Twitter  
What's this?

Answers to 20 Questions About Interrater Reliability and Interrater Agreement

James M. LeBreton

Purdue University, lebreton{at}psych.purdue.edu

Jenell L. Senter

Wayne State University

The use of interrater reliability (IRR) and interrater agreement (IRA) indices has increased dramatically during the past 20 years. This popularity is, at least in part, because of the increased role of multilevel modeling techniques (e.g., hierarchical linear modeling and multilevel structural equation modeling) in organizational research. IRR and IRA indices are often used to justify aggregating lower-level data used in composition models. The purpose of the current article is to expose researchers to the various issues surrounding the use of IRR and IRA indices often used in conjunction with multilevel models. To achieve this goal, the authors adopt a question-and-answer format and provide a tutorial in the appendices illustrating how these indices may be computed using the SPSS software.

Key Words: interrater agreement • interrater reliability • aggregation • multilevel modeling

This version was published on October 1, 2008

Organizational Research Methods, Vol. 11, No. 4, 815-852 (2008)
DOI: 10.1177/1094428106296642
Add to CiteULike CiteULike   Add to Complore Complore   Add to Connotea Connotea   Add to Del.icio.us Del.icio.us   Add to Digg Digg   Add to Reddit Reddit   Add to Technorati Technorati   Add to Twitter Twitter    What's this?


This article has been cited by other articles:


Home page
 Small Group ResearchHome page
M. Jackson and R. L. Moreland
Transactive Memory in the Classroom
Small Group Research, October 1, 2009; 40(5): 508 - 534.
[Abstract] [PDF]

Home page
 Journal of ManagementHome page
M. Kuenzi and M. Schminke
Assembling Fragments Into a Lens: A Review, Critique, and Proposed Research Agenda for the Organizational Work Climate Literature
Journal of Management, June 1, 2009; 35(3): 634 - 717.
[Abstract] [PDF]

Home page
 Group Organization ManagementHome page
A. G. Tekleab, N. R. Quigley, and P. E. Tesluk
A Longitudinal Study of Team Conflict, Conflict Management, Cohesion, and Team Effectiveness
Group Organization Management, April 1, 2009; 34(2): 170 - 205.
[Abstract] [PDF]