This Article Full Text (PDF) References Alert me when this article is cited Alert me if a correction is posted Citation Map Services Email this article to a friend Similar articles in this journal Alert me to new issues of the journal Add to Saved Citations Download to citation manager Request Permissions Request Reprints Add to My Marked Citations Citing Articles Citing Articles via HighWire Citing Articles via Google Scholar Citing Articles via Scopus Google Scholar Articles by Penny, J. A. Search for Related Content Social Bookmarking                         What's this?

Exploring Differential Item Functioning in a 360-Degree Assessment: Rater Source and Method of Delivery

Castle Worldwide, Inc.

This research used logistic regression to model item responses from a popular 360-degree assessment-for-development survey. The model used method of survey delivery and rater group to identify items exhibiting differential item functioning (DIF). The methods of survey delivery were pencil-and-paper and online by Web page. The rater groups were self, boss, peer, and direct report. The sample consisted of 374 survey families where a survey family was a set of four surveys: self, boss, peer, and direct report. Half the survey families were pencil-and-paper administration; half were online administration. The flagging procedure used effect size from Wald chi-square statistics. Results indicated little evidence that DIF existed due to method of survey delivery, lending additional support for the use of the Internet to deliver 360-degree surveys. Approximately 10% of items exhibited DIF attributable to rater group, though in every instance the magnitude of the DIF was small, suggesting that the impact of DIF on the 360-degree feedback could be slight. There was no evidence of an interaction between method of delivery and rater group. The maximum likelihood parameter estimates indicated DIF resulted from either hierarchical complexity or contingency theory. This research suggested that such forms of DIF could be naturally occurring phenomena in 360- degree assessment because both contingency and complexity can influence the perceptions by raters of a manager’s performance.

Organizational Research Methods, Vol. 6, No. 1, 61-79 (2003)
DOI: 10.1177/1094428102239426


CiteULike    Complore    Connotea    Del.icio.us    Digg    Reddit    Technorati    Twitter    What's this?

This article has been cited by other articles:

				R. Gomez Australian Parent and Teacher Ratings of the DSM-IV ADHD Symptoms: Differential Symptom Functioning and Parent-Teacher Agreement and Differences J Atten Disord, July 1, 2007; 11(1): 17 - 27. [Abstract] [PDF]

				J. T. Kulas and L. M. Finkelstein Content and Reliability of Discrepancy-Defined Self-Awareness in Multisource Feedback Organizational Research Methods, July 1, 2007; 10(3): 502 - 522. [Abstract] [PDF]

				P. E. Levy and J. R. Williams The Social Context of Performance Appraisal: A Review and Framework for the Future Journal of Management, December 1, 2004; 30(6): 881 - 905. [Abstract] [PDF]