This Article Full Text (PDF) All Versions of this Article: 1094428107303155v1 1094428107303155v2 11/1/114    most recent References Alert me when this article is cited Alert me if a correction is posted Services Email this article to a friend Similar articles in this journal Similar articles in Web of Science Alert me to new issues of the journal Add to Saved Citations Download to citation manager Request Permissions Request Reprints Add to My Marked Citations Citing Articles Citing Articles via HighWire Citing Articles via Web of Science (1) Citing Articles via Google Scholar Citing Articles via Scopus Google Scholar Articles by Bobko, P. Articles by Roth, P. L. Search for Related Content Social Bookmarking                         What's this?

Psychometric Accuracy and (the Continuing Need for) Quality Thinking in Meta-Analysis

Gettysburg College

Philip L. Roth

Clemson University

The four feature-topic articles advance the accuracy of meta-analytic techniques. As might be expected, most articles focus on more precise ways to aggregate all available relationships in a given topic domain. Such aggregation results in overall estimates of relationships and estimates conditional on particular moderators. However, scholars and practitioners can expect more than empirical aggregation from meta-analysis. Careful attention to underlying theory, application, and important methodological issues will result in clearer understanding and explanation. Using the situational judgment testing literature as an example, the current analysis suggests the need for much more upfront, reflective thinking about each meta-analytic study's purpose and how this thinking relates to the inclusion or choice of primary studies, analytic method, coding, and so on. For example, when the focus is on prediction, frequent use of concurrent designs may bias aggregated parameter estimates. Also, it is noted that methods and constructs continue to be confounded in the research literatures.

Key Words: meta-analysis • prediction • selection • concurrent designs

This version was published on January 1, 2008

Organizational Research Methods, Vol. 11, No. 1, 114-126 (2008)
DOI: 10.1177/1094428107303155


CiteULike    Complore    Connotea    Del.icio.us    Digg    Reddit    Technorati    Twitter    What's this?

This article has been cited by other articles:

				H. Aguinis, C. A. Pierce, and S. A. Culpepper Scale Coarseness as a Methodological Artifact: Correcting Correlation Coefficients Attenuated From Using Coarse Scales Organizational Research Methods, October 1, 2009; 12(4): 623 - 652. [Abstract] [PDF]