Acceso usuarios
Philip L. Roth, Philip Bobko, Maury A. Buster
Situational judgment tests ( SJTs) have become popular in recent years. Yet, there is little research on how the constructs targeted within SJTs influence standardized ethnic group differences. Further, most research in this area is subject to differential range restriction concerns that hinder understanding of the role of constructs. We report on scale-level data from four jobs in which SJTs were part of the first major hurdle of selection, thus providing an analysis of how constructs might relate to standardized group differences when range restriction concerns are minimized. Results indicate that cognitively saturated scales were associated with d values of 0.56 and 0.76, while interpersonal items were associated with d values of 0.07, 0.20, and 0.50. Based on the obtained ds, we simulated hiring and obtained adverse impact ratios to help interpret these values of d for decision-makers. Overall, we demonstrate the importance of examining constructs and gathering data at the applicant level of analyses when attempting to understand SJT d values (and any associated adverse impact). Practitioner points The constructs targeted by SJTs may influence ethnic group differences, such that cognitively-related items/scales may lead to larger group differences than scales targeting interpersonal skills., It can be useful to compare SJT ds based on both job applicant samples and targeted constructs during test development and during consideration of alternative predictors. [ABSTRACT FROM AUTHOR]
