New research report: Estimating the Revised SAT Score and its Marginal Predictive Validity by Maria Veronica Santelices and Mark Wilson

Monday, October 1, 2012 - 10:03am

This paper explores the predictive validity of the Revised SAT (R-SAT) score as an alternative to the student SAT score. Freedle proposed this score for students who may potentially be harmed by the relationship between item difficulty and ethnic DIF observed in the test they took in order to apply to college. The R-SAT score is defined as the score minority student would have received if only the hardest questions from the test had been considered and was computed using formula score and an inverse regression approach. Predictive validity of short and long-term academic outcomes is considered as well as the potential effect on the overprediction and underprediction of grades among minorities. The predictive power of the R- SAT score was compared to the predictive capacity of the SAT score and to the predictive capacity of alternative Item Response Theory (IRT) ability estimates based on models that explicitly considered DIF and/or were based on the hardest test questions. We found no evidence of incremental validity in favor of the R-SAT score nor of the IRT ability estimates.