Library

A Comparison of SSI and Non-SSI Performance On State NAEP Mathematics Assessment Items

http://www.wcer.wisc.edu/SSI/AERA%202002 /a_comparison_of_ssi_and_nonx.htm

Norman L. Webb, Allan Cohen, Taehoon Kang

Wisconsin Center for Education Research

April 2, 2002

MSP Key Features / Evidence-Based Design and Outcomes
Ed Change & Policy / Systemic Change, Mathematics, Evaluation

The impact of curricular reform efforts that are incorporated into the Statewide Systemic Initiatives (SSIs) program were examined at the item level using data from the 1990, 1992, and 1996 NAEP state administrations. The item-level data from the State NAEP for grade 8 from 1990, 1992, and 1996 and for grade 4 from 1992, and 1996 were examined applying methodology developed for the study of differential item functioning (DIF) under Item Response Theory. The results suggest that there are some important differences in item functioning between SSI and non-SSI states. Eighth grade Students in SSI states in 1992 and 1996 appear more likely to perform better than those in non-SSI states on items reflecting curricular reforms associated with the NCTM Standards. At grade 4, the earlier differences between SSI states and non-SSI states declined, indicating that SSI states became more comparable with the non-SSI states in the underlying constructs being tested.

10/14/2004