全球智库信息集成服务系统

The school composition of MAP Growth test-takers has shifted over time, and this could affect school-aggregate test scores

• Participation in MAP Growth assessments was lower in 2020–2021 than in pre-pandemic years. Of students taking MAP assessments in spring 2019, 42 percent were assessed again in spring 2021, and 21 percent of these test-takers attended the same schools across these two school years.
• Within and among districts, there was wide variability in the percentage of students who attended the same schools and participated in assessments over two academic years.
• Participation in assessments was uneven in 2020–2021. Students of color were less likely than white students to have attended the same schools and participated in assessments over two academic years.
• Historically higher-achieving students who participated in assessments in a given year were more likely than their peers to have attended the same schools and participated in assessments over two academic years.
• Schools serving high-poverty and COVID-19–vulnerable communities had systematically fewer students attend the same school and participate in assessments over two academic years than other schools.

The following insights about test participation could help guide school systems as they report school-level test score information from spring 2021 and implement restart and recovery plans

• Comparing spring 2021 school-aggregate test scores with those from spring 2019 might misrepresent school progress or pandemic impacts.
• Comparing spring 2021 aggregates among schools might misrepresent the relative performance of schools.
• Information about low and differential participation in spring 2021 testing should be transparently reported.

School officials regularly use school-aggregate test scores to monitor school performance and make policy decisions. After the U.S. Department of Education offered assessment waivers to all 50 states in 2019–2020, many educators and policymakers advocated for assessment programs to be restarted in the 2020–2021 school year to evaluate the state of teaching and learning and to inform policies for recovery from the coronavirus disease 2019 (COVID-19) pandemic. However, the use of school-aggregate test scores for these purposes relies on the assumption that differences in aggregate scores can be accurately interpreted as representing real and meaningful differences in school progress and performance. There are serious concerns about the accuracy of such interpretations even under routine schooling conditions, but the pandemic may exacerbate these issues and further compromise the comparability of these test scores. In this report, RAND researchers investigate one specific issue that may contaminate utilization of COVID-19–era school-aggregate scores and result in faulty comparisons with historical and other proximal aggregate scores: changes in school composition over time. To investigate this issue, they examine data from NWEA's Measures of Academic Progress (MAP) Growth assessments, interim assessments used by states and districts during the 2020–2021 school year.

• Skip to page content

Objective Analysis. Effective Solutions.