This backgrounder by the UFT Research Dept. was recently released to reporters. The Trial Urban Districts Assessment results for the big U.S. cities will be published on Wednesday, Dec. 18. They come out every two years and break out the performance of large U.S. cities on National Assessment of Educational Progress tests. We review results from 2003 to 2011 and include statewide results for 2013, which came out in November. TUDA scores show New York City’s performance stagnating since 2009 while other cities showed growth. They suggest the limitations of a test-driven system pegged to mediocre assessments.
TUDA results for New York City will be exceptionally important this year. While Mayor Bloomberg has highlighted selected indicators of improvement during his tenure, the Trial Urban District Assessment results will be a final, objective assessment of student progress during the Bloomberg years. They will also allow us to measure New York City against other major urban districts, including Boston, Chicago, Los Angeles, Washington, DC, Houston, Atlanta, and a large-U.S. cities average.
What TUDA results have showed so far — and 2011 was the last time they were updated — is that New York City’s 4th- and 8th-graders have improved in 4th grade math and reading and 8th grade math, but not as much as their peers in other major cities. On 8th-grade reading between 2003 and 2011, the city showed an especially disturbing trend of no improvement. New York used to lead among urban districts. But city scores have moved towards the middle of the pack of major urban school systems over the past decade.
NAEP/TUDA — The “Gold Standard”
Our state tests underwent three major overhauls between 2003 and 2013, but the National Assessment of Education Progress from which the TUDA scores are drawn remained unchanged. This is why they are often referred to as a “gold standard,” by providing a reliable, clearly comparable look at student progress over time.
NAEP tests representative samples of 4th- and 8th-grade students in math and reading every two years. State by state results have been published by the U.S. Education Department’s National Center for Education Statistics since 1992. In the last decade, results have been made available for individual urban districts as TUDA.
The TUDA cities include 21 major urban districts, such as Atlanta, Chicago, Los Angeles and Houston. The report also includes a large-city average of all U.S. cities with a population of 250,000 or more. The average provides a quick, valuable way to compare NYC students to their big-city peers nationwide.
The 2013 state NAEP results came out on Nov. 6. New York State (which includes New York City) went up a small amount, two points on a 500-point scale, in 4th-grade math and reading and 8th-grade math; 8th-grade reading results were flat. Since New York City students make up one-third or more of the total state, the city’s TUDA results should more or less track the state results.
Math – Recovery Needed
Fourth Grade Math
Between 2003 and 2007, New York City’s 4th-graders gained 10 scale-score points, equivalent to about a year’s worth of learning, in math. But then progress stalled. Fourth graders actually lost three scale-score points between 2009 and 2011. Statewide over this same time period, 4th-graders lost a similar 3 points. Meanwhile, the overall national average continued to rise, as did the average for large-city districts.
New York State 4th-graders recovered some of their losses on the 2013 NAEP tests published in November, though they have still not returned to their 2007 high. All things being equal, we expect the city’s 4th-graders to recover a similar two points.
Compared with the large city average, NYC’s 4th-graders made less progress in math from 2003 to 2011. Gains were also greater in Atlanta, Boston, Chicago, Washington, DC, Houston and San Diego.
Eighth Grade Math
In 2003, NYC 8th-graders outscored the large-city average by four points. But by 2011 the lines had crossed, with the city’s 8th-graders actually backsliding and performing slightly below the large-city average.
This year’s 2013 NAEP score for New York State showed a two-point recovery, and we hope for the same uptick for the city. However, other large cities did not slip in 2011 and have showed greater gains over the last eight years, so it could be that NYC’s former advantage over other urban districts has been erased.
Every large city but one has improved more in 8th-grade math than New York since 2003. New York’s six-point gain is thoroughly eclipsed by a large-city average gain of 12 points, while comparable cities such as Chicago and Los Angeles have gained 16 points, Atlanta has gained 22, and Boston 20 points.
NAEP scores are also reported by percentages of students at “basic,” “proficient,” and “advanced.”
In math, 33 percent of New York City’s 4th-graders scored at proficient or advanced in 2011. Between 2003 and 2011, the share of proficient or advanced students rose by 11 percentage points, about the middle of the distribution, with Boston a clear leader (up 20 points to 43 percent proficient).
For 8th-grade math, 24 percent of New York City’s students scored proficient or advanced in 2011, below the large-city average of 26 percent. Since 2003, New York 8th-graders at proficient or above has increased by three points, well below the large-city gain of 10 proficiency points.
Comparing NAEP results to New York’s new state tests is more plausible since the state switched to the new Common Core assessments. They are closely pegged to NAEP achievement levels and designed to predict college readiness. On the 2013 state tests, 35 percent of 4th-graders and 26 percent of 8th-graders were at or above the proficient level, just a hair above the TUDA 2011 results (of 33 and 24 percent). This might suggest there will be small gains on TUDA. However, it also shows that fewer than one-third of students are on track for college-level work.
Reading – Trouble In Middle Schools
Fourth Grade Reading
Up through 2009, 4th grade reading scores rose in NYC. Along with their peers in many other urban districts, NYC 4th-graders made good progress. But the city’s scores took a dip in 2011, while large cities on average continued to make gains. The city as of 2011 still hovered five points above the large-city average and should be able to maintain that lead.
This year’s 2013 NAEP score for New York State increased two points, so the city will probably show an increase as well (remember, city students are about one-third of the state population).
New York City’s gains in 4th-grade reading are comparable to most other large cities.
Eighth Grade Reading
Eighth grade reading is another story. New York City scores have been virtually unchanged since 2003, finally inching up two points in 2011, while every other TUDA city but one has made more progress. The city score dropped below the large-city average in 2011 for the first time.
New York State 8th-grade reading performance has also been flat since 1998. On the 2013 NAEP, 8th-graders again made no gains, which could suggest there will be little gain on the city’s TUDA either.
Other cities have had substantially more success on improving 8th-grade reading.
On the New York State tests for 2013, 27 percent of 4th graders and 25 percent of 8th graders met or exceeded the proficiency cutoffs, compared with 36 percent of city 4th-graders and 26 percent of 8th-graders at or above proficiency on the 2011 TUDA.
By 8th-grade, students should be proficient readers, well on their way to making inferences, analyzing text and making and supporting judgments. That just 26 percent of the city’s 8th-graders demonstrated such proficiency on TUDA in 2011 means that three-quarters of next year’s incoming freshmen will be no better prepared to succeed in high school than were incoming high school students 10 years ago.