USA Today Uncovers Widespread Evidence of K-12 Test-Score Inflation

My friend Greg Toppo and the rest of the education reporting team at USA Today have produced a must-read series on standardized testing irregularities around the country. Culling student achievement data from 24,000 public schools in six states and Washington, D.C., the team identified 1,610 instances in which test score gains from year to year exceeded three standard deviations–a jump greater than that of 99.7 percent of all test-takers annually in any given state, the threshold at which statisticians agree that test results may be suspect. 

In some cases, these jumps were due to outright cheating, such as a teacher using an eraser to correct students' answers on a multiple choice exam. In others, the causes remain mysterious because school districts–especially those under pressure to meet the requirements of No Child Left Behind–are reluctant to launch investigations into "good news" test scores:

That was the case at Charles Duval Elementary School in Gainesville, Fla., where math scores in the fifth grade rose sharply year after year. In 2005, the school's fourth-graders finished near the bottom of the state, in the 5th percentile. The next year, 2006, as fifth-graders, they scored in the 79th percentile. Duval fifth-grade classes repeated the feat the next two years, and, by 2008, they were testing in the 91st percentile.

Then, in 2009, Duval's test scores took a nose dive. Math scores as well as reading scores crashed, and the fifth-graders finished in the 1st percentile, at the very bottom, on both tests. The school overall dropped in state rankings from an "A" school — among the best in the state — to an "F" school. Only then did the state step in, but not to investigate how the high scores were achieved. Instead, the state sent education specialists to help the school get back on track.

Linda Perlstein, author of the wonderful book Tested, points out that aggressive teaching to the test could account for these fantastic score gains, and that teaching to the test–even in a highly scripted, curriculum-narrowing way–is not, alas, against the rules. In fact, it's often encouraged by adminstrators, as it was in this case:

The third-grade teacher I followed for my book Tested had a good sense of what was going to be on the Maryland School Assessment. The exam, and the benchmark tests designed in its image, didn’t change a whole lot from year to year—there were certain constructs that showed up again and again, and certain questions too. One question she’d come to expect was, “How do you know such-and-such is a poem?” The standard tested was identifying the elements of a poem. We all know that the best way to ingrain an enduring understanding of poetry is to have students not just read poems but to engage with them—especially, to write them. These kids didn’t do that. More than 30 times the teacher had the kids copy some form of this paragraph from the overhead projector: I know this is a poem because it has rhyme, stanzas and rhythm. It has rhyme because sea and free rhyme. It has stanzas because the paragraphs don’t indent. It has rhythm because…

These are the unintended consquences of well-intentioned standards-and-accountability education reforms. If you're looking for a clear-headed, easy-to-understand discussion of why high-stakes tests almost inevitably lead to narrowed curricula and widespread score inflation, pick up Harvard psychometrician Daniel Koretz's Measuring Up: What Educational Testing Really Tells Us. Here are some choice nuggets from chapter 10, "Inflated Test Scores:"

People will argue, "There is nothing wrong with the items on the test, so what is wrong with focusing our teaching on them?" … The problem is not bad material on the test; it is that the material on the test is only a small sample of what matters. … The acid test is whether the gains in scores produced by test preparation truly represent meaningful gains in student achievement. We should not care very much about a score on a particular test…What we should be concerned about is the proficiency, the knowledge and skills, that the test score is intended to represent. Gains that are specific to a particular test and that do not generalize to other measures and to performance in the real world are worthless. 

5 thoughts on “USA Today Uncovers Widespread Evidence of K-12 Test-Score Inflation

  1. Rochelle Dolim

    I live in an area where one school district had a 100% graduation rate at their ‘alternative’ high school. The way they accomplished this was to ‘dumb down’ what they’d present as curriculum and attach the test sheet to the printouts .. .all anyone had to do to get a diploma was copy what had been handed them.
    For 2 students who would better have benefitted from twice recommended in IEEs electronic based education (18.0 grade level comprehension), who wanted to be a volcanologist, they gave printouts which said there were no 5.0 or above seismic events in the ‘continental’ United States between 1917 and the 1980 eruption of Mt. St Helens – St. Louis, Seattle, Yellowstone, Long Beach, El Centro, Sylmar, Nome, Anchorage, etc (totaling 35) seem to not be part of the ‘continental’ United States.
    When that district split into two and continuity of service was picked up by the new school district, they refused to reconsider the exisiting graduation credits.
    These two school district and the USOE would prefer tracking two intelligent young women whose needs they aren’t willing to meet into a life of dependency on public assistance.
    I’ve tried contacting the superintendent of the new school district … he’s ignored me every time but one – when there was something in it for them, a gift he didn’t have the basic decency and civility to acknowledge.

    Reply
  2. DFP

    If I did not receive a response from the superintendent or school district, I would take it directly to the school board.

    Reply
  3. Ecobeagl

    The portion of this article on Duval Elementary in Gainesville, FL leaves out a big part of the story.

    For the years when the school’s fifth grade math scores showed continual increases, the fifth grade students were blessed to have an amazing master teacher, Ms. Gloria Merriex, who both taught and inspired every student in the fifth grade each year.

    Sadly, in Spring 2008, Ms. Merriex passed away quite suddenly, leaving the school in shock and distress. It was no surprise for those of us who know and work with the school to see the sharp decline in the 2009 scores. It was impossible to replace Gloria and keep the scores high.

    If you would like to know more, there is a documentary made about this amazing teacher’s success – link to de-de.facebook.com

    Please be sure you understand context before you slander a school as possibly cheating their way to good test scores.

    Reply
  4. Lucky Teacher

    In my school district there are no neighborhood high schools. Parents submit requests and the district uses a convoluted algorithm to make assignments.

    When our high school was second lowest in test scores, suddenly the district gave us more students from the “better” middle schools. Now our test scores are on top and certain other schools are rated as “failing.” No school will ever stay on the failing list for long because the district will shuffle around the “good” students. Watch out! In the next two years my high school will go down in test scores proving that the teachers are doing a bad job. Clever huh?

    Reply

Leave a Reply

Your email address will not be published. Required fields are marked *

You may use these HTML tags and attributes: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <strike> <strong>