Orwell Award Announcement SusanOhanian.Org Home

The Eggplant


in the collection  

Johnny Can Read In Some States

Gerald Bracey Comment:

In the summer issue of Education Next, Paul Peterson and Rick Hess grade each state on the discrepancy between the proportion of students proficient on the state test and the proportion proficient on NAEP and the size of that discrepancy compared to the discrepancy in other states. Thus, South Carolina gets an A on 4th grade reading because 26 percent of the kids are NAEP-proficient and 31 percent are proficient on the state test whereas the average discrepancy for all states is 36 percent. You might recall that The Princeton Review did something similar a couple of years ago.

If you do poorly on both tests you get a good grade which suggests a refinement in the system is needed.

Texas gets an F because the percents are 33 and 87, on NAEP and state.

The trouble with having something like this in Education Next is that it is likely to increase the calls for NAEP to be used as the "common yardstick" to cure the babel we now have from each state uniquely defining "proficient."

That would be a disaster as the NAEP achievement levels are set absurdly high. Recall that in the original TIMSS, American 4th-graders were 3rd among 26 nations, but only something like 26 percent were proficient or better on the NAEP science assessment given in the same year (1995).

Johnny can’t read ... in South Carolina. But if his folks move to Texas, he’ll be reading up a storm. What’s going on?

It turns out that in complying with the requirements of No Child Left Behind (NCLB), some states have decided to be a whole lot more generous than others in determining whether students are proficient at math and reading. While NCLB required all states to have accountability systems in place, it did not say specifically how much students should know at the end of 4th or any other grade.

Some states have risen to the challenge and set demanding proficiency levels for their students, while others have used lower standards to inflate reported performance. Not only is the disparity confusing, but, perversely enough, the states with the highest expectations often stand accused of having the most schools said to be in need of improvement—even when their students are doing relatively well.

Because of such disparities, the states with the highest standards will be tempted to lower their threshold for determining proficiency, especially when NCLB teeth begin to bite. With the passage of time, states may be tempted to race to the bottom, lowering expectations to ever lower levels so that fewer schools are identified as failing, even when no gains are being made.

Because each state selects its own testing system and sets its own passing scores, there is no direct way to compare the proficiency levels established by one state against the others. However, NCLB does require each state to administer the National Assessment of Educational Progress (NAEP) to a sample of students in 4th and 8th grade in reading and in mathematics. Comparing the percentage of students achieving proficiency on state tests with the percentage achieving proficiency on the NAEP suggests how demanding each state’s standards are.

For instance, if only 50 percent of a state’s 4th graders are proficient by the nationally determined NAEP standard, but the state claims proficiency for 80 percent, then the state should be given an F for its failure to establish high expectations for its students. But if a state with an equivalent score on the NAEP says only 45 percent are proficient, then it should be given an A for having standards that exceed even those of the NAEP.

In practice, only five states—South Carolina, Maine, Missouri, Wyoming, and Massachusetts—deserve the A grade. A lot more deserve Ds and Fs, the worst grades going to Tennessee, Texas, and Oklahoma.

To help citizens of every state know whether their state is maintaining high expectations for its students, Education Next plans to issue periodic assessments of how the states compare with one another. Figure 1 shows initial results for the 40 states for which both state and NAEP proficiency levels are currently available. In the future, it will be possible to compare all states with one another.

By reporting this straightforward, objective grading system, we hope to help eliminate some of the murkiness that still prevails. It would be even better if, as Caroline M. Hoxby recommends elsewhere in this issue (see “Inadequate Yearly Progress,” page 46), the federal government issued its own grade for each state.

For the ranking of all states, go to the url below.

Paul E. Peterson and Frederick M. Hess are editors of Education Next. Mark Linnen provided research assistance

— Paul E. Peterson & Frederick M. Hess, with comment by Gerald Bracey
Education Next


This site contains copyrighted material the use of which has not always been specifically authorized by the copyright owner. We are making such material available in our efforts to advance understanding of education issues vital to a democracy. We believe this constitutes a 'fair use' of any such copyrighted material as provided for in section 107 of the US Copyright Law. In accordance with Title 17 U.S.C. Section 107, the material on this site is distributed without profit to those who have expressed a prior interest in receiving the included information for research and educational purposes. For more information click here. If you wish to use copyrighted material from this site for purposes of your own that go beyond 'fair use', you must obtain permission from the copyright owner.