Is Value-added Teacher Data Flawed?

Amidst the imbroglio kicked up by The Los Angeles Times series of articles on teacher effectiveness data comes the findings of a research paper authored by several prominent education experts and published by the non-partisan Economics Policy Institute. Its finding: It would be "unwise" to consider student improvement (or slides) in standardized tests as up to 50 percent of a teacher's evaluation, as some states are proposing to do.

Louisiana, Tennessee, and Washington, D.C., are weighting value-added data up to 50 percent. Other states, however, are not looking to depend that heavily on the controversial assessment. In response to the Times article, Los Angeles Unified School District Superintendent Ramon Cortines is shooting to use value-added assessments for 30 percent of a teacher's grade. A pilot program galvanized by The Gates Foundation in Tampa weights value-added data at 40 percent.

Maureen Downey over at the Atlanta Journal-Constitution's Get Schooled blog was among the first to point out the study questioning the emphasis of so-called "value-added data." Whereas, the study suggests that scores be limited to a small component of overall evaluations, Downey rightly notes that the idealized regimen these researchers suggest—which includes "observations or videotapes of classroom practice, teacher interviews, and artifacts such as lesson plans, assignments, and samples of student work"—is, frankly, financially unfeasible.

Over at The Washington Post's Answer Sheet blog, Valerie Strauss asks of EPI study coauthor and Duke University economist Helen Ladd: Why use standardized test data at all?

Ladd's response:

Test scores are unreliable, but they are still more often right than wrong, but not sufficiently more often to justify making high-stakes decisions on the basis of test scores alone. But giving test scores too much weight in a balanced evaluation system runs the additional danger of creating incentives to narrow the curriculum, as we described in the paper. If they are not given too much weight, this danger is lessened. How much weight they should be given should be a matter of local experimentation and judgment. All we say in the paper is that giving them 50 percent of the weight is too much.


In addition to being "more often right than wrong," the scores are also essentially the sole objective component of teacher assessments. Thus, they certainly deserve some weight—though they shouldn't be the sole basis for personnel decisions.

And the place where that especially true is in L.A. As Slate's Jack Shafer writes, the L.A. Times was absolutely in the right publishing the data, as it's in the public domain and is the right of the people to see. It could, however, lead engaged parents to pull their kids from the classrooms of teachers who score badly, causing further non-randomization in the sort of students each teacher is assigned and possibly skewing future data: Poorer performing teachers will likely end up with poorer performing students (or at least students whose parents didn't make a decision about their child's schooling according to this data set).

That's why I'd side with Green Dot Public Schools CEO Marco Petruzzi, who wrote in response to the Times data dump:

I'm open to publicly grading schools, and I'm also in favor of transparency within a school community, where you can set the data within the right context. I'm uncomfortable, however, with publishing a narrow data point with a person's name attached to it for public consumption without the proper context.


The data is valuable. But, it's best utilized by administrators and the teachers themselves, who can then work to better their staffs or steer members of them out of the profession, if need be.

Photo via Houston Independent School District.

via The Hill / Twitter

President Trump's appearance at the World Economic Forum in Davos, Switzerland was a mixed bag.

The theme of the event was climate change, but Trump chose to use his 30 minutes of speaking time to brag about the "spectacular" U.S. economy and encouraged world leaders to invest in America.

He didn't mention climate change once.

Keep Reading
The Planet
via David Leavitt / Twitter and RealTargetTori / Twitter

Last Friday, GOOD reported on an infuriating incident that went down at a Massachusetts Target.

A Target manager who's come to be known as "Target Tori," was harassed by Twitter troll David Leavitt for not selling him an $89 Oral-B Pro 5000 toothbrush for a penny.

He describes himself as a "multimedia journalist who has worked for CBS, AXS, Yahoo, and others."

Keep Reading

The Australian bushfires have claimed 27 human lives, an estimated 1 billion animals are feared dead, and thousands of properties have been completely decimated.

The fires were caused by extreme heat and dryness, the result of 2019 being the country's hottest year on record, with average temperatures 1.52C above the 1961-1990 average.

The area hit hardest by the fires, New South Wales, also had its hottest year on record, with temperatures rising 1.95C above average.

Keep Reading
The Planet