Is Value-added Teacher Data Flawed?

Amidst the imbroglio kicked up by The Los Angeles Times series of articles on teacher effectiveness data comes the findings of a research paper authored by several prominent education experts and published by the non-partisan Economics Policy Institute. Its finding: It would be "unwise" to consider student improvement (or slides) in standardized tests as up to 50 percent of a teacher's evaluation, as some states are proposing to do.

Louisiana, Tennessee, and Washington, D.C., are weighting value-added data up to 50 percent. Other states, however, are not looking to depend that heavily on the controversial assessment. In response to the Times article, Los Angeles Unified School District Superintendent Ramon Cortines is shooting to use value-added assessments for 30 percent of a teacher's grade. A pilot program galvanized by The Gates Foundation in Tampa weights value-added data at 40 percent.

Maureen Downey over at the Atlanta Journal-Constitution's Get Schooled blog was among the first to point out the study questioning the emphasis of so-called "value-added data." Whereas, the study suggests that scores be limited to a small component of overall evaluations, Downey rightly notes that the idealized regimen these researchers suggest—which includes "observations or videotapes of classroom practice, teacher interviews, and artifacts such as lesson plans, assignments, and samples of student work"—is, frankly, financially unfeasible.

Over at The Washington Post's Answer Sheet blog, Valerie Strauss asks of EPI study coauthor and Duke University economist Helen Ladd: Why use standardized test data at all?

Ladd's response:

Test scores are unreliable, but they are still more often right than wrong, but not sufficiently more often to justify making high-stakes decisions on the basis of test scores alone. But giving test scores too much weight in a balanced evaluation system runs the additional danger of creating incentives to narrow the curriculum, as we described in the paper. If they are not given too much weight, this danger is lessened. How much weight they should be given should be a matter of local experimentation and judgment. All we say in the paper is that giving them 50 percent of the weight is too much.


In addition to being "more often right than wrong," the scores are also essentially the sole objective component of teacher assessments. Thus, they certainly deserve some weight—though they shouldn't be the sole basis for personnel decisions.

And the place where that especially true is in L.A. As Slate's Jack Shafer writes, the L.A. Times was absolutely in the right publishing the data, as it's in the public domain and is the right of the people to see. It could, however, lead engaged parents to pull their kids from the classrooms of teachers who score badly, causing further non-randomization in the sort of students each teacher is assigned and possibly skewing future data: Poorer performing teachers will likely end up with poorer performing students (or at least students whose parents didn't make a decision about their child's schooling according to this data set).

That's why I'd side with Green Dot Public Schools CEO Marco Petruzzi, who wrote in response to the Times data dump:

I'm open to publicly grading schools, and I'm also in favor of transparency within a school community, where you can set the data within the right context. I'm uncomfortable, however, with publishing a narrow data point with a person's name attached to it for public consumption without the proper context.


The data is valuable. But, it's best utilized by administrators and the teachers themselves, who can then work to better their staffs or steer members of them out of the profession, if need be.

Photo via Houston Independent School District.


Two years after its opening in 1914, the Baltimore Museum of Art acquired a painting by Sarah Miriam Peale — its first work by a female artist. More than a century later, one might assume that the museum would have a fairly equal mix of male and female artists, right? But as of today, only 4% of the 95,000 pieces in the museum's permanent collection were created by women.

The museum is determined to narrow that gap, and they're taking a drastic step to do so.

Keep Reading Show less
via Chela Horsdal / Twitter

Amazon's "The Man in the High Castle" debuted the first episode of its final season last week.

The show is loosely based on an alternative history novel by Philip K. Dick that postulates what would happen if Nazi Germany and the Empire of Japan controlled the United States after being victorious in World War II.

Keep Reading Show less
via Alan Levine / Flickr

The World Health Organization is hoping to drive down the cost of insulin by encouraging more generic drug makers to enter the market.

The organization hopes that by increasing competition for insulin, drug manufacturers will be forced to lower their prices.

Currently, only three companies dominate the world insulin market, Eli Lilly, Novo Nordisk and Sanofi. Over the past three decades they've worked to drastically increase the price of the drug, leading to an insulin availability crisis in some places.

In the United States, the price of insulin has increased from $35 a vial to $275 over the past two decades.

Keep Reading Show less

Oh, irony. You are having quite a day.

The Italian region of Veneto, which includes the city of Venice, is currently experiencing historic flooding. Venice Mayor Luigi Brugnaro has stated that the flooding is a direct result of climate change, with the tide measuring the highest level in 50 years. The city (which is actually a collection of 100 islands in a lagoon—hence its famous canal streets), is no stranger to regular flooding, but is currently on the brink of declaring a state of emergency as waters refuse to recede.

Keep Reading Show less
The Planet

Since the International Whaling Commission banned commercial whaling in 1986, whale populations have been steadily recovering. However, whales in the wild still face other dangers. In the summer of 2018, four Russian companies that supply aquariums with marine animals captured almost 100 beluga whales and killer whales (aka orcas). After a public outcry, those whales are swimming free as the last of the captive whales have been released, the first time this many captured whales have been released back into the wild.

In late 2018 and early 2019, a drone captured footage of 11 orcas and 87 beluga whales crammed into holding pens in the Srednyaya Bay. The so-called "whale jail" made headlines, and authorities began to investigate their potentially illegal capture.

Keep Reading Show less
The Planet