Introducing the First Journal Solely Dedicated to Double-Checking Science

A practical solution to the reproducibility crisis.

Image via Flickr user RDECOM

One thing we all vaguely remember from science class is the scientific method—that noble set of rules for testing hypotheses that ensures results and conclusions are useful to other scientists. If you forgot the specifics, it boils down to one thing: Show your work. Transparency about methodological decisions, specificity about variables and conditions, full accessibility to raw data—these allow scientists to trust the reliability of research because, allegedly, the findings can be replicated. Over the last decade however, the scientific world has realized that the current method just isn’t working.

The so-called reproducibility crisis kicked off in 2005, when Stanford epidemiologist John Ioannidis showed, in his now-famous paper “Why Most Published Research Findings Are False,” that a majority of medical studies are distorted—by researchers’ bias toward unlikely hypotheses, publishers’ bias toward novel claims, etc. Ensuing investigations have shown that 47 of 53 “landmark” cancer studies don’t hold up to scrutiny, two-thirds of findings published in three leading psychology journals can’t be replicated, and American scientists spend $28 billion each year on unreplicable biomedical research.

While these revelations are dramatic, the full extent of the problem is unknown. Reconducting research for the sake of verification is a fundamental part of the scientific process, but in reality, scientists rarely take this step. Limited budgets, competition for professional advancement, and fragile egos all disincentivize researchers from rerunning old studies instead of conducting new ones. At the same time, since journals favor the sensational and strange, scientists who do test old findings struggle to publish their results.

The Preclinical Reproducibility and Robustness channel, which launched last Thursday, aims to fill the void. The online-only journal, based in London, is the first ever dedicated exclusively to the replication and testing of past experiments. “Because science depends on observations that are verifiable, science is at its core self-correcting,” co-founders Bruce Alberts and Alexander Kamb write in the journal’s introductory editorial. “It is our hope that … a vigorous new publishing culture can be established to enhance the crucial self-correcting feature of science.”

In recent years, several other initiatives have begun to tackle the problem, including Stanford’s Meta-Research Innovation Center, co-founded by Ioannidis and dedicated to researching the processes, policies, and methodologies of scientific research. But until now, there was no institution promoting independent reproductions and no outlet in which to publish them. Since it went live, PRB has published three replication studies, including a debunking of the claim that high-fat diets improve metabolism in mice.

via Real Time with Bill Maher / YouTube and The Late Late Show with James Corden / YouTube

A controversial editorial on America's obesity epidemic and healthcare by comedian Bill Maher on his HBO show "Real Time" inspired a thoughtful, and funny, response by James Cordon. It also made for a great debate about healthcare that Americans are avoiding.

At the end of the September 6th episode of "Real Time, " Maher turned to the camera for his usual editorial and discussed how obesity is a huge part of the healthcare debate that no one is having.

"At Next Thursday's debate, one of the candidates has to say, 'The problem with our healthcare system is Americans eat shit and too much of it.' All the candidates will mention their health plans but no one will bring up the key factor: the citizens don't lift a finger to help," Maher said sternly.

Keep Reading Show less

There is no shortage of proposals from the, um, what's the word for it… huge, group of Democratic presidential candidates this year. But one may stand out from the pack as being not just bold but also necessary; during a CNN town hall about climate change Andrew Yang proposed a "green amendment" to the constitution.

Keep Reading Show less
Me Too Kit

The creator of the Me Too kit — an at home rape kit that has yet to hit the market — has come under fire as sexual assault advocates argue the kit is dangerous and misleading for women.

The kit is marketed as "the first ever at home kit for commercial use," according to the company's website. "Your experience. Your kit. Your story. Your life. Your choice. Every survivor has a story, every survivor has a voice." Customers will soon be able order one of the DIY kits in order to collect evidence "within the confines of the survivor's chosen place of safety" after an assault.

"With MeToo Kit, we are able to collect DNA samples and other tissues, which upon testing can provide the necessary time-sensitive evidence required in a court of law to identify a sexual predator's involvement with sexual assault," according to the website.

Keep Reading Show less

Villagers rejoice as they receive the first vaccines ever delivered via drone in the Congo

The area's topography makes transporting medicines a treacherous task.

Photo by Henry Sempangi Senyule

When we discuss barriers to healthcare in the developed world, affordability is commonly the biggest concern. But for some in the developing world, physical distance and topography can be the difference between life and death.

Widjifake, a hard-to-reach village in northwestern Democratic Republic of Congo (DRC) with a population of 6,500, struggles with having consistent access to healthcare supplies due to the Congo River and its winding tributaries.

It can take up to three hours for vehicles carrying supplies to reach the village.

Keep Reading Show less
via Keith Boykin / Twitter

Fox News and President Trump seem like they may be headed for a breakup. "Fox is a lot different than it used to be," Trump told reporters in August after one of the network's polls found him trailing for Democrats in the 2020 election.

"There's something going on at Fox, I'll tell you right now. And I'm not happy with it," he continued.

Some Fox anchors have hit back at the president over his criticisms. "Well, first of all, Mr. President, we don't work for you," Neil Cavuto said on the air. "I don't work for you. My job is to cover you, not fawn over you or rip you, just report on you."

Keep Reading Show less