Winter 2018
What Does It Mean to Replicate a Study?

Replication studies put researchers’ conclusions to the test by creating new versions of the original experiment

In principle, a well-designed and well-documented experiment will accurately describe a real phenomenon and provide other researchers with everything they need to reproduce those results in a comparable study.

To replicate an experiment, researchers use the same methods of data collection and apply the same analysis, even though they have to use new subjects, often in somewhat different situations. Subjects may be generally older or younger, for example, or from a different country.

See Ghost Effects, a feature article about the replication crisis

While later tests can’t possibly be identical to the original, they need to be similar enough to yield comparable data.

Concepts like “similar enough” and “comparable data” involve a level of subjectivity that adds to the controversy around replication. When a study fails a replication attempt, defenders often question whether the followup truly reflected the original. Researchers help to resolve such debates when they openly share their data and methods.

Add a Comment

required, use real name
required, Not for Publication
optional, eg: BSc 2008

Next story in this issue: »
Previous story in this issue: «