Prediction Interval: What to Expect When You’re Expecting … A Replication

A challenge when interpreting replications is determining whether the results of a replication “successfully” replicate the original study. Looking for consistency between two studies is challenging because individual studies are susceptible to many sources of error that can cause study results to deviate from each other and the population effect in unpredictable directions and magnitudes. In the current paper, we derive methods to compute a prediction interval, a range of results that can be expected in a replication due to chance (i.e., sampling error), for means and commonly used indexes of effect size: correlations and d-values. The prediction interval is calculable based on objective study characteristics (i.e., effect size of the original study and sample sizes of the original study and planned replication) even when sample sizes across studies are unequal. The prediction interval provides an a priori method for assessing if the difference between an original and replication result is consistent with what can be expected due to sample error alone. We provide open-source software tools that allow researchers, reviewers, replicators, and editors to easily calculate prediction intervals.

Tags
Data and Resources
To access the resources you must log in

This item has no data

Identity

Description: The Identity category includes attributes that support the identification of the resource.

Field Value
PID https://www.doi.org/10.1371/journal.pone.0162874
PID pmc:PMC5028066
PID pmid:27644090
URL http://dx.plos.org/10.1371/journal.pone.0162874
URL https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0162874&type=printable
URL https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5028066
URL https://ui.adsabs.harvard.edu/abs/2016PLoSO..1162874S/abstract
URL https://paperity.org/p/80304677/prediction-interval-what-to-expect-when-youre-expecting-a-replication
URL http://europepmc.org/articles/PMC5028066?pdf=render
URL https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0162874
URL http://dx.doi.org/10.1371/journal.pone.0162874
URL https://academic.microsoft.com/#/detail/2522856199
URL https://europepmc.org/articles/PMC5028066
URL https://doaj.org/toc/1932-6203
URL http://europepmc.org/articles/PMC5028066
Access Modality

Description: The Access Modality category includes attributes that report the modality of exploitation of the resource.

Field Value
Access Right Open Access
Attribution

Description: Authorships and contributors

Field Value
Author Spence, Jeffrey R.
Author Stanley, David J.
Publishing

Description: Attributes about the publishing venue (e.g. journal) and deposit location (e.g. repository)

Field Value
Collected From PubMed Central; UnpayWall; DOAJ-Articles; Crossref; Microsoft Academic Graph
Hosted By Europe PubMed Central; PLoS ONE
Journal PLOS ONE, 11, null
Publication Date 2016-09-19
Publisher Public Library of Science (PLoS)
Additional Info
Field Value
Language Undetermined
Resource Type Article
keyword Q
keyword R
system:type publication
Management Info
Field Value
Source https://science-innovation-policy.openaire.eu/search/publication?articleId=dedup_wf_001::404eca888dd0a61aa7ea3cede835d3e9
Author jsonws_user
Last Updated 21 December 2020, 20:31 (CET)
Created 21 December 2020, 20:31 (CET)