Poor statistical reporting, inadequate data presentation and spin persist despite editorial advice

The Journal of Physiology and British Journal of Pharmacology jointly published an editorial series in 2011 to improve standards in statistical reporting and data analysis. It is not known whether reporting practices changed in response to the editorial advice. We conducted a cross-sectional analysis of reporting practices in a random sample of research papers published in these journals before (n = 202) and after (n = 199) publication of the editorial advice. Descriptive data are presented. There was no evidence that reporting practices improved following publication of the editorial advice. Overall, 76-84% of papers with written measures that summarized data variability used standard errors of the mean, and 90-96% of papers did not report exact p-values for primary analyses and post-hoc tests. 76-84% of papers that plotted measures to summarize data variability used standard errors of the mean, and only 2-4% of papers plotted raw data used to calculate variability. Of papers that reported p-values between 0.05 and 0.1, 56-63% interpreted these as trends or statistically significant. Implied or gross spin was noted incidentally in papers before (n = 10) and after (n = 9) the editorial advice was published. Overall, poor statistical reporting, inadequate data presentation and spin were present before and after the editorial advice was published. While the scientific community continues to implement strategies for improving reporting practices, our results indicate stronger incentives or enforcements are needed.

Tags
Data and Resources
To access the resources you must log in

This item has no data

Identity

Description: The Identity category includes attributes that support the identification of the resource.

Field Value
PID https://www.doi.org/10.1371/journal.pone.0202121
PID pmc:PMC6093658
PID pmid:30110371
URL https://dx.doi.org/10.1371/journal.pone.0202121
URL https://dx.plos.org/10.1371/journal.pone.0202121
URL https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0202121&type=printable
URL http://europepmc.org/articles/PMC6093658?pdf=render
URL https://doaj.org/toc/1932-6203
URL https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0202121
URL http://europepmc.org/articles/PMC6093658
URL https://academic.microsoft.com/#/detail/2885134687
URL http://dx.doi.org/10.1371/journal.pone.0202121
URL http://dx.plos.org/10.1371/journal.pone.0202121
URL https://www.ncbi.nlm.nih.gov/pubmed/30110371
Access Modality

Description: The Access Modality category includes attributes that report the modality of exploitation of the resource.

Field Value
Access Right Open Access
Attribution

Description: Authorships and contributors

Field Value
Author Annie Butler, 0000-0002-3678-1297
Author Joanna Diong, 0000-0002-0077-3869
Author Martin Héroux, 0000-0002-3354-7104
Contributor Williams, Bart O.
Publishing

Description: Attributes about the publishing venue (e.g. journal) and deposit location (e.g. repository)

Field Value
Collected From Europe PubMed Central; PubMed Central; ORCID; Datacite; UnpayWall; DOAJ-Articles; Crossref; Microsoft Academic Graph
Hosted By Europe PubMed Central; PLoS ONE
Journal PLoS ONE, 13, 8
Publication Date 2018-08-15
Publisher Public Library of Science
Additional Info
Field Value
Language English
Resource Type Other literature type; Article; UNKNOWN
keyword Q
keyword R
system:type publication
Management Info
Field Value
Source https://science-innovation-policy.openaire.eu/search/publication?articleId=dedup_wf_001::5859beac225b0f792be97367d6fd0d88
Author jsonws_user
Last Updated 26 December 2020, 19:07 (CET)
Created 26 December 2020, 19:07 (CET)