Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2024 Jan 8;22(1):e3002423.
doi: 10.1371/journal.pbio.3002423. eCollection 2024 Jan.

Finding the right power balance: Better study design and collaboration can reduce dependence on statistical power

Affiliations

Finding the right power balance: Better study design and collaboration can reduce dependence on statistical power

Shinichi Nakagawa et al. PLoS Biol. .

Abstract

Power analysis currently dominates sample size determination for experiments, particularly in grant and ethics applications. Yet, this focus could paradoxically result in suboptimal study design because publication biases towards studies with the largest effects can lead to the overestimation of effect sizes. In this Essay, we propose a paradigm shift towards better study designs that focus less on statistical power. We also advocate for (pre)registration and obligatory reporting of all results (regardless of statistical significance), better facilitation of team science and multi-institutional collaboration that incorporates heterogenization, and the use of prospective and living meta-analyses to generate generalizable results. Such changes could make science more effective and, potentially, more equitable, helping to cultivate better collaborations.

PubMed Disclaimer

Conflict of interest statement

The authors have declared that no competing interests exist.

Figures

Fig 1
Fig 1. The vicious cycle of power analysis and publication bias.
An example of how effect size θ can be inflated via selective publication and how power analysis, in its current use, can encourage this cycle to continue.
Fig 2
Fig 2. Plasticity of a trait in relation to an environmental variable.
Traits are expressed differently (y1 and y2) depending on environmental conditions (x1 and x2). Therefore, excessive standardizations (of environments) will lead to unreplicable results. See Box 3 for the details of differently colored parts.
Fig 3
Fig 3. The virtuous cycle of research.
A visualization of how our proposed paradigm shift could start a virtuous cycle that empowers researchers and better science.

References

    1. Chalmers I, Glasziou P. Avoidable waste in the production and reporting of research evidence. Lancet. 2009;374(9683):86–89. doi: 10.1016/S0140-6736(09)60329-9 WOS:000267768800037. - DOI - PubMed
    1. Purgar M, Klanjscek T, Culina A. Quantifying research waste in ecology. Nat Ecol Evol. 2022;6(9):1390–1397. doi: 10.1038/s41559-022-01820-0 WOS:000828437000001. - DOI - PubMed
    1. Ioannidis JPA. Why most published research findings are false. PLoS Med. 2005;2(8):696–701. doi: 10.1371/journal.pmed.0020124 WOS:000231676900008. - DOI - PMC - PubMed
    1. Amrhein V, Greenland S, McShane B. Scientists rise up against statistical significance. Nature. 2019;567(7748):305–307. Epub 2019/03/22. doi: 10.1038/d41586-019-00857-9 . - DOI - PubMed
    1. Wasserstein RL, Schirm AL, Lazar NA. Moving to a World Beyond "p < 0.05". Am Stat. 2019;73:1–19. doi: 10.1080/00031305.2019.1583913 WOS:000462083800001. - DOI

Publication types

LinkOut - more resources