Measuring the crowd within again: a pre-registered replication study
- PMID: 25120505
- PMCID: PMC4112915
- DOI: 10.3389/fpsyg.2014.00786
Measuring the crowd within again: a pre-registered replication study
Erratum in
-
Corrigendum: Measuring the crowd within again: a pre-registered replication study.Front Psychol. 2015 Mar 12;6:238. doi: 10.3389/fpsyg.2015.00238. eCollection 2015. Front Psychol. 2015. PMID: 25814965 Free PMC article.
Abstract
According to the crowd within effect, the average of two estimates from one person tends to be more accurate than a single estimate of that person. The effect implies that the well documented wisdom of the crowd effect-the crowd's average estimate tends to be more accurate than the individual estimates-can be obtained within a single individual. In this paper, we performed a high-powered, pre-registered replication study of the original experiment. Our replication results are evaluated with the traditional null hypothesis significance testing approach, as well as with effect sizes and their confidence intervals. We adopted a co-pilot approach, in the sense that all analyses were performed independently by two researchers using different analysis software. Moreover, we report Bayes factors for all tests. We successfully replicated the crowd within effect, both when the second guess was made immediately after the first guess, as well as when it was made 3 weeks later. The experimental protocol, the raw data, the post-processed data and the analysis code are available online.
Keywords: crowd within; effect size; power analysis; registered replication study; wisdom of the crowd.
Figures
References
-
- Central Intelligence Agency (2013). The World Factbook. Available online at: https://www.cia.gov/library/publications/the-world-factbook/ (accessed June 7, 2013).
-
- Cohen J. (1988). Statistical Power Analysis for the Behavioral Sciences, 2nd Edn. Hillsdale, NJ: Lawrence Erlbaum
-
- Cooper H., Hedges L. V., Valentine J. C. (2009). Handbook of Research Synthesis and Meta-Analysis. New York, NY: Russell Sage Foundation
-
- Dani V., Madani O., Pennock D. M., Sanghai S., Galebach B. (2012). An empirical comparison of algorithms for aggregating expert predictions. arXiv preprint arXiv:1206.6814.
LinkOut - more resources
Full Text Sources
Other Literature Sources
