The wisdom of the inner crowd in three large natural experiments
- PMID: 30980050
- DOI: 10.1038/s41562-017-0247-6
The wisdom of the inner crowd in three large natural experiments
Abstract
The quality of decisions depends on the accuracy of estimates of relevant quantities. According to the wisdom of crowds principle, accurate estimates can be obtained by combining the judgements of different individuals 1,2 . This principle has been successfully applied to improve, for example, economic forecasts 3-5 , medical judgements 6-9 and meteorological predictions 10-13 . Unfortunately, there are many situations in which it is infeasible to collect judgements of others. Recent research proposes that a similar principle applies to repeated judgements from the same person 14 . This paper tests this promising approach on a large scale in a real-world context. Using proprietary data comprising 1.2 million observations from three incentivized guessing competitions, we find that within-person aggregation indeed improves accuracy and that the method works better when there is a time delay between subsequent judgements. However, the benefit pales against that of between-person aggregation: the average of a large number of judgements from the same person is barely better than the average of two judgements from different people.
Comment in
-
Pulling guesses up by their bootstraps.Nat Hum Behav. 2018 Jan;2(1):15-16. doi: 10.1038/s41562-017-0280-5. Nat Hum Behav. 2018. PMID: 30980056 No abstract available.
Similar articles
-
Wisdom of crowds and collective decision-making in a survival situation with complex information integration.Cogn Res Princ Implic. 2020 Oct 15;5(1):48. doi: 10.1186/s41235-020-00248-z. Cogn Res Princ Implic. 2020. PMID: 33057843 Free PMC article.
-
How Endogenous Crowd Formation Undermines the Wisdom of the Crowd in Online Ratings.Psychol Sci. 2018 Sep;29(9):1475-1490. doi: 10.1177/0956797618775080. Epub 2018 Jul 25. Psychol Sci. 2018. PMID: 30044721
-
The wisdom of select crowds.J Pers Soc Psychol. 2014 Aug;107(2):276-99. doi: 10.1037/a0036677. J Pers Soc Psychol. 2014. PMID: 25090129
-
Passage of time judgements.Conscious Cogn. 2015 Dec 15;38:165-71. doi: 10.1016/j.concog.2015.06.005. Epub 2015 Jun 23. Conscious Cogn. 2015. PMID: 26115594 Review.
-
Using judgement to improve accuracy in decision-making.Nurs Times. 2004 Jun 1-7;100(22):42-4. Nurs Times. 2004. PMID: 15195545 Review.
Cited by
-
Fermian guesstimation can boost the wisdom-of-the-inner-crowd.Sci Rep. 2024 Feb 29;14(1):5014. doi: 10.1038/s41598-024-53639-3. Sci Rep. 2024. PMID: 38424100 Free PMC article.
-
On an effective and efficient method for exploiting the wisdom of the inner crowd.Sci Rep. 2023 Mar 3;13(1):3608. doi: 10.1038/s41598-023-30599-8. Sci Rep. 2023. PMID: 36869129 Free PMC article.
-
A simple cognitive method to improve the prediction of matters of taste by exploiting the within-person wisdom-of-crowd effect.Sci Rep. 2022 Jul 20;12(1):12413. doi: 10.1038/s41598-022-16584-7. Sci Rep. 2022. PMID: 35858998 Free PMC article.
-
Measuring Dynamics in Evacuation Behaviour with Deep Learning.Entropy (Basel). 2022 Jan 27;24(2):198. doi: 10.3390/e24020198. Entropy (Basel). 2022. PMID: 35205493 Free PMC article.
-
Annotation-free glioma grading from pathological images using ensemble deep learning.Heliyon. 2023 Mar 21;9(3):e14654. doi: 10.1016/j.heliyon.2023.e14654. eCollection 2023 Mar. Heliyon. 2023. PMID: 37009333 Free PMC article.
Publication types
MeSH terms
LinkOut - more resources
Full Text Sources
