Do social science studies published in Nature and Science replicate?
Nature Human Behaviour
2018년8월28일
The results of efforts to replicate 21 experimental social science studies published in Nature and Science between 2010 and 2015 are reported in Nature Human Behaviour this week. The primary replication method used in the study found that one out of the four Nature papers and seven of the seventeen Science papers evaluated did not replicate.
Understanding the extent to which scientific findings can be trusted is of fundamental importance. Recent attempts to replicate published research from across various fields and journals found that a substantial number of studies do not replicate. To ensure replication rates are not being underestimated, however, higher-powered replication studies with larger sample sizes have been called for.
Colin Camerer, Brian Nosek and colleagues conducted high-powered replications of the 21 experimental social science studies - using sample sizes around five times larger than the original sample sizes. They find that 62% of the replications show an effect in the same direction as the original studies. This effect varies between 57% and 67%, depending on how replicability is determined. The authors suggest that the original studies are likely to have contained both false positives and inflated effect sizes. Based on a survey of 400 social scientists, the authors also report a strong correlation between the research community’s expectations of each study’s replicability and the reality.
In an associated collection of eight Correspondences, non-replicating study authors discuss why their results did not replicate, providing their views into potential sources of irreproducibility. In an accompanying News & Views, Malcolm Macleod argues that replication studies are necessary for establishing a solid foundation for the social sciences, and can generate important new research into the parameters that could lead to more robust scientific conclusions.
doi:10.1038/s41562-018-0411-7 | Original articledoi:10.1038/s41562-018-0403-7 | Original article
doi:10.1038/s41562-018-0424-2 | Original article
doi: 10.1038/s41562-018-0404-6 | Original article
doi:10.1038/s41562-018-0409-1 | Original article
doi:10.1038/s41562-018-0426-0 | Original article
doi:10.1038/s41562-018-0408-2 | Original article
doi: 10.1038/s41562-018-0399-z | Original article
doi: 10.1038/s41562-018-0405-5
리서치 하이라이트
-
6월24일
Sport science: New wearable sensor to measure neck strain may detect potential concussionScientific Reports
-
6월23일
Scientific community: Women credited less than men in scientific paper authorshipNature
-
6월17일
Health technology: New cost-effective smartphone test for middle ear functionCommunications Medicine
-
6월16일
An exercise-inducible molecule that suppresses appetiteNature
-
6월16일
Cancer: Signatures of structural genomic variation in cancerNature
-
6월10일
Animals: Genetic clues to how dogs became man’s best friendsScientific Reports