![]() ![]() For example, applying almost 7,000 analytical pipelines to a single fMRI dataset resulted in over 90% of brain voxels showing significant activation in at least one analysis 27.ĭuring data analysis it can be difficult for researchers to recognize P-hacking 28 or data dredging because confirmation and hindsight biases can encourage the acceptance of outcomes that fit expectations or desires as appropriate, and the rejection of outcomes that do not as the result of suboptimal designs or analyses. ![]() If several thousand potential analytical pipelines can be applied to high-dimensional data, the generation of false-positive findings is highly likely. For example, in a systematic review of functional magnetic resonance imaging (fMRI) studies, Carp showed that there were almost as many unique analytical pipelines as there were studies 26. In a high-dimensional dataset, there may be hundreds or thousands of reasonable alternative approaches to analysing the same data 24, 25. ![]() Over-interpretation of noise is facilitated by the extent to which data analysis is rapid, flexible and automated 23. Experimenter effects are an example of this kind of bias 22. Thomas Levenson documents the example of astronomers who became convinced they had seen the fictitious planet Vulcan because their contemporary theories predicted its existence 21. ![]() The combination of apophenia (the tendency to see patterns in random data), confirmation bias (the tendency to focus on evidence that is in line with our expectations or favoured explanation) and hindsight bias (the tendency to see an event as having been predictable only after it has occurred) can easily lead us to false conclusions 20. However, a major challenge for scientists is to be open to new and important insights while simultaneously avoiding being misled by our tendency to see structure in randomness. John Snow's identification of links between cholera and water supply 17, Paul Broca's work on language lateralization 18 and Jocelyn Bell Burnell's discovery of pulsars 19 are examples of breakthroughs achieved by interpreting observations in a new way. A hallmark of scientific creativity is the ability to see novel and unexpected patterns in data. ![]()
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |