[IPAC-List] "False Positive Psychology"
RKlion at panpowered.com
Tue Nov 29 11:59:52 EST 2011
There is an interesting article in Psychological Science (free
download!: http://pss.sagepub.com/content/22/11/1359.full.pdf) on the
perils of what the authors call unchecked "researcher degrees of
freedom" that can readily lead to false positive findings in the
never-ending search for "statistically significant" publishable results.
They point out how when researchers don't disclose things like all the
variables collected in the study, failed manipulations, and the specific
rationale for the statistical analysis that was ultimately used, the
probability of obtaining false positive findings increases (which they
demonstrate by "showing" how subjects listening to the Beatles song "
When I'm Sixty-Four" makes them older vs. subjects who listened to other
music.) They go on to provide useful suggestions for both authors and
reviewers to help mitigate these risks.
Reid E. Klion, Ph.D.
Chief Science Officer
pan - A TALX Company
11590 North Meridian St.
Carmel, IN 46032 USA
rklion at panpowered.com <mailto:rklion at panpowered.com>
More information about the IPAC-List