The present paper argues that an important cause of publication bias resides in traditional frequentist statistics forcing binary decisions. An alternative approach through Bayesian statistics provides various degrees of support for any hypothesis allowing balanced decisions and proper null hypothesis testing, which may prevent publication bias. Testing a null hypothesis becomes increasingly relevant in mediated communication and virtual environments. To illustrate our arguments, we re-analyzed three data sets of previously published data --media violence effects, mediated communication, and visuospatial abilities across genders. Results are discussed in view of possible Bayesian interpretations, which are more open to a content-related argumentation of varying levels of support. Finally, we discuss potential pitfalls of a Bayesian approach such as BF-hacking (cf., “God would love a Bayes Factor of 3.01 nearly as much as a BF of 2.99”). Especially when BF values are small, replication studies and Bayesian updating are still necessary to draw conclusions.

Konijn, E., Van de Schoot, R., Winter, S., & Ferguson, C. J. (2015). Possible Solution to Publication Bias Through Bayesian Statistics, Including Proper Null Hypothesis Testing. Communication Methods and Measures, 9(4), 280-302. http://dx.doi.org/10.1080/19312458.2015.1096332

Elly Konijn
full professor in Media Psychology
Elly's scientific research program moves along three main lines: 1) emotions and media-based reality perceptions; 2) media use among adolescents; and 3) relating to media figures, virtual humans, and social robots.
Visit website
Former team member

After working with Rens on various research projects related to Bayesian Estimation and latent growth modeling I developed an interest in researching both of these further.