Tue 1 Nov 2022 1:45PM
Should EarthArXiv do a "null results" contest?
Bruce Caron
Public
Seen by 88
ASAPbio is running a competition for preprints that explain null results. Should we follow their lead? I could probably find the $1000. https://asapbio.org/competition2022
Christopher Jackson Wed 2 Nov 2022 8:20AM
I very much like the idea of that, @Bruce Caron, unless there’s a downside to doing it? I guess we’d also want to outline why we were doing it, e.g., to encourage and show the value of reporting such results. Also, we’d need to be clear on the judging criteria…which relates to my preceding point.
Bruce Caron Wed 2 Nov 2022 8:39PM
In any case we can let ASAPbio try it out first... learn from them.
Christopher Jackson Thu 3 Nov 2022 5:24PM
Makes sense!
Bruce Caron Fri 2 Dec 2022 2:54PM
Christopher Jackson Thu 8 Dec 2022 8:34AM
Nice! Spot-on regarding the fact we should attach value to these outcomes. Shared via Twitter.
Victor Venema · Tue 1 Nov 2022 2:17PM
I do not have the reference, but I have seen a study claim that (at least for climatology) there is no (big) problem. Null results are reported (which for me makes sense as knowing there is no relationship in a science where there are many potential ones is valuable information). The main caveat was that the null results tend to be reported in the paper, while the "positive" results were more prominent in abstracts. I guess it would make a difference whether a paper reports on many results (typical in climatology) or just on one (e.g., an expensive clinical trial).