2 Comments

Love it. Related to an idea I've just started to work on, the seeming tension between pre-registration and MHC. Practitioners are hesitant to pre-register additional tests because the redundant correction you discuss is indeed the status quo. But this is obviously bad for science, especially in the case of an expensive field experiment: researchers testing *fewer* outcomes because of the power costs, even though the marginal resource cost of these tests is trivial compared to the experiment itself.

Expand full comment

Thanks Kevin,

Yes I discuss this question-asking penalty in my 2021 paper (p. 10992; https://doi.org/10.1007/s11229-021-03276-4). I totally agree that it is a strange idea to penalize researchers for asking more questions!

Look forward to hearing more about your work on preregistration. Sounds really interesting!

Expand full comment