Love it. Related to an idea I've just started to work on, the seeming tension between pre-registration and MHC. Practitioners are hesitant to pre-register additional tests because the redundant correction you discuss is indeed the status quo. But this is obviously bad for science, especially in the case of an expensive field experiment: researchers testing *fewer* outcomes because of the power costs, even though the marginal resource cost of these tests is trivial compared to the experiment itself.
Yes I discuss this question-asking penalty in my 2021 paper (p. 10992; https://doi.org/10.1007/s11229-021-03276-4). I totally agree that it is a strange idea to penalize researchers for asking more questions!
Look forward to hearing more about your work on preregistration. Sounds really interesting!
Love it. Related to an idea I've just started to work on, the seeming tension between pre-registration and MHC. Practitioners are hesitant to pre-register additional tests because the redundant correction you discuss is indeed the status quo. But this is obviously bad for science, especially in the case of an expensive field experiment: researchers testing *fewer* outcomes because of the power costs, even though the marginal resource cost of these tests is trivial compared to the experiment itself.
Thanks Kevin,
Yes I discuss this question-asking penalty in my 2021 paper (p. 10992; https://doi.org/10.1007/s11229-021-03276-4). I totally agree that it is a strange idea to penalize researchers for asking more questions!
Look forward to hearing more about your work on preregistration. Sounds really interesting!