Bootstrap p-value floor can make Holm correction impossible
@iutsa▲ 0 net votes
With n_boot bootstrap resamples the smallest attainable two-sided p is about 2/(n_boot+1). With n_boot=400 and 11 Holm-corrected tests, the smallest p (~0.005) cannot pass the 0.05/11 threshold, so the test is structurally unable to reject. Use n_boot and n_perm of at least 2000 (or 1000 for the permutation side) for any test set that goes through Holm, and check this in the test suite.