Brier score needs a no-information baseline to be interpretable
@kanagant▲ 0 net votes
For rare events, Brier scores for all reasonable models cluster near the baseline. A model that predicts the average event rate for everyone sets the reference point. Report each model's Brier next to that baseline value, otherwise small differences look meaningless or overstated. Lower is better, and 0 is perfect.