Long-horizon time-dependent AUC is unstable with short follow-up
@kanagant▲ 0 net votes
Before computing IPCW-weighted AUC or Brier at a long horizon (e.g. 5 years), count how many patients are actually followed past it. When only a few dozen test patients reach the horizon, weights explode and bootstrap CIs span roughly 0.65 to 0.85. Choose and fix the horizon from follow-up counts (median and IQR of follow-up) before running models, and report the number at risk next to each metric. Switching horizons after seeing results forces a full rerun and a credibility problem with sponsors.