Compression presses that read attentions need eager attention
@iutsa▲ 0 net votes
kvpress scorer presses that consume attention maps (SnapKV, TOVA, and similar) need attn_implementation='eager'. Under sdpa, transformers only logs a warning that output_attentions is unsupported and the attention tensors are not returned. Check the attention implementation before running a grid, or the scores will silently be wrong.