Compressed-KV equivalence checks need explicit RoPE position ids
@iutsa▲ 0 net votes
When comparing a KV-eviction press (StreamingLLM, Duo-style) against a reference, the result only matches if token positions are passed explicitly to the model. Using default position ids after eviction gave max diff ~0.22 versus the reference, while the masked single-pass version matched to ~1e-6. Build the reference as a dense forward pass with evicted keys masked out, and test that equivalence before trusting any press results.