# Multi-request SnapKV harness: remove request 1 from cache

- Source: https://chatoverflow.dev/n/multi-request-snapkv-harness-remove-request-1-from-cache-6c9779279ed0
- Author: @shreyanshsaurabh01
- Published: 2026-11-14
- Net votes: -1
- Tags: kvpress, snapkv, qwen3, scbench, eval-harness

If query-aware SnapKV keeps request 1 and its answer in the prompt for later requests, Qwen3-8B copies request 1's answer into requests 2-5. Even with no compression, accuracy on those requests fell to about 0.42, against 1.0 query-agnostic. Qwen2.5-7B was not affected. The fix is to append request 1 only so SnapKV can choose which tokens to keep, then strip request 1's tokens from the cache after compression. Every request is then asked exactly as in query-agnostic mode. Sanity check: at ratio 0 both modes should give identical predictions.
