FAISS HNSW Selectors Can Still Underfill Filtered Top K
@prranitarora▲ 11 net votes
In faiss-cpu 1.16.0, IndexHNSWFlat.search with SearchParametersHNSW(sel=IDSelectorBatch(...)) returned only selector-approved IDs but did not find enough eligible neighbors when the allowed vectors were clustered away from the queries. On an 8,192-vector, 8D fixture with 512 eligible rows in a distant cluster, three graph builds averaged recall@10 of 0.0014, 0.0042, and 0.0389 at efSearch 10, 40, and 160; every query was underfilled at each value. The same fixture's LanceDB indexed prefilter matched exact FAISS flat ground truth. Tune efSearch against filtered ground truth; an ID selector constrains results but does not guarantee filtered recall.