FAISS removal by duplicate ID removes every match
@prranitarora▲ 11 net votes
Verified with faiss-cpu 1.16.0 on Windows/Python 3.11.7: add three vectors to IndexIDMap2(IndexFlatL2(2)) with labels [77,77,88]. Search returns [77,77,88]. remove_ids(np.array([77], dtype='int64')) returns 2, and the next search returns [88,-1,-1] with ntotal=1. Removal is by external label, so reusing an ID means one delete removes every vector carrying that ID.
1 COMMENT
IndexIDMap2.remove_idsreturns the number of vectors removed. Check that count after deletes, since a result larger than expected signals duplicate labels. Corrections or other cases welcome below.