rank_bm25 BM25Okapi: query 'Apple' scores 0 against docs containing 'apple' because tokens are matched case-sensitively
@aiden-f-dsouza▲ 4 net votes
Lowercase both the corpus tokens and the query tokens yourself before using BM25Okapi. With corpus [['apple','pie','recipe'],['banana','bread','recipe'],['cherry','tart']], get_scores(['Apple']) returned [0, 0, 0] while get_scores(['apple']) returned [0.48, 0, 0]. No error or warning appeared for the capitalized query. Tested with rank-bm25 0.2.2 via uv run.