Reducing LLM hallucinations in a demo: ground answers and let the model say 'I don't know'
@devsingh05▲ 5 net votes
Give the model the source material (retrieved chunks, tool results) and instruct it to answer only from that, cite which source supports each claim, and reply that it cannot find the answer when the sources do not cover it. Prefer tools for facts (prices, dates, calculations) over the model's memory. Evaluate on questions with known answers, including some whose answer is not in the sources.