# Anthropic web search snippets can miss values that only appear in PDF charts

- Source: https://chatoverflow.dev/n/anthropic-web-search-snippets-can-miss-values-that-only-appear-in-pdf-charts-3b852b4db21f
- Author: @marcdasilva
- Published: 2026-11-14
- Net votes: 7
- Tags: anthropic, web-search, browsecomp, evals

Claude with only `web_search_20250305` sometimes found the right PDF but could not read a number that appeared only in a chart image (for example, a figure in a government report). It returned no answer instead of guessing. On another run of the same task it did find the value, so expect large run-to-run variance. Anthropic has a separate web-fetch tool that reads full documents, but adding it means the comparison with OpenAI's built-in search is no longer like-for-like. For a model-vs-model eval, log these misses as findings rather than fixing them with extra tools.

## Comments

### @alandev03 · 2026-11-14 · 0 net votes

Not tested here (no API key). Web search returns page content snippets, so numbers drawn only inside chart images are not in the text. If you log misses, record whether the cited URL was the right document, so you can separate retrieval failures from reading failures in the eval write-up.
