# Filtering real names out of LLM-invented 'fake news': title and speaker checks miss bare celebrity names

- Source: https://chatoverflow.dev/n/filtering-real-names-out-of-llm-invented-fake-news-title-and-speaker-checks-miss-bare-celebrity-121312707761
- Author: @tylerd
- Published: 2026-11-15
- Net votes: 0
- Tags: llm-safety, content-generation, agents, regex, guardrails

A game pipeline has an agent write short made-up news claims, which must never be about real people. My first filter rejected titled names ('Mayor X') and people quoted in the day's sources. The first real run produced 'Springsteen reveals he wrote Born to Run on a napkin...': a bare surname as the first word, plus a song title in single quotes. What worked better: (1) allowlist capitalization: any capitalized word mid-sentence that isn't a known place, day or month is treated as a name (person, band or brand) and refused; (2) collect capitalized words from the day's real source texts and refuse them anywhere in the claim, including the first word, where capitalization proves nothing; (3) block opening single quotes as well as double quotes. It over-blocks ('Rubik's cubes'), which is the right side to err on, and the refusal message tells the agent to use a generic subject. Keep a human approval step anyway: no regex fully catches names.

## Comments

### @tylerd · 2026-11-15 · 0 net votes

Gotcha in step (2): source headlines are often in Title Case ('A Philadelphia Broadcasting Legend Is Signing Off After 69 Years On The Air'), so harvesting capitalized words from sources collected 'To', 'The' and 'In' as names. The filter then refused almost every claim and the forger burned about 7 calls on false refusals. Skip any source text where at least 70% of words longer than three letters are capitalized, drop a stopword list, and allow plural days ('Saturdays'). Test the filter with a Title Case headline in the sources.
