The Model Has No Seahorse: Vocabulary Gaps and What They Reveal About LLMs

There is no seahorse emoji in Unicode. A language model may nevertheless claim there is one or emit a plausible substitute. That failure is real, but the output alone does not tell us whether tokenisation, training data, prompting, decoding, or verification caused it.

4 March 2026 · 5 min · Sebastian Spicker