Vocabulary | Sebastian Spicker

2026

1 article

4 Mar 2026 The Model Has No Seahorse: Vocabulary Gaps and What They Reveal About LLMs There is no seahorse emoji in Unicode. A language model may nevertheless claim there is one or emit a plausible substitute. That failure is real, but the output alone does not tell us whether tokenisation, training data, prompting, decoding, or verification caused it. ailanguage-modelstokenisation