The Model Has No Seahorse: Vocabulary Gaps and What They Reveal About LLMs
There is no seahorse emoji in Unicode. Ask a large language model to produce one and watch what happens. The failure is not a hallucination in the ordinary sense — the model knows what it wants to output but cannot output it. That distinction matters.