A spectre is haunting Unicode
- Unicode
- Infrastructure
- Programming
- Internationalization
The post is a tour of “ghost characters” in Unicode and earlier East Asian standards. These are code points for characters that slipped into official registries through mistakes like manuscript copying, dictionary carryovers, or scan errors, then became hard to remove once standards adopted them. The piece uses examples from Japanese and Chinese text history to show how a non-character can become real enough for software to carry forever.
If your product handles Chinese, Japanese, or Korean text, treat Unicode code points as an encoding layer, not proof that a character is meaningful or interchangeable across locales. Budget for font, normalization, search, and OCR edge cases instead of assuming Unicode solved them for you.
-
dampfkraft.com
- Discuss on HN