https://mbrenndoerfer.com/writing/tokenization-challenges-numbers-code-multilingual-unicode/tokenization-challenges2026-01-20T03:38:52.000Zhttps://mbrenndoerfer.com/writing/tokenization-challenges-numbers-code-multilingual-unicode/number-tokenization2026-01-20T03:38:52.000Zhttps://mbrenndoerfer.com/writing/tokenization-challenges-numbers-code-multilingual-unicode/code-tokenization2026-01-20T03:38:52.000Zhttps://mbrenndoerfer.com/writing/tokenization-challenges-numbers-code-multilingual-unicode/multilingual-text-and-the-token-budget-problem2026-01-20T03:38:52.000Zhttps://mbrenndoerfer.com/writing/tokenization-challenges-numbers-code-multilingual-unicode/emoji-and-unicode-edge-cases2026-01-20T03:38:52.000Zhttps://mbrenndoerfer.com/writing/tokenization-challenges-numbers-code-multilingual-unicode/tokenization-artifacts2026-01-20T03:38:52.000Zhttps://mbrenndoerfer.com/writing/tokenization-challenges-numbers-code-multilingual-unicode/adversarial-tokenization2026-01-20T03:38:52.000Zhttps://mbrenndoerfer.com/writing/tokenization-challenges-numbers-code-multilingual-unicode/measuring-tokenization-quality2026-01-20T03:38:52.000Zhttps://mbrenndoerfer.com/writing/tokenization-challenges-numbers-code-multilingual-unicode/code-implementation2026-01-20T03:38:52.000Zhttps://mbrenndoerfer.com/writing/tokenization-challenges-numbers-code-multilingual-unicode/limitations-and-impact2026-01-20T03:38:52.000Zhttps://mbrenndoerfer.com/writing/tokenization-challenges-numbers-code-multilingual-unicode/summary2026-01-20T03:38:52.000Zhttps://mbrenndoerfer.com/writing/tokenization-challenges-numbers-code-multilingual-unicode/quiz2026-01-20T03:38:52.000Z