Aren’t Unicode characters generally treated as 2 tokens to avoid a huge vocabula... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

noddybear 14 days ago | parent | context | favorite | on: Claude Fable 5: mid-tier results on coding tasks

Aren’t Unicode characters generally treated as 2 tokens to avoid a huge vocabulary?

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact