Could it be that Anthropic is using the Chinese characters trick to consume less... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

maaaaattttt 25 days ago | parent | context | favorite | on: Claude Fable 5: mid-tier results on coding tasks

Could it be that Anthropic is using the Chinese characters trick to consume less tokens behind the scenes?

noddybear 25 days ago | [–]

Aren’t Unicode characters generally treated as 2 tokens to avoid a huge vocabulary?

winrid 25 days ago | [–]

It used a chinese character instead of the word "true"

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact