Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

> Language models read text in chunks called tokens. In English, a token can be as short as one character or as long as one word (e.g., a or apple), and in some languages tokens can be even shorter than one character or even longer than one word.

Why should the Germans get a discount?



Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: