We don’t know o1 thinks in English. What we see is a summary of the thinking pro... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		MaxLeiter on Dec 15, 2024 \| parent \| context \| favorite \| on: Llama.cpp Now Supports Qwen2-VL (Vision Language M... We don’t know o1 thinks in English. What we see is a summary of the thinking process. My guess is it “thinks” in non-eligible tokens

letmevoteplease on Dec 15, 2024 | [–]

The o1 release blog post contains 8 full examples of o1 chains of thought (not the summarized versions visible to users). They're English.

https://openai.com/index/learning-to-reason-with-llms/#chain...

I have seen the summaries dip into completely random languages like Thai, so it might switch between languages occasionally.

disqard on Dec 15, 2024 | [–]

Did you mean to write "non-legible" ?

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact