even if there were some mixture-of-experts shenanigans going on, there is no int... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		gcr on July 11, 2023 \| parent \| context \| favorite \| on: Claude 2 even if there were some mixture-of-experts shenanigans going on, there is no introspection or reasoning, so the model isn’t able to comment on or understand its “inner experience”, if you can call matrix multiplications an inner experience

losteric on July 11, 2023 [–]

I was imagining system-prompt-based tool use, where the LLM "knows" it can call some calculator to get digits of pi

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact