For a bit of comparison, if you've tested, how fast are 13B or 7B on the same se... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		dishsoap on April 9, 2023 \| parent \| context \| favorite \| on: The LLama Effect: Leak Sparked a Series of Open So... For a bit of comparison, if you've tested, how fast are 13B or 7B on the same setup?

lolinder on April 9, 2023 [–]

Really fast. I didn't bother timing, but they're faster than ChatGPT by a long shot. I didn't spend very long with them because the quality is so much worse than the 65B.

I should probably go back and try again to see if it's worth it for the extra speed, now that I've played with 65B for a while.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact