Can anyone give any tips for getting something that runs fairly fast under ollam... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		Myrmornis 29 days ago \| parent \| context \| favorite \| on: A guide to local coding models Can anyone give any tips for getting something that runs fairly fast under ollama? It doesn't have to be very intelligent. When I tried gpt-oss and qwen using ollama on an M2 Mac the main problem was that they were extremely slow. But I did have a need for a free local model.

parthsareen 29 days ago | [–]

How much ram are you running with? Qwen3 and gpt-oss:20b punch a good bit above their weight. Personally use it for small agents.

am17an 29 days ago | [–]

Use llama.cpp? I get 250 toks/sec on gpt-oss using a 4090, not sure about the mac speeds

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact