I think you'd need 2 80GB A100's for unquantised.

		zacmps on Sept 17, 2023 \| parent \| context \| favorite \| on: Run LLMs at home, BitTorrent‑style I think you'd need 2 80GB A100's for unquantised.