Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
artemisart
on May 22, 2024
|
parent
|
context
|
favorite
| on:
Ask HN: Which LLMs can run locally on most consume...
No, the Nvidia 4070 Ti has much higher performance, TOPS is for integer operations, the 4070 Ti has ~40 float32 TFLOPS and 641 TOPS
https://www.nvidia.com/fr-fr/geforce/graphics-cards/40-serie...
(which I would say would be peak TOPS for int4 operations, comparing it to the 4080 datasheet, and a bit more than half that for int8 operations)
https://images.nvidia.com/aem-dam/Solutions/geforce/ada/nvid...
page 34. I did not find the datasheet for 4070 Ti.
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search: