Which TPUs do you use? Cloud-hosted or your own hardware? Interesting insight. | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		renewiltord on March 11, 2024 \| parent \| context \| favorite \| on: Intel Gaudi2 chips outperform Nvidia H100 on diffu... Which TPUs do you use? Cloud-hosted or your own hardware? Interesting insight.

1024core on March 11, 2024 | [–]

"TPUs" are a Google-only product, available* only on GCP.

* Notwithstanding the Choral boards

MasterScrat on March 11, 2024 | | [–]

We started on V3s, now fully moved to V4s with some V5Es, investigating a full move towards V5E & V5P

memossy on March 11, 2024 | [–]

We use v4s, v5es & v5ps. Mostly v5ps, very stable int8 training (versus the horror that is fp8 stability)

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact