Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

650GB? We have 72PB IN S3, know people who have multiple EB in S3.


This is not a game of, “mine is bigger than yours”. Many many workloads in the wild are smaller than this.

Motherduck have a few posts about how few people have “big data”. https://motherduck.com/blog/redshift-files-hunt-for-big-data...


That has to be multiple data sets. How big are your individual nightly jobs, and what are you processing them with?




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: