I'm curious to hear of experiences running distributed filesystems like glusterfs or ceph (others too?) on Digitalocean's block storage.
I've got a side project that will be continuously adding many 50kb to 20mb files, so easy expansion is necessary.
Any "at-scale" (ie. production, under real load) performance reports/benchmarks appreciated.
Reliability, recovery from node failure, etc comments welcome.
This cost two months of my life and I was not flavur of the month with my employer.
I eventually tried lsyncd ( https://axkibe.github.io/lsyncd/) and it works like a charm. It took me about a week to get a decent setup going, but it has never let me down since, can handle large numbers of small files (similar to yours) and smaller numbers of large files. I use unison ( https://www.howtoforge.com/tutorial/unison-file-sync-between...) for web server pairs.