exactly.. parquet is good for append only.. stream mods to parquet in new partit...

		cmollis on July 31, 2024 \| parent \| context \| favorite \| on: Amazon's exabyte-scale migration from Apache Spark... exactly.. parquet is good for append only.. stream mods to parquet in new partitions.. compact, repeat.