AWS announced Lambda durable functions today in a blog post titled "Build multi-step applications and AI workflows with AWS Lambda durable functions" [0]
Mostly playing around with stacking "powerful" words:
King Kong + Power Ranger = King Kong Ranger (first)
Megazord + Power Ranger = Power Megazord
Megazord + Power Megazord or Artzord + Megazord = Ultrazord
Dragonzord + Art = Artzord (first)
Groot + Mega Artzord = Grootzord
Megazord + Grootzord = Gigazord (first)
Godzord + Giga Artzord = Giga Godzord (first)
Giga Godzord + Giga Titanic Gigazord = Giga Titanic Godzord (first)
Giga Titanic Godzord + Mega Power Godzillazord = Super Giga Mega Titanic Power Godzillazord (first)
I also got firsts on both Earthquake Laser and Laser Earthquake, but I'm not sure what the recipes were.
Trying to get Zebra was an interesting sequence.
Tamer + Africa = Tamerlane (first)
Tamerlane + Terror = Timur (first)
Timur + Asia = Genghis Khan
Genghis Khan + Bellerophon = Alexander the Great
Alexander the Great + Unicorn = Bucephalus (first)
Alexander the Great + Bucephalus = Horse
Horse + Africa = Zebra
I don't have the hulk, but Superman mostly refuses to combine with other superheroes (Deadpool, spider-man, wolverine, aquaman) or turns into the justice league (batman). Though Superman+ghost rider= super ghost rider.
DVC is slow because it stores and writes data twice, and the default of dozens of concurrent downloads causes resource starvation. They finally improved uploads in 3.0, but downloads and storage are still much worse than a simple "aws s3 cp". You can improve pull performance somewhat by passing a reasonable value for --jobs. Storage can be improved by nuking .dvc/cache. There's no way to skip writing all data twice though.
Look for something with good algorithms. Xethub worked very well for me, and oxen looks like a good alternative. git-xet has a very nice feature that allows you to mount a repo over the network [0]
Clarification on file duplication: DVC tries to use reflinks if the filesystem supports it, and falls back on copying the files. It can be configured to use hardlinks instead for filesystems like ext4 [0]. This improves performance significantly.
[0] https://aws.amazon.com/blogs/aws/build-multi-step-applicatio...
reply