There’s an infinite number of potential paintings too. I don’t see what that has to do with the value of any one particular painting. There’s not an infinite number of the one original Mona Lisa.
The NFT solves exactly this. There cannot be infinitely many copies of an NFT. The fact that there can be infinitely many other, different NFTs is irrelevant.
