In a no-growth (or even degrowth, which I have recently learned is a thing) society taking what you need from someone else is not the only option: someone can also choose to share it.

A society like that may be quite different in innumerable ways, of course, and the idea of “wealth” in the way we understand it may not make sense.