That's an interesting point, though – that compared to Chess or Go, playing against other versions of itself is less helpful for improving against humans, due to the requirement of communication with the other players.

Sure thing. But if they trained these against human players, winningly, and THEN sic'd'em on each other... oh dear.