One issue is that over long enough timeframes, even atoms that we consider stable will decay - particularly ones that are heavier than iron, which will decay towards iron or nickel. That decay will eventually compromise the structure of the probes.