I wonder if semi-reliable RAM could be made to work for training. After all gradient descent already works in a stochastic environment, so maybe the noise from a few flipped bits doesn't matter too much.