If you broke a string into overlapping blocks you could easily reconstruct it. The key here is that blocks form a sliding window on the string

If blocks were nonoverlapping then yeah the problem is much harder, akin to fitting pieces of a puzzle. I bet a language model still could do it though