Interesting finding! The conclusion for me is that language models need to be trained more carefully, on a wider corpus and without undue emphasis on any source, to generate more representative and idiomatic text.