10,000% true which is why AI can't replace a search engine, only compliment it. If you can't surface the documents that contain the answer then you'll only get garbage.

Maybe we need an algorithm like this:

1. Search databases for documents relevant to query

2. Hand them to AI#1 which generates an answer based on the text of those documents and its background knowledge

3. Give both documents and answer to AI#2 which evaluates whether documents support answer

4. If “yes”, return answer to user. If “no”, go back to step 2 and try again

Each AI would be trained appropriately to perform its specialised task

A GAN approach to penalising a generator for generating something that is not supported by it's available data would be interesting (and I'm sure some have tried it already, I'm not following the field closely), but for many subjects creating training sets would be immensely hard (for some subjects you certainly could produce large synthetic training sets)

I've been working on something like this for fun. I know its not grownbreakimg, but it's an interesting problem.