I've noticed this style of usage greatly reduces the quality of work my colleagues produce. The computer is great at writing stuff that looks right, but is not.

Also, at least some of the "increased productivity" boils down to "I spent less time thinking about the underlying problem while I was composing text and copy-editing".

But what about the times where your colleagues use LLMs in this way, but the output is good enough that you don't realize it?