> get dinged because you couldn’t remember whether the protagonist put on an otherwise irrelevant blue sweater or red jacket

This sounds like a bad quiz, unless the story was set in e.g. the American revolution.