Some people have zero sympathy for viewpoints that differ from their own, which leads to individual polarization. But some people have an excess of such sympathy, which can contribute to collective polarization.

They are very worried about being fair-minded. They see a vocal minority as social proof that the minority viewpoint is sincere, thoughtful and worthy of consideration. Neither is a bad assumption to start with, but it's not a great place to end the thought process.