As the other comment says (but kind of hides) install earlyoom and point the config at whatever you reckon is the main culprit. It only needs done once and you can forget about it.

Edit: I should add, this is advice for desktops. If it's a server either resize or fix your service.