The only issue I personally ever had was gmail tagging almost anything as spam after I initially imported all my old email. It would even tag mails from my contacts as spam, but this stopped after a week or so. I've never encountered anything like what you describe.