Surely there are actions you can take between "call the cops" and "ignore it"?

Maybe talk to the guy? Hear his side, maybe give him a warning?