Dev here...

We have tied together parts of https://github.com/daviferreira/medium-editor, vanilla-js and jquery :)

digitalpbk$ nslookup smtp.google.com Server: 8.8.8.8 Address: 8.8.8.8#53

server can't find smtp.google.com: NXDOMAIN

SMTP servers are down for me. Anyone else?

NXDOMAIN wouldn't be server down, that's no DNS record. Still won't work, but different (much bigger) issue.

I'm pretty sure the 'bigger' issue here is that it's smtp.gmail.com - smtp.google.com is, I believe, always down on account of not existing. :P

Works fine for me:

    > dig +short @8.8.8.8 smtp.gmail.com
    gmail-smtp-msa.l.google.com.
    74.125.136.108
    74.125.136.109

http://homepage.ntlworld.com/jonathan.deboynepollard/FGA/nsl...

Or: smtp.googlemail.com

try `nslookup -querytype=MX google.com`

http://www.cucumbertown.com/magazine, I think we have it pretty clear about what goes to where.

yup

Server: google-public-dns-a.google.com Address: 8.8.8.8

* google-public-dns-a.google.com can't find stackoverflow.com: Server failed

Same for me, I'm on the east coast if that makes a difference

No, it won't, both their primary and secondary DNS are resolving it with SERVFAIL.

Pretty bad...

Most of the IPs are from the EC2 subnet.

Mostly duplicate content & messing up my analytics (increased bounce rate, decreased time spend on page etc.)

Because it seems to be from selenium (from referer), it is triggering the JS too, we are using Google Analytics.

Why not exclude the EC2 ip range from analytics ?

What analytics are you using? I thought most would use javascript to avoid problems like this, and I would wager that the vast majority of bots don't bother executing javascript. You will always have legit bots hitting your site as well.

Selenium executes Javascript, as do other WebKit-based scrapers, like phantom.js.

Developer here, since we had a click to open form at the time, we loaded the CSRF via AJAX. However that does not seem to be a good idea if we need it to work asap (and without javascript). I would look at something like SSI to put in the CSRF token to a cached page.