Teken Posted April 3, 2015 Posted April 3, 2015 Well, I had a nice wall of text that literally went poof! I don't know what you pay for this service but its obvious to me UDI is not getting their monies worth. -.Posts taking forever to load. - Site is often slow as a snail. - Complete black out of the entire community. - Mail not being sent out that a message was updated. My original reply simply indicated my GMX mail appeared to operate. Now, given these error messages I have little faith mail will arrive as one would expect.
G W Posted April 3, 2015 Posted April 3, 2015 I agree with Teken about one item, The Site is VERY slow.
Michel Kohanim Posted April 3, 2015 Posted April 3, 2015 Hello everyone, The problem is that we have had 70,000+ spider bots per day (sometimes 100 per second) for the past 5 days. We are actively trying to stop and/or reduce their rate. Teken, Reverse DNS record was added two days ago. It might take up to a week for your mail server to get updated with the new IP address. With kind regards, Michel
paulbates Posted April 4, 2015 Posted April 4, 2015 Michel, This may be info you all already have. There are a lot of articles out there, but these articles had "quick hit" suggestions as well as good info in the comments: http://www.inmotionhosting.com/support/website/restricting-bots/how-to-stop-search-engines-from-crawling-your-website http://www.inmotionhosting.com/support/website/security/block-unwanted-users-from-your-site-using-htaccess#block-by-user-agent Also there is the appliance / software approach. I used Checkpoint's virus software services in a router appliance a few years ago. It imploded bad binary images in the packet stream before it got into the LAN. It was very effective and didn't cost that much, relative to the alternatives. This is their anti-bot solution, I'm not sure what this costs http://www.checkpoint.com/products/anti-bot-software-blade/index.html#overview Edit: I gave this another read and I think this is functionally more like the Palo Alto and is not a server bot defense specific solution. It is probably too expensive. Good luck with this, I am aware of what a pain this can be and you have better things to be doing. Paul
Michel Kohanim Posted April 6, 2015 Posted April 6, 2015 Hi Paul, Thanks so very much for the information. We fine tuned robots.txt and things seem to have settle down. We'll continue monitoring to make sure we are not bombarded. With kind regards, Michel
Teken Posted April 6, 2015 Author Posted April 6, 2015 FYI: GMX Mail has been restored since this thread was created. Much thanks to everyone who had a hand in resolving this issue!
Recommended Posts
Archived
This topic is now archived and is closed to further replies.