PDA

View Full Version : MSN Bot Gone Mad



erbain
09-22-2004, 06:44 AM
Hi,

I was just wondering if anyone else is experiencing the MSNbot going a bit wild. Since the beginning of the month it has eaten up over 1GB of bandwidth.

MSNBot 51494+94 1.03 GB 21 Sep 2004 - 17:00
Inktomi Slurp 1379+181 29.52 MB 21 Sep 2004 - 15:39
GigaBot 244+33 5.98 MB 09 Sep 2004 - 02:04
Googlebot 185+58 3.91 MB 21 Sep 2004 - 13:37

This site only has about 25 pages so I don;t know what it thinks it's doing. The site uses dynamic content I suspect it's being really stupid and getting itself in a mess. I don't expect anything less from Bill.

Ewan.

BetterWebSpace
09-22-2004, 07:00 AM
Hi,

I certainly have - I have one site where it hammered a page every 3 seconds for near on a week! Hopefully it will calm down a bit once they start using the results!

Regards,
Keiron

dcmginc
09-22-2004, 07:15 AM
Same here... but it started yesterday for me. One of my forums was hit like I had never seen before. I have a little piece of code in the forum php that alerts me when Googlebot is in the site. Yesterday it was a constent flow of email. :)

miraclew
09-27-2004, 10:11 AM
maybe they are trying to beat googlebot eh :P