erbain
09-22-2004, 06:44 AM
Hi,
I was just wondering if anyone else is experiencing the MSNbot going a bit wild. Since the beginning of the month it has eaten up over 1GB of bandwidth.
MSNBot 51494+94 1.03 GB 21 Sep 2004 - 17:00
Inktomi Slurp 1379+181 29.52 MB 21 Sep 2004 - 15:39
GigaBot 244+33 5.98 MB 09 Sep 2004 - 02:04
Googlebot 185+58 3.91 MB 21 Sep 2004 - 13:37
This site only has about 25 pages so I don;t know what it thinks it's doing. The site uses dynamic content I suspect it's being really stupid and getting itself in a mess. I don't expect anything less from Bill.
Ewan.
I was just wondering if anyone else is experiencing the MSNbot going a bit wild. Since the beginning of the month it has eaten up over 1GB of bandwidth.
MSNBot 51494+94 1.03 GB 21 Sep 2004 - 17:00
Inktomi Slurp 1379+181 29.52 MB 21 Sep 2004 - 15:39
GigaBot 244+33 5.98 MB 09 Sep 2004 - 02:04
Googlebot 185+58 3.91 MB 21 Sep 2004 - 13:37
This site only has about 25 pages so I don;t know what it thinks it's doing. The site uses dynamic content I suspect it's being really stupid and getting itself in a mess. I don't expect anything less from Bill.
Ewan.