Slurped

[ThomasW]

Is it just me or has anyone else noticed since MSN started their search engine that the other bots come a lot more frequently and more deeply?

It seems that Inktomi is on all of my sites daily the past few months.
A lot of the sites are very static in nature so nothing has changed...

Just some food for thought I guess.

[dammitjanet]

if its a problem, jut set up a robots.txt to set the interval you want the robots to come around.

Some of the sites I administer, get daily Google and Inktomi scans, which for hem is a good thng since they are very dynamic sites with constantly changing content.