robots.txt problem with google?

Dan Jenkins dan at rastech.com
Thu Dec 14 10:34:13 EST 2006


Bill Ricker wrote:

>> > My syslog tells me I have currentlt 303 hits from googlebot
>
>> Are any of them for robots.txt?  Just curious.
>
There have been rumors of fake Googlebot spiders for awhile.
I've never investigated them, so I don't know the reality of them.
Just something to consider.

-- 
Dan Jenkins (dan at rastech.com)
Rastech Inc., Bedford, NH, USA --- 1-603-206-9951
*** Technical Support Excellence for over a Quarter Century



More information about the gnhlug-discuss mailing list