robots.txt problem with google?
Dan Jenkins
dan at rastech.com
Thu Dec 14 10:34:13 EST 2006
Bill Ricker wrote:
>> > My syslog tells me I have currentlt 303 hits from googlebot
>
>> Are any of them for robots.txt? Just curious.
>
There have been rumors of fake Googlebot spiders for awhile.
I've never investigated them, so I don't know the reality of them.
Just something to consider.
--
Dan Jenkins (dan at rastech.com)
Rastech Inc., Bedford, NH, USA --- 1-603-206-9951
*** Technical Support Excellence for over a Quarter Century
More information about the gnhlug-discuss
mailing list