robots.txt problem with google?
    Dan Jenkins 
    dan at rastech.com
       
    Thu Dec 14 10:34:13 EST 2006
    
    
  
Bill Ricker wrote:
>> > My syslog tells me I have currentlt 303 hits from googlebot
>
>> Are any of them for robots.txt?  Just curious.
>
There have been rumors of fake Googlebot spiders for awhile.
I've never investigated them, so I don't know the reality of them.
Just something to consider.
-- 
Dan Jenkins (dan at rastech.com)
Rastech Inc., Bedford, NH, USA --- 1-603-206-9951
*** Technical Support Excellence for over a Quarter Century
    
    
More information about the gnhlug-discuss
mailing list