robots.txt problem with google?

Thomas Charron twaffle at gmail.com
Wed Dec 13 14:37:08 EST 2006


 What's it look like?

On 12/13/06, Steven W. Orr <steveo at syslang.net> wrote:
>
> I have a big dir full of pictures and my robots.txt file excludes it. So
> now I just noticed that google is crawling through it. Anyone know what I
> shoul do?
>

-- 
-- Thomas
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mail.gnhlug.org/mailman/private/gnhlug-discuss/attachments/20061213/bb2406ba/attachment.html


More information about the gnhlug-discuss mailing list