robots.txt problem with google?
Thomas Charron
twaffle at gmail.com
Wed Dec 13 14:37:08 EST 2006
What's it look like?
On 12/13/06, Steven W. Orr <steveo at syslang.net> wrote:
>
> I have a big dir full of pictures and my robots.txt file excludes it. So
> now I just noticed that google is crawling through it. Anyone know what I
> shoul do?
>
--
-- Thomas
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mail.gnhlug.org/mailman/private/gnhlug-discuss/attachments/20061213/bb2406ba/attachment.html
More information about the gnhlug-discuss
mailing list