robots.txt problem with google?
Steven W. Orr
steveo at syslang.net
Wed Dec 13 14:33:31 EST 2006
I have a big dir full of pictures and my robots.txt file excludes it. So
now I just noticed that google is crawling through it. Anyone know what I
shoul do?
--
Time flies like the wind. Fruit flies like a banana. Stranger things have .0.
happened but none stranger than this. Does your driver's license say Organ ..0
Donor?Black holes are where God divided by zero. Listen to me! We are all- 000
individuals! What if this weren't a hypothetical question?
steveo at syslang.net
More information about the gnhlug-discuss
mailing list