Is this normal?

[Curt Howland]

On Fri, Jun 14, 2013 at 9:03 AM, Tom Buskey <tom at buskey.name> wrote:
> robots.txt is just like the yellow line on the highway.  Having everyone
> honor it is what keeps you from having a 50 mph head on collision but the
> line won't do anything to prevent it.

Well put. It's an element of the cooperative nature of the Net.

But cooperation means that an unethical individual can cheat. It also
means they will get caught.

Curt-