Bots don't honor 301 :(

Ben Scott dragonhawk at gmail.com
Tue Jan 13 22:25:18 EST 2009


On Tue, Jan 13, 2009 at 12:00 PM,  <VirginSnow at vfemail.net> wrote:
> Assuming the bot is deterministic, hosts are likely to be
> scanned in the same order by every copy of the bot.

  And assuming the bot only ever scans one host, we only have to shut
off that one host and the problem is solved for all time.

-- Ben


More information about the gnhlug-discuss mailing list