[Previous] [Next] - [Index] [Thread Index] - [Previous in Thread] [Next in Thread]

Subject: Re: UKNM: robots.txt - are you at risk?
From: Kief Morris
Date: Wed, 28 Jun 2000 12:15:18 +0100

Lee [dot] Rickleratjoshua-agency [dot] co [dot] uk typed the following on 17:09 27/06/00 +0100
> hhhmmm ... very similar article to:
>Also ...
>robots.txt files are fine but for real security

robots.txt has *nothing* to do with security, the purpose of the file is
to warn robots which sections of the site can get them into a mess
due to dynamically generated content and links, secondarily to advise
of content you'd prefer not have in search directories.

Anybody ignorant and/or lazy enough to use robots.txt as a security
mechanism needs to be culled from the Web herd. Maybe script
kiddiez have a useful purpose in the ecosystem after all.

The Wildest party on the Net is about to begin ...

the UK's totally managed affiliate marketing solution.
ukaffiliates.com >> the net.working
http://www.ukaffiliates.com / salesatukaffiliates [dot] com (mailto:salesatukaffiliates [dot] com)
telephone: 020 7691 1880 / fax: 020 7691 1881
To unsubscribe or change your list settings go to
http://www.chinwag.com/uk-netmarketing or helpatchinwag [dot] com

  Re: UKNM: robots.txt - are you at risk?, Lee.Rickler

[Previous] [Next] - [Index] [Thread Index] - [Next in Thread] [Previous in Thread]