On 6 May 2004 at 17:05, Dennis Budd <[log in to unmask]> wrote:
> But LSTOWN is a public archive. I've never been asked for my
> subscription when I've accessed it via the web. So that can't be the
> difference.
Here is the robots.txt file that we've had on the Peach server's main
archives page for years:
User-agent: *
Disallow: /scripts
It seems to have done the job.
Francoise