From mboxrd@z Thu Jan  1 00:00:00 1970
From: Gerald Pfeifer <pfeifer@dbai.tuwien.ac.at>
To: Jason Molenda <jsm@cygnus.com>, egcs@egcs.cygnus.com
Cc: egcs-patches@egcs.cygnus.com
Subject: Re: robots.txt
Date: Wed, 31 Mar 1999 23:46:00 -0000
Message-ID: <Pine.GSO.4.10.9903112308070.24740-100000@markab.dbai.tuwien.ac.at>
References: <Pine.GSO.4.10.9902150100390.9254-100000@alphard.dbai.tuwien.ac.at>
X-SW-Source: 1999-03n/msg00431.html
Message-ID: <19990331234600.dGdX3vGB5B2QnWl1mSDKJhIig2FVyUw8Dip-daLtb5c@z>

On Wed, 10 Mar 1999, Gerald Pfeifer wrote:
> How about the following for now?

I have now installed the following robots.txt file for our egcs.cygnus.com
site as wwwdocs/htdocs/robots.txt.

---- cut ----
# See http://info.webcrawler.com/mak/projects/robots/norobots.html
# for information about the file format.
# Contact egcs@egcs.cygnus.com for questions.

User-Agent: *
Disallow: /cgi-bin/
---- cut ----

Thanks to Jason for his comments...

Gerald
-- 
Gerald "Jerry" pfeifer@dbai.tuwien.ac.at http://www.dbai.tuwien.ac.at/~pfeifer/