From mboxrd@z Thu Jan 1 00:00:00 1970 From: Gerald Pfeifer To: Jason Molenda , egcs@egcs.cygnus.com Subject: robots.txt Date: Tue, 09 Mar 1999 15:04:00 -0000 Message-id: X-SW-Source: 1999-03/msg00360.html I noticed that we don't (yet) have a robots.txt file for the egcs web server. How about the following for now? User-Agent: * Disallow: /cgi-bin/ If there are no objections, I'll commit that in a couple of days... Gerald -- Gerald Pfeifer (Jerry) Vienna University of Technology pfeifer@dbai.tuwien.ac.at http://www.dbai.tuwien.ac.at/~pfeifer/ From mboxrd@z Thu Jan 1 00:00:00 1970 From: Gerald Pfeifer To: Jason Molenda , egcs@egcs.cygnus.com Subject: robots.txt Date: Wed, 31 Mar 1999 23:46:00 -0000 Message-ID: X-SW-Source: 1999-03n/msg00362.html Message-ID: <19990331234600.wCJst3GPBKtaMx7SGVWX3pg0_WXclN5dHyyWIADJip0@z> I noticed that we don't (yet) have a robots.txt file for the egcs web server. How about the following for now? User-Agent: * Disallow: /cgi-bin/ If there are no objections, I'll commit that in a couple of days... Gerald -- Gerald Pfeifer (Jerry) Vienna University of Technology pfeifer@dbai.tuwien.ac.at http://www.dbai.tuwien.ac.at/~pfeifer/