public inbox for gcc-cvs-wwwdocs@sourceware.org
help / color / mirror / Atom feed
* wwwdocs/htdocs robots.txt
@ 2014-07-15  7:49 rguenth
  0 siblings, 0 replies; 10+ messages in thread
From: rguenth @ 2014-07-15  7:49 UTC (permalink / raw)
  To: gcc-cvs-wwwdocs

Files modified in the GCC repository. Log entry:

2014-07-15  Richard Biener  <rguenther@suse.de>

	* robots.txt: Disallow /git/


^ permalink raw reply	[flat|nested] 10+ messages in thread
* wwwdocs/htdocs robots.txt
@ 2015-06-03 17:10 fche
  0 siblings, 0 replies; 10+ messages in thread
From: fche @ 2015-06-03 17:10 UTC (permalink / raw)
  To: gcc-cvs-wwwdocs

Files modified in the GCC repository. Log entry:

discourage robots from traversing /viewvc/ too


^ permalink raw reply	[flat|nested] 10+ messages in thread
* wwwdocs/htdocs robots.txt
@ 2013-05-02 19:14 fche
  0 siblings, 0 replies; 10+ messages in thread
From: fche @ 2013-05-02 19:14 UTC (permalink / raw)
  To: gcc-cvs-wwwdocs

Files modified in the GCC repository. Log entry:

Disallow /svn for web robots


^ permalink raw reply	[flat|nested] 10+ messages in thread
* wwwdocs/htdocs robots.txt
@ 2011-05-17  5:26 ian
  0 siblings, 0 replies; 10+ messages in thread
From: ian @ 2011-05-17  5:26 UTC (permalink / raw)
  To: gcc-cvs-wwwdocs

Files modified in the GCC repository. Log entry:

Block "/viewcvs", not "/viewcvs/", as protocol looks for prefixes, and
some retrieves look like, e.g., "GET viewcvs?view=revision...".


^ permalink raw reply	[flat|nested] 10+ messages in thread
* wwwdocs/htdocs robots.txt
@ 2011-05-13 17:09 ian
  0 siblings, 0 replies; 10+ messages in thread
From: ian @ 2011-05-13 17:09 UTC (permalink / raw)
  To: gcc-cvs-wwwdocs

Files modified in the GCC repository. Log entry:

Don't let search bots look at lists of bugs, as it is taking a lot of
CPU time.


^ permalink raw reply	[flat|nested] 10+ messages in thread
* wwwdocs/htdocs robots.txt
@ 2009-09-22 19:19 fche
  0 siblings, 0 replies; 10+ messages in thread
From: fche @ 2009-09-22 19:19 UTC (permalink / raw)
  To: gcc-cvs-wwwdocs

Files modified in the GCC repository. Log entry:

* remove bugzilla/, to let spiders see it


^ permalink raw reply	[flat|nested] 10+ messages in thread
* wwwdocs/htdocs robots.txt
@ 2006-05-27 20:59 gerald
  0 siblings, 0 replies; 10+ messages in thread
From: gerald @ 2006-05-27 20:59 UTC (permalink / raw)
  To: gcc-cvs-wwwdocs

Files modified in the GCC repository. Log entry:

Remove Allow: /cgi-bin/fom.cgi.  We no longer have the Faq-o-matic
running.


^ permalink raw reply	[flat|nested] 10+ messages in thread
* wwwdocs/htdocs robots.txt
@ 2005-10-30  3:09 dberlin
  0 siblings, 0 replies; 10+ messages in thread
From: dberlin @ 2005-10-30  3:09 UTC (permalink / raw)
  To: gcc-cvs-wwwdocs

Files modified in the GCC repository. Log entry:

We don't want people crawling viewcvs either


^ permalink raw reply	[flat|nested] 10+ messages in thread
* wwwdocs/htdocs robots.txt
@ 2005-03-21 18:38 fche
  0 siblings, 0 replies; 10+ messages in thread
From: fche @ 2005-03-21 18:38 UTC (permalink / raw)
  To: gcc-cvs-wwwdocs

Files modified in the GCC repository. Log entry:

* crawl delay added


^ permalink raw reply	[flat|nested] 10+ messages in thread
* wwwdocs/htdocs robots.txt
@ 2004-04-12 22:09 fche
  0 siblings, 0 replies; 10+ messages in thread
From: fche @ 2004-04-12 22:09 UTC (permalink / raw)
  To: gcc-cvs-wwwdocs

Files modified in the GCC repository. Log entry:

* keep search engines out of /bugzilla/


^ permalink raw reply	[flat|nested] 10+ messages in thread
end of thread, other threads:[~2015-06-03 17:10 UTC | newest]

Thread overview: 10+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2014-07-15  7:49 wwwdocs/htdocs robots.txt rguenth
  -- strict thread matches above, loose matches on Subject: below --
2015-06-03 17:10 fche
2013-05-02 19:14 fche
2011-05-17  5:26 ian
2011-05-13 17:09 ian
2009-09-22 19:19 fche
2006-05-27 20:59 gerald
2005-10-30  3:09 dberlin
2005-03-21 18:38 fche
2004-04-12 22:09 fche

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for read-only IMAP folder(s) and NNTP newsgroup(s).