gcc-wwwdocs branch master updated. 0d8105fd15b33980886283869e980f60f2ca9f04

gcc-wwwdocs branch master updated. 0d8105fd15b33980886283869e980f60f2ca9f04

[Mark Wielaard]

This is an automated email from the git hooks/post-receive script. It was
generated because a ref change was pushed to the repository containing
the project "gcc-wwwdocs".

The branch, master has been updated
       via  0d8105fd15b33980886283869e980f60f2ca9f04 (commit)
      from  062897ff96bb9651f7a1e152bc2327cbda4ad89e (commit)

Those revisions listed above that are new to this repository have
not appeared on any other notification email; so we list those
revisions in full, below.

- Log -----------------------------------------------------------------
commit 0d8105fd15b33980886283869e980f60f2ca9f04
Author: Mark Wielaard <mark@klomp.org>
Date:   Fri Dec 22 21:46:32 2023 +0100

    robots.txt: Disallow a few more bugzilla queries
    
    Some spiders are hitting bugzilla hard generating dependency trees
    or graphs, downloading large attachements or requesting all bugs
    in xml format. Disallow all that.

diff --git a/htdocs/robots.txt b/htdocs/robots.txt
index b9fc830d..057c5899 100644
--- a/htdocs/robots.txt
+++ b/htdocs/robots.txt
@@ -10,4 +10,8 @@ Disallow: /cgit/
 Disallow: /svn
 Disallow: /cgi-bin/
 Disallow: /bugzilla/buglist.cgi
+Disallow: /bugzilla/show_bug.cgi*ctype=xml*
+Disallow: /bugzilla/attachment.cgi
+Disallow: /bugzilla/showdependencygraph.cgi
+Disallow: /bugzilla/showdependencytree.cgi
 Crawl-Delay: 60

-----------------------------------------------------------------------

Summary of changes:
 htdocs/robots.txt | 4 ++++
 1 file changed, 4 insertions(+)


hooks/post-receive
-- 
gcc-wwwdocs