From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: by sourceware.org (Postfix, from userid 2161) id E130F3858D28; Fri, 22 Dec 2023 20:51:36 +0000 (GMT) DKIM-Filter: OpenDKIM Filter v2.11.0 sourceware.org E130F3858D28 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=sourceware.org; s=default; t=1703278296; bh=qx7Iv0rzBOnx2oskZgp2hQCCQz0mDyGvoLFhoQ253wQ=; h=To:Subject:Date:From:From; b=YfC/+403K25SOdxvKtvwYZlsKzHttgAa2uXLIxZt0ML8OnFRjwnDmJX+EaO2oSQIU ZeHfIE0qZ1/OhlRPKpB3f6062PlysV/2jQoFtFxzt1+l+5Qn0PpWil2uvWTNirhOXc 3YFlZa4eRpPnfZ93Z1vE8BbrWfLXUYQXn9ld6l2E= To: gcc-cvs-wwwdocs@gcc.gnu.org Subject: gcc-wwwdocs branch master updated. 0d8105fd15b33980886283869e980f60f2ca9f04 X-Git-Refname: refs/heads/master X-Git-Reftype: branch X-Git-Oldrev: 062897ff96bb9651f7a1e152bc2327cbda4ad89e X-Git-Newrev: 0d8105fd15b33980886283869e980f60f2ca9f04 Message-Id: <20231222205136.E130F3858D28@sourceware.org> Date: Fri, 22 Dec 2023 20:51:36 +0000 (GMT) From: Mark Wielaard List-Id: This is an automated email from the git hooks/post-receive script. It was generated because a ref change was pushed to the repository containing the project "gcc-wwwdocs". The branch, master has been updated via 0d8105fd15b33980886283869e980f60f2ca9f04 (commit) from 062897ff96bb9651f7a1e152bc2327cbda4ad89e (commit) Those revisions listed above that are new to this repository have not appeared on any other notification email; so we list those revisions in full, below. - Log ----------------------------------------------------------------- commit 0d8105fd15b33980886283869e980f60f2ca9f04 Author: Mark Wielaard Date: Fri Dec 22 21:46:32 2023 +0100 robots.txt: Disallow a few more bugzilla queries Some spiders are hitting bugzilla hard generating dependency trees or graphs, downloading large attachements or requesting all bugs in xml format. Disallow all that. diff --git a/htdocs/robots.txt b/htdocs/robots.txt index b9fc830d..057c5899 100644 --- a/htdocs/robots.txt +++ b/htdocs/robots.txt @@ -10,4 +10,8 @@ Disallow: /cgit/ Disallow: /svn Disallow: /cgi-bin/ Disallow: /bugzilla/buglist.cgi +Disallow: /bugzilla/show_bug.cgi*ctype=xml* +Disallow: /bugzilla/attachment.cgi +Disallow: /bugzilla/showdependencygraph.cgi +Disallow: /bugzilla/showdependencytree.cgi Crawl-Delay: 60 ----------------------------------------------------------------------- Summary of changes: htdocs/robots.txt | 4 ++++ 1 file changed, 4 insertions(+) hooks/post-receive -- gcc-wwwdocs