* search engines crawling bugzilla
@ 2004-04-12 21:05 Frank Ch. Eigler
2004-04-12 21:28 ` Christopher Faylor
0 siblings, 1 reply; 2+ messages in thread
From: Frank Ch. Eigler @ 2004-04-12 21:05 UTC (permalink / raw)
To: Sourceware Overseers
[-- Attachment #1: Type: text/plain, Size: 341 bytes --]
Hi -
Part of the high load on sourceware in the last few hours has been
due to a large number of bugzilla/buglist.cgi perl scripts running.
Many of these in turn are being invoked by google. Assuming this
was unintentional, are there any objections to my listing the
bugzilla cgi directories for exclusion in the robots.txt files?
- FChE
[-- Attachment #2: Type: application/pgp-signature, Size: 189 bytes --]
^ permalink raw reply [flat|nested] 2+ messages in thread
* Re: search engines crawling bugzilla
2004-04-12 21:05 search engines crawling bugzilla Frank Ch. Eigler
@ 2004-04-12 21:28 ` Christopher Faylor
0 siblings, 0 replies; 2+ messages in thread
From: Christopher Faylor @ 2004-04-12 21:28 UTC (permalink / raw)
To: Frank Ch. Eigler; +Cc: Sourceware Overseers
On Mon, Apr 12, 2004 at 04:57:28PM -0400, Frank Ch. Eigler wrote:
>Part of the high load on sourceware in the last few hours has been
>due to a large number of bugzilla/buglist.cgi perl scripts running.
>Many of these in turn are being invoked by google. Assuming this
>was unintentional, are there any objections to my listing the
>bugzilla cgi directories for exclusion in the robots.txt files?
I'm sure this was unintentional. I see that there is already a
robots.txt file. I wonder why it is so sparse.
cgf
^ permalink raw reply [flat|nested] 2+ messages in thread
end of thread, other threads:[~2004-04-12 21:05 UTC | newest]
Thread overview: 2+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2004-04-12 21:05 search engines crawling bugzilla Frank Ch. Eigler
2004-04-12 21:28 ` Christopher Faylor
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for read-only IMAP folder(s) and NNTP newsgroup(s).