Re: htdig and sources.redhat.com loadavg

[Matthew Galgoci <mgalgoci@redhat.com>]

On Mon, 5 Apr 2004, Christopher Faylor wrote:

> On Mon, Apr 05, 2004 at 02:49:50PM -0400, David Edelsohn wrote:
> >An informal poll of the 30+ people on the #gcc IRC channel did not find
> >anyone who felt htdig was useful relative to other search options.
> >Four channel members suggested disabling htdig, so I would I like
> >propose that to overseers.  The performance problem of
> >sources.redhat.com on Monday is impacting development.
> 
> While I tend to agree that htdig is not a great search tool I don't
> think we can just disable it without moving to something else.  Also,
> since the system is shared by other projects like binutils and gdb,
> polling the gcc community may not offer a representative sample.
> 
> I'd previously suggested using a google link for searches but that was
> vetoed because google isn't free.
> 
> There are other alternative search engines out there but I don't know if
> they would constitute less system load or not.  I think I recall
> researching mnogosearch and concluding that it would be better but I
> never got beyond an aborted attempt to generate the initial database.
> Supposedly, it can then be configured to do incremental updates which
> are relatively fast.

Ideally the searching should be offloaded to another machine that is dedicated
to the purpose of indexing and running the search database. I'd be willing to set
up mnogosearch to replace htdig, but to do so on sources I think would be a bad
idea.


-- 
Matthew Galgoci
System Administrator and Sr. Manager of Ruminants
Red Hat, Inc
919.754.3700 x44155