Re: htdig and sources.redhat.com loadavg

[Hans-Peter Nilsson <hp@bitrange.com>]

On Mon, 5 Apr 2004, David Edelsohn wrote:
> 	The load average on sources.redhat.com appears to be spiking very
> high on Monday, according to reports from people who can log in:
>
> <dnovillo>  15:56:05  up 45 days, 17:01,  1 user,  load average: 23.58, 23.54, 25.16
> <echristo>  18:31:24  up 45 days, 19:36,  2 users,  load average: 37.94, 37.67, 35.41
>
> htdig is a candidate for the root cause of the problem.  The heavy disk
> traffic and decrease in performance from htdig is generating a backlog of
> CVS operations -- 24 cvs processes in disk wait state, which further loads
> the system.
>
> 	An informal poll of the 30+ people on the #gcc IRC channel did not
> find anyone who felt htdig was useful relative to other search options.
> Four channel members suggested disabling htdig, so I would I like propose
> that to overseers.  The performance problem of sources.redhat.com on
> Monday is impacting development.

Please be informed that htdig is used on the gcc side and
sourceware side (all other projects) separately.  I don't think
what's said on #gcc shouldn't be final (or perhaps shouldn't
matter at all) for the sourceware side.

I have no problem shutting down htdig for gcc permanently.

Though it seems it wasn't considered that there could be an
error situation that led to the high load from htdig.  I just
looked and there was; a DB file is over the 2G limit once again,
and the last two updates (done every other day for gcc htdig)
have failed.  Since the updates have been from scratch and the
scripts retries once in case of failure, the load from htdig has
been much higher that what is normal.  I've shut off gcc htdig
until I get to investigate whether it's fixable (once again).

(Everyone ok with shutting off gcc htdig permanently?)

brgds, H-P