Re: Automated build-and-test summary report (2007/11/05)

[Kris Van Hees <kris.van.hees@oracle.com>]

On Tue, Nov 06, 2007 at 01:22:56PM +0100, Mark Wielaard wrote:
> OK, so "First failure:  no changes - not built" actually means that the
> sources didn't change from the last time the builder ran and so it
> wasn't build. Correct? If so the "First Failure" part confused me.

Yes, in the email report the first failure entry actually gives the first
stage in the build-and-run instance where a failure was detected.  There are
actually three possible entry types here (both for the current result and for
the previous result):

	- no failures: this obviously is a rare entry, because it means that
		all stages completed without any problem
	- no changes - not built: this is reported when there were not changes
		found in the source tree during the build-and-test run; labrat
		doesn't perform a build/test run unless at least something in
		the source tree changed
	- a stage name: the most common case, reporting the first stage that
		failed

I guess it can be a bit confusing in cases like:

	First failure:  test (was no changes - not built)

especially because it might (incorrectly0 read as if the (was...) part is
actually an explanation of why 'test' was the first failure, rather than
reflecting the previous state (result of the previous build we're comparing
to).

Would it be more clear if I changed that to be:

	First failure:  test (previously: no changes - not built)

> > The fact that the (usually) downloadable logs are not being shown as links
> > (that section is empty) is a bug.  I'll send notice when it is resolved.
> 
> OK, yes, that was the other confusion.

Being worked on right now.  The nice part of task separation is that one thing
failing in the reporting engine won't stop the rest from work.  The less nice
part of task separation is that if one thing in the reporting engine fails and
the rest keeps working, it is not necessarily noticed (by me) that there is a
problem :)  Win a few, lose a few.

	Cheers,
	Kris