* Re: Automated build-and-test summary report (2007/11/07)
[not found] <20071107123714.GA12748@oracle.com>
@ 2007-11-07 21:52 ` Kris Van Hees
2007-11-07 22:17 ` Mark Wielaard
0 siblings, 1 reply; 3+ messages in thread
From: Kris Van Hees @ 2007-11-07 21:52 UTC (permalink / raw)
To: frysk
All,
Sami made the suggestion that perhaps the list of failed tests (and broken I
would assume) should be included in the daily email. It's not a major change
in terms of coding, though it would increase the size of the daily email report
by about 600-700 lines (and more if we end up adding more configurations to the
reporting structure).
Opinions?
Cheers,
Kris
On Wed, Nov 07, 2007 at 07:37:14AM -0500, Kris Van Hees wrote:
> More results (and detailed reports) can be found on the labrat website:
>
> http://build.alchar.org/
>
> ------------------------------------------------------------------------------
> Package: frysk_fresh
> Previous build: 2007/11/06 00:43:26 - 2007/11/06 01:08:16
> Current build: 2007/11/07 00:43:11 - 2007/11/07 01:03:10
> Host: ca-tools2
> Platform: Linux 2.6.22.9-61.fc6 i386 (FC6)
> URL: http://build.alchar.org/cgi/showBuild?host=ca-tools2&pkg=frysk_fresh&date=20071107-004311
> First failure: test
> Test result: 1051: 942 +, 35 -, 3 S, 71 E (before: 1049: 953 +, 31 -, 3 S, 62 E)
>
> Old -> New Test
> ----- ----- ----------------------------------
> PASS -> ERRR frysk-sys - testTextFuncPokeBytes(frysk.sys.TestPtrace)
> ERRR -> PASS frysk-sys - testOffsetOverBound(frysk.sys.TestPtrace)
> PASS -> FAIL frysk-sys - testDaemonExecute(frysk.sys.TestPipePair)
> PASS -> ERRR frysk-sys - testDaemonTee(frysk.sys.TestPipePair)
> ERRR -> PASS frysk-sys - testDataValPokeBytes(frysk.sys.TestPtrace)
> ERRR -> FAIL frysk-sys - testTextStackPeekBytes(frysk.sys.TestPtrace)
> PASS -> ERRR frysk-sys - testTextFuncPeek(frysk.sys.TestPtrace)
> PASS -> ERRR frysk-sys - testDataStackPeek(frysk.sys.TestPtrace)
> PASS -> ERRR frysk-sys - testChildExecute(frysk.sys.TestPipePair)
> PASS -> ERRR frysk-sys - testChildTee(frysk.sys.TestPipePair)
> PASS -> ERRR frysk-sys - testLeakyPipes(frysk.sys.TestLeakingFileDescriptor)
> PASS -> ERRR frysk-sys - testDataStackPoke(frysk.sys.TestPtrace)
> PASS -> ERRR frysk-sys - testTextValPoke(frysk.sys.TestPtrace)
> N/A -> PASS frysk-sys - PASS
> ERRR -> PASS frysk-sys - testDataFuncPokeBytes(frysk.sys.TestPtrace)
> FAIL -> PASS frysk-sys - testShortTimeout(frysk.sys.TestWait)
> PASS -> FAIL frysk-sys - testTextStackPeek(frysk.sys.TestPtrace)
> FAIL -> N/A frysk-sys - testLengthUnderBound(frysk.sys.TestPtrace)FAIL
> PASS -> ERRR frysk-sys - testLengthOverBound(frysk.sys.TestPtrace)
> PASS -> FAIL frysk-sys - testTextStackPoke(frysk.sys.TestPtrace)
> PASS -> ERRR frysk-sys - testTextValPeek(frysk.sys.TestPtrace)
> N/A -> FAIL frysk-sys - FAIL
> ERRR -> PASS frysk-sys - testDataStackPeekBytes(frysk.sys.TestPtrace)
> ERRR -> FAIL frysk-sys - testTextStackPokeBytes(frysk.sys.TestPtrace)
> PASS -> ERRR frysk-sys - testTextFuncPoke(frysk.sys.TestPtrace)
> ERRR -> PASS frysk-sys - testTextValPokeBytes(frysk.sys.TestPtrace)
> PASS -> ERRR frysk-sys - testDataFuncPeekBytes(frysk.sys.TestPtrace)
>
> ------------------------------------------------------------------------------
> Package: frysk_fresh
> Previous build: 2007/11/06 02:08:11 - 2007/11/06 03:08:49
> Current build: 2007/11/07 01:59:07 - 2007/11/07 02:57:30
> Host: ca-tools4
> Platform: Linux 2.6.23.1-10.fc7 x86_64 (F7)
> URL: http://build.alchar.org/cgi/showBuild?host=ca-tools4&pkg=frysk_fresh&date=20071107-015907
> First failure: test
> Test result: 1036: 938 +, 41 -, 3 S, 54 E (before: 1036: 938 +, 40 -, 3 S, 55 E)
>
> Old -> New Test
> ----- ----- ----------------------------------
> PASS -> FAIL frysk-core - testArray(frysk.debuginfo.TestTypeEntry)
> ERRR -> PASS frysk-core - testLineSteppingList(frysk.stepping.TestSteppingEngine)
>
> ------------------------------------------------------------------------------
> Package: frysk_fresh
> Previous build: 2007/11/06 03:54:18 - 2007/11/06 04:36:43
> Current build: 2007/11/07 03:54:17 - 2007/11/07 04:37:25
> Host: coldstone
> Platform: Linux 2.6.22.9-61.fc6 x86_64 (FC6)
> URL: http://build.alchar.org/cgi/showBuild?host=coldstone&pkg=frysk_fresh&date=20071107-035417
> First failure: test
> Test result: 1036: 952 +, 25 -, 4 S, 55 E (before: 1036: 950 +, 27 -, 4 S, 55 E)
>
> Old -> New Test
> ----- ----- ----------------------------------
> FAIL -> PASS frysk-sys - TestRunner
> FAIL -> PASS frysk-sys - testShortTimeout(frysk.sys.TestWait)
>
> ------------------------------------------------------------------------------
> Package: frysk_incr
> Previous build: 2007/11/06 00:24:04 - 2007/11/06 00:43:25
> Current build: 2007/11/07 00:24:03 - 2007/11/07 00:43:10
> Host: ca-tools2
> Platform: Linux 2.6.22.9-61.fc6 i386 (FC6)
> URL: http://build.alchar.org/cgi/showBuild?host=ca-tools2&pkg=frysk_incr&date=20071107-002403
> First failure: test
> Test result: 1036: 955 +, 26 -, 3 S, 52 E (before: 1048: 945 +, 33 -, 3 S, 67 E)
>
> Old -> New Test
> ----- ----- ----------------------------------
> ERRR -> PASS frysk-sys - testTextFuncPokeBytes(frysk.sys.TestPtrace)
> FAIL -> PASS frysk-sys - testDaemonExecute(frysk.sys.TestPipePair)
> ERRR -> PASS frysk-sys - testDaemonTee(frysk.sys.TestPipePair)
> FAIL -> PASS frysk-sys - TestRunner
> FAIL -> PASS frysk-sys - testTextStackPeekBytes(frysk.sys.TestPtrace)
> ERRR -> PASS frysk-sys - testTextFuncPeek(frysk.sys.TestPtrace)
> ERRR -> PASS frysk-sys - testLengthUnderBound(frysk.sys.TestPtrace)
> ERRR -> PASS frysk-sys - testAttachDetach(frysk.sys.TestPtrace)
> FAIL -> PASS frysk-sys - testChildExecute(frysk.sys.TestPipePair)
> ERRR -> PASS frysk-sys - testChildTee(frysk.sys.TestPipePair)
> ERRR -> PASS frysk-sys - testLeakyPipes(frysk.sys.TestLeakingFileDescriptor)
> FAIL -> PASS frysk-sys - testDataStackPoke(frysk.sys.TestPtrace)
> ERRR -> PASS frysk-sys - testLengthOnBound(frysk.sys.TestPtrace)
> ERRR -> PASS frysk-sys - testDataValPoke(frysk.sys.TestPtrace)
> ERRR -> PASS frysk-sys - testDataFuncPokeBytes(frysk.sys.TestPtrace)
> ERRR -> PASS frysk-sys - testOffsetOnBound(frysk.sys.TestPtrace)
> ERRR -> PASS frysk-sys - testTextStackPeek(frysk.sys.TestPtrace)
> ERRR -> PASS frysk-sys - testLengthOverBound(frysk.sys.TestPtrace)
> FAIL -> PASS frysk-sys - testTextStackPokeBytes(frysk.sys.TestPtrace)
> ERRR -> PASS frysk-sys - testDataFuncPoke(frysk.sys.TestPtrace)
> ERRR -> PASS frysk-sys - testLeakyFileDescriptors(frysk.sys.TestLeakingFileDescriptor)
>
> ------------------------------------------------------------------------------
> Package: frysk_incr
> Previous build: 2007/11/06 01:12:01 - 2007/11/06 02:08:10
> Current build: 2007/11/07 01:12:01 - 2007/11/07 01:59:06
> Host: ca-tools4
> Platform: Linux 2.6.23.1-10.fc7 x86_64 (F7)
> URL: http://build.alchar.org/cgi/showBuild?host=ca-tools4&pkg=frysk_incr&date=20071107-011201
> First failure: test
> Test result: 1036: 937 +, 41 -, 3 S, 55 E (before: 1036: 936 +, 42 -, 3 S, 55 E)
>
> Old -> New Test
> ----- ----- ----------------------------------
> FAIL -> PASS frysk-core - testHpdBreakpointInline(frysk.hpd.TestBreakpoints)
>
> ------------------------------------------------------------------------------
> Package: frysk_incr
> Previous build: 2007/11/06 03:34:02 - 2007/11/06 03:54:07
> Current build: 2007/11/07 03:34:02 - 2007/11/07 03:54:05
> Host: coldstone
> Platform: Linux 2.6.22.9-61.fc6 x86_64 (FC6)
> URL: http://build.alchar.org/cgi/showBuild?host=coldstone&pkg=frysk_incr&date=20071107-033402
> First failure: test
> Test result: 1036: 952 +, 25 -, 4 S, 55 E
>
> Old -> New Test
> ----- ----- ----------------------------------
> (No differences.)
>
^ permalink raw reply [flat|nested] 3+ messages in thread
* Re: Automated build-and-test summary report (2007/11/07)
2007-11-07 21:52 ` Automated build-and-test summary report (2007/11/07) Kris Van Hees
@ 2007-11-07 22:17 ` Mark Wielaard
2007-11-08 15:08 ` Sami Wagiaalla
0 siblings, 1 reply; 3+ messages in thread
From: Mark Wielaard @ 2007-11-07 22:17 UTC (permalink / raw)
To: Kris Van Hees; +Cc: frysk
[-- Attachment #1: Type: text/plain, Size: 691 bytes --]
Hi Kris,
On Wed, 2007-11-07 at 16:51 -0500, Kris Van Hees wrote:
> Sami made the suggestion that perhaps the list of failed tests (and broken I
> would assume) should be included in the daily email. It's not a major change
> in terms of coding, though it would increase the size of the daily email report
> by about 600-700 lines (and more if we end up adding more configurations to the
> reporting structure).
>
> Opinions?
I think that is a good idea. People explicitly subscribe to the
testresults mailinglist. And hopefully it gets so annoying that we
finally figure out how to get to zero FAIL on all these setups. Which
really should be out goal.
Cheers,
Mark
[-- Attachment #2: This is a digitally signed message part --]
[-- Type: application/pgp-signature, Size: 189 bytes --]
^ permalink raw reply [flat|nested] 3+ messages in thread
* Re: Automated build-and-test summary report (2007/11/07)
2007-11-07 22:17 ` Mark Wielaard
@ 2007-11-08 15:08 ` Sami Wagiaalla
0 siblings, 0 replies; 3+ messages in thread
From: Sami Wagiaalla @ 2007-11-08 15:08 UTC (permalink / raw)
To: Mark Wielaard; +Cc: Kris Van Hees, frysk
Mark Wielaard wrote:
> And hopefully it gets so annoying that we
> finally figure out how to get to zero FAIL on all these setups. Which
> really should be out goal.
>
Ditto :)
^ permalink raw reply [flat|nested] 3+ messages in thread
end of thread, other threads:[~2007-11-08 15:08 UTC | newest]
Thread overview: 3+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
[not found] <20071107123714.GA12748@oracle.com>
2007-11-07 21:52 ` Automated build-and-test summary report (2007/11/07) Kris Van Hees
2007-11-07 22:17 ` Mark Wielaard
2007-11-08 15:08 ` Sami Wagiaalla
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for read-only IMAP folder(s) and NNTP newsgroup(s).