Re: Automated build-and-test summary report (2007/11/07)

public inbox for frysk@sourceware.org
 help / color / mirror / Atom feed

* Re: Automated build-and-test summary report (2007/11/07)
       [not found] <20071107123714.GA12748@oracle.com>
@ 2007-11-07 21:52 ` Kris Van Hees
  2007-11-07 22:17   ` Mark Wielaard
  0 siblings, 1 reply; 3+ messages in thread
From: Kris Van Hees @ 2007-11-07 21:52 UTC (permalink / raw)
  To: frysk

All,

Sami made the suggestion that perhaps the list of failed tests (and broken I
would assume) should be included in the daily email.  It's not a major change
in terms of coding, though it would increase the size of the daily email report
by about 600-700 lines (and more if we end up adding more configurations to the
reporting structure).

Opinions?

	Cheers,
	Kris

On Wed, Nov 07, 2007 at 07:37:14AM -0500, Kris Van Hees wrote:
> More results (and detailed reports) can be found on the labrat website:
> 
>     http://build.alchar.org/
> 
> ------------------------------------------------------------------------------
> Package:        frysk_fresh
> Previous build: 2007/11/06 00:43:26 - 2007/11/06 01:08:16
> Current build:  2007/11/07 00:43:11 - 2007/11/07 01:03:10
> Host:           ca-tools2
> Platform:       Linux 2.6.22.9-61.fc6 i386 (FC6)
> URL:            http://build.alchar.org/cgi/showBuild?host=ca-tools2&pkg=frysk_fresh&date=20071107-004311
> First failure:  test
> Test result:    1051: 942 +, 35 -, 3 S, 71 E (before: 1049: 953 +, 31 -, 3 S, 62 E)
> 
>   Old   -> New   Test
>   -----    ----- ----------------------------------
>   PASS  -> ERRR  frysk-sys - testTextFuncPokeBytes(frysk.sys.TestPtrace)
>   ERRR  -> PASS  frysk-sys - testOffsetOverBound(frysk.sys.TestPtrace)
>   PASS  -> FAIL  frysk-sys - testDaemonExecute(frysk.sys.TestPipePair)
>   PASS  -> ERRR  frysk-sys - testDaemonTee(frysk.sys.TestPipePair)
>   ERRR  -> PASS  frysk-sys - testDataValPokeBytes(frysk.sys.TestPtrace)
>   ERRR  -> FAIL  frysk-sys - testTextStackPeekBytes(frysk.sys.TestPtrace)
>   PASS  -> ERRR  frysk-sys - testTextFuncPeek(frysk.sys.TestPtrace)
>   PASS  -> ERRR  frysk-sys - testDataStackPeek(frysk.sys.TestPtrace)
>   PASS  -> ERRR  frysk-sys - testChildExecute(frysk.sys.TestPipePair)
>   PASS  -> ERRR  frysk-sys - testChildTee(frysk.sys.TestPipePair)
>   PASS  -> ERRR  frysk-sys - testLeakyPipes(frysk.sys.TestLeakingFileDescriptor)
>   PASS  -> ERRR  frysk-sys - testDataStackPoke(frysk.sys.TestPtrace)
>   PASS  -> ERRR  frysk-sys - testTextValPoke(frysk.sys.TestPtrace)
>   N/A   -> PASS  frysk-sys - PASS
>   ERRR  -> PASS  frysk-sys - testDataFuncPokeBytes(frysk.sys.TestPtrace)
>   FAIL  -> PASS  frysk-sys - testShortTimeout(frysk.sys.TestWait)
>   PASS  -> FAIL  frysk-sys - testTextStackPeek(frysk.sys.TestPtrace)
>   FAIL  -> N/A   frysk-sys - testLengthUnderBound(frysk.sys.TestPtrace)FAIL
>   PASS  -> ERRR  frysk-sys - testLengthOverBound(frysk.sys.TestPtrace)
>   PASS  -> FAIL  frysk-sys - testTextStackPoke(frysk.sys.TestPtrace)
>   PASS  -> ERRR  frysk-sys - testTextValPeek(frysk.sys.TestPtrace)
>   N/A   -> FAIL  frysk-sys - FAIL
>   ERRR  -> PASS  frysk-sys - testDataStackPeekBytes(frysk.sys.TestPtrace)
>   ERRR  -> FAIL  frysk-sys - testTextStackPokeBytes(frysk.sys.TestPtrace)
>   PASS  -> ERRR  frysk-sys - testTextFuncPoke(frysk.sys.TestPtrace)
>   ERRR  -> PASS  frysk-sys - testTextValPokeBytes(frysk.sys.TestPtrace)
>   PASS  -> ERRR  frysk-sys - testDataFuncPeekBytes(frysk.sys.TestPtrace)
> 
> ------------------------------------------------------------------------------
> Package:        frysk_fresh
> Previous build: 2007/11/06 02:08:11 - 2007/11/06 03:08:49
> Current build:  2007/11/07 01:59:07 - 2007/11/07 02:57:30
> Host:           ca-tools4
> Platform:       Linux 2.6.23.1-10.fc7 x86_64 (F7)
> URL:            http://build.alchar.org/cgi/showBuild?host=ca-tools4&pkg=frysk_fresh&date=20071107-015907
> First failure:  test
> Test result:    1036: 938 +, 41 -, 3 S, 54 E (before: 1036: 938 +, 40 -, 3 S, 55 E)
> 
>   Old   -> New   Test
>   -----    ----- ----------------------------------
>   PASS  -> FAIL  frysk-core - testArray(frysk.debuginfo.TestTypeEntry)
>   ERRR  -> PASS  frysk-core - testLineSteppingList(frysk.stepping.TestSteppingEngine)
> 
> ------------------------------------------------------------------------------
> Package:        frysk_fresh
> Previous build: 2007/11/06 03:54:18 - 2007/11/06 04:36:43
> Current build:  2007/11/07 03:54:17 - 2007/11/07 04:37:25
> Host:           coldstone
> Platform:       Linux 2.6.22.9-61.fc6 x86_64 (FC6)
> URL:            http://build.alchar.org/cgi/showBuild?host=coldstone&pkg=frysk_fresh&date=20071107-035417
> First failure:  test
> Test result:    1036: 952 +, 25 -, 4 S, 55 E (before: 1036: 950 +, 27 -, 4 S, 55 E)
> 
>   Old   -> New   Test
>   -----    ----- ----------------------------------
>   FAIL  -> PASS  frysk-sys - TestRunner
>   FAIL  -> PASS  frysk-sys - testShortTimeout(frysk.sys.TestWait)
> 
> ------------------------------------------------------------------------------
> Package:        frysk_incr
> Previous build: 2007/11/06 00:24:04 - 2007/11/06 00:43:25
> Current build:  2007/11/07 00:24:03 - 2007/11/07 00:43:10
> Host:           ca-tools2
> Platform:       Linux 2.6.22.9-61.fc6 i386 (FC6)
> URL:            http://build.alchar.org/cgi/showBuild?host=ca-tools2&pkg=frysk_incr&date=20071107-002403
> First failure:  test
> Test result:    1036: 955 +, 26 -, 3 S, 52 E (before: 1048: 945 +, 33 -, 3 S, 67 E)
> 
>   Old   -> New   Test
>   -----    ----- ----------------------------------
>   ERRR  -> PASS  frysk-sys - testTextFuncPokeBytes(frysk.sys.TestPtrace)
>   FAIL  -> PASS  frysk-sys - testDaemonExecute(frysk.sys.TestPipePair)
>   ERRR  -> PASS  frysk-sys - testDaemonTee(frysk.sys.TestPipePair)
>   FAIL  -> PASS  frysk-sys - TestRunner
>   FAIL  -> PASS  frysk-sys - testTextStackPeekBytes(frysk.sys.TestPtrace)
>   ERRR  -> PASS  frysk-sys - testTextFuncPeek(frysk.sys.TestPtrace)
>   ERRR  -> PASS  frysk-sys - testLengthUnderBound(frysk.sys.TestPtrace)
>   ERRR  -> PASS  frysk-sys - testAttachDetach(frysk.sys.TestPtrace)
>   FAIL  -> PASS  frysk-sys - testChildExecute(frysk.sys.TestPipePair)
>   ERRR  -> PASS  frysk-sys - testChildTee(frysk.sys.TestPipePair)
>   ERRR  -> PASS  frysk-sys - testLeakyPipes(frysk.sys.TestLeakingFileDescriptor)
>   FAIL  -> PASS  frysk-sys - testDataStackPoke(frysk.sys.TestPtrace)
>   ERRR  -> PASS  frysk-sys - testLengthOnBound(frysk.sys.TestPtrace)
>   ERRR  -> PASS  frysk-sys - testDataValPoke(frysk.sys.TestPtrace)
>   ERRR  -> PASS  frysk-sys - testDataFuncPokeBytes(frysk.sys.TestPtrace)
>   ERRR  -> PASS  frysk-sys - testOffsetOnBound(frysk.sys.TestPtrace)
>   ERRR  -> PASS  frysk-sys - testTextStackPeek(frysk.sys.TestPtrace)
>   ERRR  -> PASS  frysk-sys - testLengthOverBound(frysk.sys.TestPtrace)
>   FAIL  -> PASS  frysk-sys - testTextStackPokeBytes(frysk.sys.TestPtrace)
>   ERRR  -> PASS  frysk-sys - testDataFuncPoke(frysk.sys.TestPtrace)
>   ERRR  -> PASS  frysk-sys - testLeakyFileDescriptors(frysk.sys.TestLeakingFileDescriptor)
> 
> ------------------------------------------------------------------------------
> Package:        frysk_incr
> Previous build: 2007/11/06 01:12:01 - 2007/11/06 02:08:10
> Current build:  2007/11/07 01:12:01 - 2007/11/07 01:59:06
> Host:           ca-tools4
> Platform:       Linux 2.6.23.1-10.fc7 x86_64 (F7)
> URL:            http://build.alchar.org/cgi/showBuild?host=ca-tools4&pkg=frysk_incr&date=20071107-011201
> First failure:  test
> Test result:    1036: 937 +, 41 -, 3 S, 55 E (before: 1036: 936 +, 42 -, 3 S, 55 E)
> 
>   Old   -> New   Test
>   -----    ----- ----------------------------------
>   FAIL  -> PASS  frysk-core - testHpdBreakpointInline(frysk.hpd.TestBreakpoints)
> 
> ------------------------------------------------------------------------------
> Package:        frysk_incr
> Previous build: 2007/11/06 03:34:02 - 2007/11/06 03:54:07
> Current build:  2007/11/07 03:34:02 - 2007/11/07 03:54:05
> Host:           coldstone
> Platform:       Linux 2.6.22.9-61.fc6 x86_64 (FC6)
> URL:            http://build.alchar.org/cgi/showBuild?host=coldstone&pkg=frysk_incr&date=20071107-033402
> First failure:  test
> Test result:    1036: 952 +, 25 -, 4 S, 55 E
> 
>   Old   -> New   Test
>   -----    ----- ----------------------------------
>   (No differences.)
> 

^ permalink raw reply	[flat|nested] 3+ messages in thread

* Re: Automated build-and-test summary report (2007/11/07)
  2007-11-07 21:52 ` Automated build-and-test summary report (2007/11/07) Kris Van Hees
@ 2007-11-07 22:17   ` Mark Wielaard
  2007-11-08 15:08     ` Sami Wagiaalla
  0 siblings, 1 reply; 3+ messages in thread
From: Mark Wielaard @ 2007-11-07 22:17 UTC (permalink / raw)
  To: Kris Van Hees; +Cc: frysk

[-- Attachment #1: Type: text/plain, Size: 691 bytes --]

Hi Kris,

On Wed, 2007-11-07 at 16:51 -0500, Kris Van Hees wrote:
> Sami made the suggestion that perhaps the list of failed tests (and broken I
> would assume) should be included in the daily email.  It's not a major change
> in terms of coding, though it would increase the size of the daily email report
> by about 600-700 lines (and more if we end up adding more configurations to the
> reporting structure).
> 
> Opinions?

I think that is a good idea. People explicitly subscribe to the
testresults mailinglist. And hopefully it gets so annoying that we
finally figure out how to get to zero FAIL on all these setups. Which
really should be out goal.

Cheers,

Mark

[-- Attachment #2: This is a digitally signed message part --]
[-- Type: application/pgp-signature, Size: 189 bytes --]

^ permalink raw reply	[flat|nested] 3+ messages in thread

* Re: Automated build-and-test summary report (2007/11/07)
  2007-11-07 22:17   ` Mark Wielaard
@ 2007-11-08 15:08     ` Sami Wagiaalla
  0 siblings, 0 replies; 3+ messages in thread
From: Sami Wagiaalla @ 2007-11-08 15:08 UTC (permalink / raw)
  To: Mark Wielaard; +Cc: Kris Van Hees, frysk

Mark Wielaard wrote:
>  And hopefully it gets so annoying that we
> finally figure out how to get to zero FAIL on all these setups. Which
> really should be out goal.
>   
Ditto :)

^ permalink raw reply	[flat|nested] 3+ messages in thread

end of thread, other threads:[~2007-11-08 15:08 UTC | newest]

Thread overview: 3+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
     [not found] <20071107123714.GA12748@oracle.com>
2007-11-07 21:52 ` Automated build-and-test summary report (2007/11/07) Kris Van Hees
2007-11-07 22:17   ` Mark Wielaard
2007-11-08 15:08     ` Sami Wagiaalla

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for read-only IMAP folder(s) and NNTP newsgroup(s).