public inbox for gdb@sourceware.org
 help / color / mirror / Atom feed
* gdb test results web page
@ 2001-01-17 13:54 Christopher Faylor
  2001-01-17 18:07 ` Andrew Cagney
  0 siblings, 1 reply; 9+ messages in thread
From: Christopher Faylor @ 2001-01-17 13:54 UTC (permalink / raw)
  To: gdb

I've been meaning to announce the existence of the gdb test results web
page for some time.  It is here:

http://sources.redhat.com/cgi-bin/gdb.cgi

This web page uses some cool software, written by Tom Tromey that helps
in the categorization and comparison of test results.  You can upload
your own test results here by clicking on the "upload a testsuite log
file" link or by sending email to gdb-testresults@sources.redhat.com.

We're thinking of setting up a project on sources.redhat.com devoted to
the "Terf" software which handles this web page so that people can
improve it.  If anyone is interested in joining this project let me
know.  You'll need to be fairly proficient in perl, since Terf is written
in perl.

cgf

^ permalink raw reply	[flat|nested] 9+ messages in thread
* Re: gdb test results web page
@ 2001-01-17 14:48 Michael Elizabeth Chastain
  2001-01-17 17:46 ` Tom Tromey
  2001-01-17 18:01 ` Tom Tromey
  0 siblings, 2 replies; 9+ messages in thread
From: Michael Elizabeth Chastain @ 2001-01-17 14:48 UTC (permalink / raw)
  To: cgf, gdb

It looks promising, but I think it's not usable yet.

The upload page says:

  UPLOAD FOR GDB
  Enter the file name of a test suite log file to upload:
  --------------------------------------------------------
  |                                                      |
  --------------------------------------------------------

So I gave it my "gdb.log" file for 2001-01-15.

Now the results page says there were 375 PASS, 7 FAIL, 0 XPASS, and 0 XFAIL
for this test run.  That's way too few total tests.

It appears that the results page counts only results that start in
column 1.  That's fine for "gdb.sum" files, but it misses 90% of the
results in "gdb.log" files.  It looks like every entry in the current
database suffers from this problem.

The upload page should say more clearly whether it wants a "gdb.log"
file or a "gdb.sum" file.  And if it does not handle both types, then
it needs to reject files of the wrong type.

I have a lot more opinions but I better shut up before I get recruited!

Michael Chastain
<chastain@redhat.com>
"love without fear"

^ permalink raw reply	[flat|nested] 9+ messages in thread
* Re: gdb test results web page
@ 2001-01-17 20:18 Michael Elizabeth Chastain
  2001-01-18 13:40 ` Tom Tromey
  0 siblings, 1 reply; 9+ messages in thread
From: Michael Elizabeth Chastain @ 2001-01-17 20:18 UTC (permalink / raw)
  To: tromey; +Cc: gdb

Tom Tromey writes:
Tom> Can you suggest how to do this?  I don't see a way to tell the two
Tom> kinds of files apart.

Here are some differences to key on for gdb.sum versus gdb.log:

  A gdb.log file has several '^Using' lines in the first few lines.

  A gdb.log file ends with the line '^runtest completed ...'

You could also parse the '^# of ...' totals near the end of the file,
and compare them with the count you get by grepping.  If the counts do
not match you could reject the file.  That would protect against lots of
kinds of user errors, script shortcomings, and bogus input files.

Tom> Hmm.  One approach would be to fix dejagnu so that pass/fail
Tom> indications always start on a new line.  At least, this doesn't seem
Tom> unreasonable to me.

Ouch, an interface problem.  You are suggesting we change this:

  Program exited with code 01.^M
  (gdb) PASS: gdb.base/a2-run.exp: run "run" with no args

To this:

  Program exited with code 01.^M
  (gdb)
  PASS: gdb.base/a2-run.exp: run "run" with no args

I have two concerns.  First, if we make this change in Dejagnu, it affects
all tools tested with Dejagnu.  And second, it means that nobody can enter
any test results until this change gets made and propagated in Dejagnu.

So I'm more inclined to say: leave the sender [dejagnu] alone, and change
the receiver to be more liberal.

Michael

^ permalink raw reply	[flat|nested] 9+ messages in thread

end of thread, other threads:[~2001-01-18 15:16 UTC | newest]

Thread overview: 9+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2001-01-17 13:54 gdb test results web page Christopher Faylor
2001-01-17 18:07 ` Andrew Cagney
2001-01-17 14:48 Michael Elizabeth Chastain
2001-01-17 17:46 ` Tom Tromey
2001-01-17 18:01 ` Tom Tromey
2001-01-17 20:18 Michael Elizabeth Chastain
2001-01-18 13:40 ` Tom Tromey
2001-01-18 14:36   ` Christopher Faylor
2001-01-18 15:16     ` Tom Tromey

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for read-only IMAP folder(s) and NNTP newsgroup(s).