* [Bug testsuite/19135] New: testsuite results hard to compare
@ 2015-10-14 20:53 dsmith at redhat dot com
2015-11-03 8:21 ` [Bug testsuite/19135] " mcermak at redhat dot com
0 siblings, 1 reply; 2+ messages in thread
From: dsmith at redhat dot com @ 2015-10-14 20:53 UTC (permalink / raw)
To: systemtap
https://sourceware.org/bugzilla/show_bug.cgi?id=19135
Bug ID: 19135
Summary: testsuite results hard to compare
Product: systemtap
Version: unspecified
Status: NEW
Severity: normal
Priority: P2
Component: testsuite
Assignee: systemtap at sourceware dot org
Reporter: dsmith at redhat dot com
Target Milestone: ---
While doing some regression testing, I find that the testsuite results are hard
to compare from run to run:
bench.exp - reports some number at the end, which makes passes not compare
well:
-PASS: bench (488)
+PASS: bench (538)
listing_mode.exp - seems to report actual process IDs, which make passes not
compare well (since this test has lots of subtests, it makes the diff large):
-PASS: listing_mode (process(12536).begin )
+PASS: listing_mode (process(31544).begin )
valid_pid.exp: I'm unsure of what this number is at the end of these lines,
perhaps a process ID (this test also has lots of subtests):
-PASS: probe process($1).syscall{exit();} 20620
+PASS: probe process($1).syscall{exit();} 6402
If these numbers weren't present in the output, these lines wouldn't be shown
in a 'diff' command's output between two systemtap.sum files.
--
You are receiving this mail because:
You are the assignee for the bug.
^ permalink raw reply [flat|nested] 2+ messages in thread
* [Bug testsuite/19135] testsuite results hard to compare
2015-10-14 20:53 [Bug testsuite/19135] New: testsuite results hard to compare dsmith at redhat dot com
@ 2015-11-03 8:21 ` mcermak at redhat dot com
0 siblings, 0 replies; 2+ messages in thread
From: mcermak at redhat dot com @ 2015-11-03 8:21 UTC (permalink / raw)
To: systemtap
https://sourceware.org/bugzilla/show_bug.cgi?id=19135
Martin Cermak <mcermak at redhat dot com> changed:
What |Removed |Added
----------------------------------------------------------------------------
Status|NEW |RESOLVED
CC| |mcermak at redhat dot com
Resolution|--- |FIXED
--- Comment #1 from Martin Cermak <mcermak at redhat dot com> ---
Fixed in commit 9382fb607d2d41f0ddcfc8acd2e55888b93316f5
--
You are receiving this mail because:
You are the assignee for the bug.
^ permalink raw reply [flat|nested] 2+ messages in thread
end of thread, other threads:[~2015-11-03 8:21 UTC | newest]
Thread overview: 2+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2015-10-14 20:53 [Bug testsuite/19135] New: testsuite results hard to compare dsmith at redhat dot com
2015-11-03 8:21 ` [Bug testsuite/19135] " mcermak at redhat dot com
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for read-only IMAP folder(s) and NNTP newsgroup(s).