public inbox for systemtap@sourceware.org
 help / color / mirror / Atom feed
* [Bug testsuite/19135] New: testsuite results hard to compare
@ 2015-10-14 20:53 dsmith at redhat dot com
  2015-11-03  8:21 ` [Bug testsuite/19135] " mcermak at redhat dot com
  0 siblings, 1 reply; 2+ messages in thread
From: dsmith at redhat dot com @ 2015-10-14 20:53 UTC (permalink / raw)
  To: systemtap

https://sourceware.org/bugzilla/show_bug.cgi?id=19135

            Bug ID: 19135
           Summary: testsuite results hard to compare
           Product: systemtap
           Version: unspecified
            Status: NEW
          Severity: normal
          Priority: P2
         Component: testsuite
          Assignee: systemtap at sourceware dot org
          Reporter: dsmith at redhat dot com
  Target Milestone: ---

While doing some regression testing, I find that the testsuite results are hard
to compare from run to run:

bench.exp - reports some number at the end, which makes passes not compare
well:

-PASS: bench (488)
+PASS: bench (538)

listing_mode.exp - seems to report actual process IDs, which make passes not
compare well (since this test has lots of subtests, it makes the diff large):

-PASS: listing_mode (process(12536).begin )
+PASS: listing_mode (process(31544).begin )

valid_pid.exp: I'm unsure of what this number is at the end of these lines,
perhaps a process ID (this test also has lots of subtests):

-PASS: probe process($1).syscall{exit();} 20620
+PASS: probe process($1).syscall{exit();} 6402

If these numbers weren't present in the output, these lines wouldn't be shown
in a 'diff' command's output between two systemtap.sum files.

-- 
You are receiving this mail because:
You are the assignee for the bug.

^ permalink raw reply	[flat|nested] 2+ messages in thread

* [Bug testsuite/19135] testsuite results hard to compare
  2015-10-14 20:53 [Bug testsuite/19135] New: testsuite results hard to compare dsmith at redhat dot com
@ 2015-11-03  8:21 ` mcermak at redhat dot com
  0 siblings, 0 replies; 2+ messages in thread
From: mcermak at redhat dot com @ 2015-11-03  8:21 UTC (permalink / raw)
  To: systemtap

https://sourceware.org/bugzilla/show_bug.cgi?id=19135

Martin Cermak <mcermak at redhat dot com> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
             Status|NEW                         |RESOLVED
                 CC|                            |mcermak at redhat dot com
         Resolution|---                         |FIXED

--- Comment #1 from Martin Cermak <mcermak at redhat dot com> ---
Fixed in commit 9382fb607d2d41f0ddcfc8acd2e55888b93316f5

-- 
You are receiving this mail because:
You are the assignee for the bug.

^ permalink raw reply	[flat|nested] 2+ messages in thread

end of thread, other threads:[~2015-11-03  8:21 UTC | newest]

Thread overview: 2+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2015-10-14 20:53 [Bug testsuite/19135] New: testsuite results hard to compare dsmith at redhat dot com
2015-11-03  8:21 ` [Bug testsuite/19135] " mcermak at redhat dot com

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for read-only IMAP folder(s) and NNTP newsgroup(s).