[Bug testsuite/19135] New: testsuite results hard to compare

["dsmith at redhat dot com" <sourceware-bugzilla at sourceware dot org>]

https://sourceware.org/bugzilla/show_bug.cgi?id=19135

            Bug ID: 19135
           Summary: testsuite results hard to compare
           Product: systemtap
           Version: unspecified
            Status: NEW
          Severity: normal
          Priority: P2
         Component: testsuite
          Assignee: systemtap at sourceware dot org
          Reporter: dsmith at redhat dot com
  Target Milestone: ---

While doing some regression testing, I find that the testsuite results are hard
to compare from run to run:

bench.exp - reports some number at the end, which makes passes not compare
well:

-PASS: bench (488)
+PASS: bench (538)

listing_mode.exp - seems to report actual process IDs, which make passes not
compare well (since this test has lots of subtests, it makes the diff large):

-PASS: listing_mode (process(12536).begin )
+PASS: listing_mode (process(31544).begin )

valid_pid.exp: I'm unsure of what this number is at the end of these lines,
perhaps a process ID (this test also has lots of subtests):

-PASS: probe process($1).syscall{exit();} 20620
+PASS: probe process($1).syscall{exit();} 6402

If these numbers weren't present in the output, these lines wouldn't be shown
in a 'diff' command's output between two systemtap.sum files.

-- 
You are receiving this mail because:
You are the assignee for the bug.