* testsuite status
@ 2010-05-20 19:34 Roland McGrath
2010-05-20 19:37 ` David Smith
2010-05-21 18:27 ` Mark Wielaard
0 siblings, 2 replies; 8+ messages in thread
From: Roland McGrath @ 2010-05-20 19:34 UTC (permalink / raw)
To: systemtap
With current git (release-1.2-157-g00130b8) I get the following
for 'make check'. Is this the expected status quo, or is there
something wrong with my build?
Also, I'm interested in a slightly different regression testing scenario.
I'm doing some internal changes that should not affect output at all. So
what I'd like to do is not even bother with a 'make installcheck' or any
dynamic tests, but instead run on a full set (as full as possible) of test
scripts, but only translate them to C and save all those .c files. Then I
want to do that before and after a change, and see diffs on all the
generated C files. Is there a way to run the testsuite like that?
Thanks,
Roland
\f
-*- mode: compilation; default-directory: "~/build/systemtap/" -*-
Compilation started at Thu May 20 03:35:31
make -k -j9 check
make check-recursive
make[1]: Entering directory `/home/roland/build/systemtap'
Making check in doc
make[2]: Entering directory `/home/roland/build/systemtap/doc'
Making check in SystemTap_Tapset_Reference
make[3]: Entering directory `/home/roland/build/systemtap/doc/SystemTap_Tapset_Reference'
make[3]: Nothing to be done for `check'.
make[3]: Leaving directory `/home/roland/build/systemtap/doc/SystemTap_Tapset_Reference'
Making check in beginners
make[3]: Entering directory `/home/roland/build/systemtap/doc/beginners'
make[3]: Nothing to be done for `check'.
make[3]: Leaving directory `/home/roland/build/systemtap/doc/beginners'
make[3]: Entering directory `/home/roland/build/systemtap/doc'
make[3]: Nothing to be done for `check-am'.
make[3]: Leaving directory `/home/roland/build/systemtap/doc'
make[2]: Leaving directory `/home/roland/build/systemtap/doc'
Making check in grapher
make[2]: Entering directory `/home/roland/build/systemtap/grapher'
make[2]: Nothing to be done for `check'.
make[2]: Leaving directory `/home/roland/build/systemtap/grapher'
make[2]: Entering directory `/home/roland/build/systemtap'
The script example index is outdated, run
cd ../../redhat/systemtap/testsuite/systemtap.examples && \
perl examples-index-gen.pl
to regenerate it.
make check-local
make[3]: Entering directory `/home/roland/build/systemtap'
SRCDIR=`cd ../../redhat/systemtap; pwd`; \
PWD=`pwd`; \
make -C testsuite check SYSTEMTAP_RUNTIME=$SRCDIR/runtime SYSTEMTAP_TAPSET=$SRCDIR/tapset LD_LIBRARY_PATH=$PWD/lib-elfutils:$PWD/lib-elfutils/systemtap SYSTEMTAP_PATH=$PWD SYSTEMTAP_INCLUDES=$PWD/includes RUNTESTFLAGS="" PKGLIBDIR="/usr/local/libexec/systemtap";
make[4]: Entering directory `/home/roland/build/systemtap/testsuite'
Run "make check" or "make installcheck".
make check-DEJAGNU check-local
make[5]: Entering directory `/home/roland/build/systemtap/testsuite'
srcdir=`CDPATH="${ZSH_VERSION+.}:" && cd ../../../redhat/systemtap/testsuite && pwd`; export srcdir; \
EXPECT=expect; export EXPECT; \
runtest="env SYSTEMTAP_TESTAPPS= SYSTEMTAP_RUNTIME=/home/roland/redhat/systemtap/runtime SYSTEMTAP_TAPSET=/home/roland/redhat/systemtap/tapset LD_LIBRARY_PATH=/home/roland/build/systemtap/lib-elfutils:/home/roland/build/systemtap/lib-elfutils/systemtap CRASH_LIBDIR=/usr/local/lib/systemtap PATH=/home/roland/build/systemtap:$PATH SYSTEMTAP_PATH=/home/roland/build/systemtap SYSTEMTAP_INCLUDES=/home/roland/build/systemtap/includes PKGLIBDIR=/usr/local/libexec/systemtap ../../../redhat/systemtap/testsuite/execrc runtest"; \
if /bin/sh -c "$runtest --version" > /dev/null 2>&1; then \
exit_status=0; l='systemtap'; for tool in $l; do \
if $runtest --tool $tool --tool_opts \'\' --srcdir $srcdir ; \
then :; else exit_status=1; fi; \
done; \
else echo "WARNING: could not find \`runtest'" 1>&2; :;\
fi; \
exit $exit_status
if test -n ""; then mail < systemtap.sum; fi
WARNING: Couldn't find the global config file.
kernel location: /usr/lib/debug/lib/modules/2.6.33.3-85.fc13.x86_64/vmlinux
kernel version: 2.6.33.3-85.fc13.x86_64
systemtap location: /home/roland/build/systemtap/stap
systemtap version: version 1.2/0.147 commit release-1.0-262-gaa8c86d
gcc location: /usr/lib64/ccache/gcc
gcc version: gcc (GCC) 4.4.4 20100503 (Red Hat 4.4.4-2)
Test Run By roland on Thu May 20 03:35:32 2010
Native configuration is x86_64-unknown-linux-gnu
=== systemtap tests ===
Schedule of variations:
unix
Running target unix
Using /usr/share/dejagnu/baseboards/unix.exp as board description file for target.
Using /usr/share/dejagnu/config/unix.exp as generic interface file for target.
Using /home/roland/redhat/systemtap/testsuite/config/unix.exp as tool-and-target-specific interface file.
Host: Linux magilla.sf.frob.com 2.6.33.3-85.fc13.x86_64 #1 SMP Thu May 6 18:09:49 UTC 2010 x86_64 x86_64 x86_64 GNU/Linux
Snapshot: version 1.2/0.147 commit release-1.0-262-gaa8c86d
GCC: 4.4.4 [gcc (GCC) 4.4.4 20100503 (Red Hat 4.4.4-2)]
Distro: Fedora release 13 (Goddard)
Running /home/roland/redhat/systemtap/testsuite/systemtap/notest.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.apps/mysql.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.apps/postgres.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.apps/tcl.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.apps/xulrunner.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/add.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/alias-condition.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/alias_tapset.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/alternatives.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/arith.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/arith_limits.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/array_size.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/array_string.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/atomic.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/backtrace.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/badkprobe.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/be_order.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/beginenderror.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/bench.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/bitfield.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/bz10078.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/bz5274.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/bz6850.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/cache.exp ...
FAIL: BASIC1 compilation failed
FAIL: BASIC2 compilation failed
FAIL: OPTION1 compilation failed
FAIL: OPTION2 compilation failed
FAIL: BULK1 compilation failed
FAIL: BULK2 compilation failed
FAIL: TIMING1 compilation failed
FAIL: TIMING2 compilation failed
FAIL: RUNTIME1 compilation failed
FAIL: RUNTIME2 compilation failed
FAIL: DISABLED1 compilation failed
FAIL: DISABLED2 compilation failed
ERROR: tcl error sourcing /home/roland/redhat/systemtap/testsuite/systemtap.base/cache.exp.
ERROR: no files matched glob pattern "stap_*.ko"
while executing
"glob "stap_*.ko""
invoked from within
"eval [list exec /bin/rm -f] [glob "stap_*.ko"]"
(file "/home/roland/redhat/systemtap/testsuite/systemtap.base/cache.exp" line 113)
invoked from within
"source /home/roland/redhat/systemtap/testsuite/systemtap.base/cache.exp"
("uplevel" body line 1)
invoked from within
"uplevel #0 source /home/roland/redhat/systemtap/testsuite/systemtap.base/cache.exp"
invoked from within
"catch "uplevel #0 source $test_file_name""
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/cast.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/cmd_parse.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/const_value.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/control_limits.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/crash.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/ctime.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/cu-decl.exp ...
FAIL: cu-decl compilation failed
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/cxxclass.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/debugpath.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/deref.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/deref2.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/div0.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/dtrace.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/equal.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/error_fn.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/externalvar.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/finloop2.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/flightrec1.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/flightrec2.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/flightrec3.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/flightrec4.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/flightrec5.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/foreach_value.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/global_end.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/global_init.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/global_stat.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/global_vars.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/gtod.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/if.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/inc.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/inlinedvars.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/itrace.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/kfunct.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/kmodule.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/kprobes.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/kretprobe-vars.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/labels.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/limits.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/logical_and.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/marker.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/maxactive.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/maxmemory.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/modargs.exp ...
FAIL: modargs compilation: /home/roland/build/systemtap/testsuite/.cache_test-roland/cache/4d/stap_4d62c27eb4244b28bd2e94ca2a0b1bc5_969.ko
make[6]: warning: jobserver unavailable: using -j1. Add `+' to parent make rule.
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/not.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/onoffprobe.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/optim.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/optim_arridx.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/optim_voidstmt.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/optionalprobe.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/overflow_error.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/overload.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/pointer_array.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/poll_map.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/pr10854.exp ...
FAIL: compiling pr10854.stp: /home/roland/build/systemtap/testsuite/.cache_test-roland/cache/0c/stap_0c08594d0f8bddcad06fa98d455a4941_768876.ko
make[6]: warning: jobserver unavailable: using -j1. Add `+' to parent make rule.
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/prepost_optim.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/preprocessor.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/print.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/probe_list.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/probefunc.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/procfs.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/procfs_maxsize.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/procfs_write.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/prologues.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/rand.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/sdt.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/sdt_misc.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/set_kernel.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/simple.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/skipped.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/statement.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/stmt_rel.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/stmtvars.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/strftime.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/system_func.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/tapset_includes.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/target_set.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/timeofday.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/timers.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/tracepoints.exp ...
FAIL: tracepoints /home/roland/build/systemtap/testsuite/.cache_test-roland/cache/2a/stap_2a785ff74a35f79f648b0ab48bd9d1ca_623.ko
make[6]: warning: jobserver unavailable: using -j1. Add `+' to parent make rule.
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/tri.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/trycatch.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/uprobes.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/utrace_p4.exp ...
FAIL: UTRACE_P4_01 compilation failed
FAIL: UTRACE_P4_01_pid compilation failed
FAIL: UTRACE_P4_02 compilation failed
FAIL: UTRACE_P4_02_pid compilation failed
FAIL: UTRACE_P4_03 compilation failed
FAIL: UTRACE_P4_03_pid compilation failed
FAIL: UTRACE_P4_04_compile failed, but got no error messages
FAIL: UTRACE_P4_04_pid_compile failed, but got no error messages
FAIL: UTRACE_P4_05 compilation failed
FAIL: UTRACE_P4_05_pid compilation failed
FAIL: UTRACE_P4_06 compilation failed
FAIL: UTRACE_P4_06_pid compilation failed
FAIL: UTRACE_P4_07 compilation failed
FAIL: UTRACE_P4_08 compilation failed
FAIL: UTRACE_P4_09 compilation failed
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/utrace_p5.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/utrace_syscall_args.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/vars.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/vta-test.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/warnings.exp ...
FAIL: warnings (13)
Running /home/roland/redhat/systemtap/testsuite/systemtap.base/x86_gs.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.context/context.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.context/fib.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.context/symbols.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.context/uprobe_stmt_num.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.context/uprobe_uaddr.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.context/usymbols.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.examples/check.exp ...
FAIL: systemtap.examples/io/ioblktime build
FAIL: systemtap.examples/network/netdev build
FAIL: systemtap.examples/process/chng_cpu build
FAIL: systemtap.examples/process/dumpstack build
FAIL: systemtap.examples/process/forktracker build
FAIL: systemtap.examples/process/migrate build
FAIL: systemtap.examples/profiling/functioncallcount build
FAIL: systemtap.examples/profiling/thread-times build
FAIL: systemtap.examples/profiling/topsys build
Running /home/roland/redhat/systemtap/testsuite/systemtap.exelib/exelib.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.maps/absentstats.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.maps/elision.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.maps/exists.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.maps/foreach_fail.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.maps/foreach_foreach.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.maps/foreach_limit.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.maps/foreach_limit2.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.maps/hist_in_string.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.maps/ii.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.maps/iiiiii.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.maps/is.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.maps/ix.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.maps/ix_clear.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.maps/ix_clear2.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.maps/ix_clear3.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.maps/ix_hist.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.maps/linear.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.maps/linear_0.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.maps/linear_bad.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.maps/linear_empty.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.maps/linear_large.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.maps/linear_large_neg.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.maps/linear_nearlyempty.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.maps/linear_neg.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.maps/linear_over.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.maps/linear_overunder.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.maps/linear_under.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.maps/log.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.maps/log_edge.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.maps/pmap_agg_overflow.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.maps/si.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.maps/ss.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.pass1-4/buildko.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.pass1-4/buildok.exp ...
FAIL: buildok/array_size.stp
FAIL: buildok/atomic.stp
FAIL: buildok/aux_syscalls-embedded.stp
FAIL: buildok/cmdline01.stp
FAIL: buildok/context-embedded.stp
FAIL: buildok/context-symbols-embedded.stp
FAIL: buildok/context-unwind-embedded.stp
FAIL: buildok/conversions-embedded.stp
FAIL: buildok/conversions.stp
FAIL: buildok/delete.stp
FAIL: buildok/dentry.stp
FAIL: buildok/eight.stp
FAIL: buildok/eighteen.stp
FAIL: buildok/eleven.stp
FAIL: buildok/fifteen.stp
FAIL: buildok/five.stp
FAIL: buildok/fortyfive.stp
FAIL: buildok/fortyone.stp
FAIL: buildok/fortysix.stp
FAIL: buildok/four.stp
FAIL: buildok/fourteen-plus.stp
FAIL: buildok/fourteen.stp
FAIL: buildok/gtod_init.stp
FAIL: buildok/gtod_noinit.stp
FAIL: buildok/histogram_operator_in.stp
FAIL: buildok/hwbkpt.stp
FAIL: buildok/indent.stp
FAIL: buildok/inet-embedded.stp
FAIL: buildok/inet_sock-embedded.stp
FAIL: buildok/ioblock-all-probes.stp
FAIL: buildok/ioblock-detailed.stp
FAIL: buildok/ioblock-embedded.stp
FAIL: buildok/ioscheduler-all-probes.stp
FAIL: buildok/ioscheduler-detailed.stp
FAIL: buildok/ioscheduler-embedded.stp
FAIL: buildok/ipmib-all-probes.stp
FAIL: buildok/irq.stp
FAIL: buildok/iterate_histogram_buckets.stp
FAIL: buildok/linuxmib-all-probes.stp
FAIL: buildok/logging.stp
FAIL: buildok/maxactive01.stp
FAIL: buildok/memory-all-probes.stp
FAIL: buildok/memory-detailed.stp
FAIL: buildok/memory-embedded.stp
FAIL: buildok/memory.stp
FAIL: buildok/networking-all-probes.stp
FAIL: buildok/networking-detailed.stp
FAIL: buildok/networking-embedded.stp
FAIL: buildok/nfs-all-probes.stp
FAIL: buildok/nfs-detailed.stp
FAIL: buildok/nfs-embedded.stp
FAIL: buildok/nfs_proc-detailed.stp
FAIL: buildok/nfs_proc-embedded.stp
FAIL: buildok/nfsd-all-probes.stp
FAIL: buildok/nfsd-detailed.stp
FAIL: buildok/nfsd-embedded.stp
FAIL: buildok/nfsderrno-embedded.stp
FAIL: buildok/nineteen.stp
FAIL: buildok/null.stp
FAIL: buildok/one.stp
FAIL: buildok/per-process-syscall.stp
FAIL: buildok/pmap_foreach.stp
FAIL: buildok/pr10678.stp
FAIL: buildok/print_histogram_entry.stp
FAIL: buildok/print_histograms.stp
FAIL: buildok/printf.stp
FAIL: buildok/proc_mem-embedded.stp
FAIL: buildok/process-all-probes.stp
FAIL: buildok/process_test.stp
FAIL: buildok/procfs01.stp
FAIL: buildok/rpc-all-probes.stp
FAIL: buildok/rpc-detailed.stp
FAIL: buildok/rpc-embedded.stp
FAIL: buildok/scheduler-all-probes.stp
FAIL: buildok/scheduler-detailed.stp
FAIL: buildok/scheduler-embedded.stp
FAIL: buildok/scsi-all-probes.stp
FAIL: buildok/scsi-embedded.stp
FAIL: buildok/scsi.stp
FAIL: buildok/semicolon.stp
FAIL: buildok/set_kernel.stp
FAIL: buildok/seven.stp
FAIL: buildok/seventeen.stp
FAIL: buildok/signal-all-probes.stp
FAIL: buildok/signal-detailed.stp
FAIL: buildok/signal-embedded.stp
FAIL: buildok/six.stp
FAIL: buildok/sixteen.stp
FAIL: buildok/socket-all-probes.stp
FAIL: buildok/socket-detailed.stp
FAIL: buildok/socket-embedded.stp
FAIL: buildok/stat_extract.stp
FAIL: buildok/stat_insert.stp
FAIL: buildok/syscall.stp
FAIL: buildok/task-embedded.stp
FAIL: buildok/task_test.stp
FAIL: buildok/task_time-embedded.stp
FAIL: buildok/tcp-all-probes.stp
FAIL: buildok/tcp-detailed.stp
FAIL: buildok/tcp-embedded.stp
FAIL: buildok/tcp_test.stp
FAIL: buildok/tcpmib-all-probes.stp
FAIL: buildok/tcpmib-detailed.stp
FAIL: buildok/ten.stp
FAIL: buildok/thirteen.stp
FAIL: buildok/thirty.stp
FAIL: buildok/thirtyfour.stp
FAIL: buildok/thirtyone.stp
FAIL: buildok/thirtythree.stp
FAIL: buildok/thirtytwo.stp
FAIL: buildok/three.stp
FAIL: buildok/timestamp.stp
FAIL: buildok/tty.stp
FAIL: buildok/twelve.stp
FAIL: buildok/twenty.stp
FAIL: buildok/twentyeight.stp
FAIL: buildok/twentyfive.stp
FAIL: buildok/twentyfour.stp
FAIL: buildok/twentynine.stp
FAIL: buildok/twentyone.stp
FAIL: buildok/twentyseven.stp
FAIL: buildok/twentythree.stp
FAIL: buildok/twentytwo.stp
FAIL: buildok/two.stp
FAIL: buildok/udp-all-probes.stp
FAIL: buildok/udp-detailed.stp
FAIL: buildok/udp_test.stp
FAIL: buildok/utrace.stp
FAIL: buildok/vfs-all-probes.stp
FAIL: buildok/vfs-detailed.stp
FAIL: buildok/vfs-embedded.stp
FAIL: buildok/xtime.stp
Running /home/roland/redhat/systemtap/testsuite/systemtap.pass1-4/parseko.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.pass1-4/parseok.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.pass1-4/semko.exp ...
XPASS: semko/nodwf01.stp
XPASS: semko/nodwf02.stp
XPASS: semko/nodwf03.stp
XPASS: semko/nodwf04.stp
XPASS: semko/nodwf05.stp
XPASS: semko/nodwf06.stp
XPASS: semko/nodwf07.stp
XPASS: semko/nodwf09.stp
Running /home/roland/redhat/systemtap/testsuite/systemtap.pass1-4/semok.exp ...
FAIL: semok/cast.stp
FAIL: semok/thirtysix.stp
Running /home/roland/redhat/systemtap/testsuite/systemtap.pass1-4/transko.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.pass1-4/transok.exp ...
FAIL: transok/buildko.stp
Running /home/roland/redhat/systemtap/testsuite/systemtap.printf/basic1.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.printf/basic2.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.printf/basic3.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.printf/basic4.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.printf/basic5.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.printf/basic6.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.printf/bin1.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.printf/bin2.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.printf/bin3.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.printf/bin4.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.printf/bin5.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.printf/bin6.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.printf/char1.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.printf/end1.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.printf/end1b.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.printf/int1.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.printf/memory1.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.printf/mixed_out.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.printf/mixed_outb.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.printf/oct.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.printf/out1.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.printf/out1b.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.printf/out2.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.printf/out2b.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.printf/out3.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.printf/out3b.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.printf/print.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.printf/print_char.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.printf/printd.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.printf/println.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.printf/ptr.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.printf/ring_buffer.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.printf/sharedbuf.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.printf/string1.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.printf/string2.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.samples/examples.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.samples/tcptest.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.server/client_args.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.server/server.exp ...
Testing using a systemtap server
Started a systemtap server as PID==773
FAIL: buildok/array_size.stp with server
FAIL: buildok/atomic.stp with server
FAIL: buildok/aux_syscalls-embedded.stp with server
FAIL: buildok/cmdline01.stp with server
FAIL: buildok/context-embedded.stp with server
FAIL: buildok/context-symbols-embedded.stp with server
FAIL: buildok/context-unwind-embedded.stp with server
FAIL: buildok/conversions-embedded.stp with server
FAIL: buildok/conversions.stp with server
FAIL: buildok/delete.stp with server
FAIL: buildok/dentry.stp with server
FAIL: buildok/eight.stp with server
FAIL: buildok/eighteen.stp with server
FAIL: buildok/eleven.stp with server
FAIL: buildok/fifteen.stp with server
FAIL: buildok/five.stp with server
FAIL: buildok/fortyfive.stp with server
FAIL: buildok/fortyone.stp with server
FAIL: buildok/fortysix.stp with server
FAIL: buildok/fortytwo.stp with server
FAIL: buildok/four.stp with server
FAIL: buildok/fourteen-plus.stp with server
FAIL: buildok/fourteen.stp with server
FAIL: buildok/gtod_init.stp with server
FAIL: buildok/gtod_noinit.stp with server
FAIL: buildok/histogram_operator_in.stp with server
FAIL: buildok/hwbkpt.stp with server
FAIL: buildok/indent.stp with server
FAIL: buildok/inet-embedded.stp with server
FAIL: buildok/inet_sock-embedded.stp with server
FAIL: buildok/ioblock-all-probes.stp with server
FAIL: buildok/ioblock-detailed.stp with server
FAIL: buildok/ioblock-embedded.stp with server
FAIL: buildok/ioscheduler-all-probes.stp with server
FAIL: buildok/ioscheduler-detailed.stp with server
FAIL: buildok/ioscheduler-embedded.stp with server
FAIL: buildok/ipmib-all-probes.stp with server
FAIL: buildok/irq.stp with server
FAIL: buildok/iterate_histogram_buckets.stp with server
FAIL: buildok/linuxmib-all-probes.stp with server
FAIL: buildok/logging.stp with server
FAIL: buildok/maxactive01.stp with server
FAIL: buildok/memory-all-probes.stp with server
FAIL: buildok/memory-detailed.stp with server
FAIL: buildok/memory-embedded.stp with server
FAIL: buildok/memory-mmap.stp with server
FAIL: buildok/memory-write_shared_copy.stp with server
FAIL: buildok/memory.stp with server
FAIL: buildok/networking-all-probes.stp with server
FAIL: buildok/networking-change_rx_flag.stp with server
FAIL: buildok/networking-detailed.stp with server
FAIL: buildok/networking-embedded.stp with server
FAIL: buildok/nfs-all-probes.stp with server
FAIL: buildok/nfs-detailed.stp with server
FAIL: buildok/nfs-embedded.stp with server
FAIL: buildok/nfs-fop.check_flags.stp with server
FAIL: buildok/nfs_proc-detailed.stp with server
FAIL: buildok/nfs_proc-embedded.stp with server
FAIL: buildok/nfsd-all-probes.stp with server
FAIL: buildok/nfsd-detailed.stp with server
FAIL: buildok/nfsd-embedded.stp with server
FAIL: buildok/nfsderrno-embedded.stp with server
FAIL: buildok/nine.stp with server
FAIL: buildok/nineteen.stp with server
FAIL: buildok/null.stp with server
FAIL: buildok/one.stp with server
FAIL: buildok/per-process-syscall.stp with server
FAIL: buildok/pmap_foreach.stp with server
FAIL: buildok/pr10678.stp with server
FAIL: buildok/print_histogram_entry.stp with server
FAIL: buildok/print_histograms.stp with server
FAIL: buildok/printf.stp with server
FAIL: buildok/proc_mem-embedded.stp with server
FAIL: buildok/process-all-probes.stp with server
FAIL: buildok/process_test.stp with server
FAIL: buildok/procfs01.stp with server
FAIL: buildok/rpc-detailed.stp with server
FAIL: buildok/rpc-embedded.stp with server
FAIL: buildok/scheduler-all-probes.stp with server
FAIL: buildok/scheduler-cpu_off.stp with server
FAIL: buildok/scheduler-ctxswitch.stp with server
FAIL: buildok/scheduler-detailed.stp with server
FAIL: buildok/scheduler-embedded.stp with server
FAIL: buildok/scheduler-migrate.stp with server
FAIL: buildok/scsi-all-probes.stp with server
FAIL: buildok/scsi-embedded.stp with server
FAIL: buildok/scsi.stp with server
FAIL: buildok/semicolon.stp with server
FAIL: buildok/set_kernel.stp with server
FAIL: buildok/seven.stp with server
FAIL: buildok/seventeen.stp with server
FAIL: buildok/signal-all-probes.stp with server
FAIL: buildok/signal-check_ignored.stp with server
FAIL: buildok/signal-detailed.stp with server
FAIL: buildok/signal-embedded.stp with server
FAIL: buildok/signal-handle.stp with server
FAIL: buildok/six.stp with server
FAIL: buildok/sixteen.stp with server
FAIL: buildok/socket-all-probes.stp with server
FAIL: buildok/socket-detailed.stp with server
FAIL: buildok/socket-embedded.stp with server
FAIL: buildok/stat_extract.stp with server
FAIL: buildok/stat_insert.stp with server
FAIL: buildok/syscall.stp with server
FAIL: buildok/task-embedded.stp with server
FAIL: buildok/task_test.stp with server
FAIL: buildok/task_time-embedded.stp with server
FAIL: buildok/tcp-all-probes.stp with server
FAIL: buildok/tcp-detailed.stp with server
FAIL: buildok/tcp-embedded.stp with server
FAIL: buildok/tcp_test.stp with server
FAIL: buildok/tcpmib-all-probes.stp with server
FAIL: buildok/tcpmib-detailed.stp with server
FAIL: buildok/ten.stp with server
FAIL: buildok/thirteen.stp with server
FAIL: buildok/thirty.stp with server
FAIL: buildok/thirtyfour.stp with server
FAIL: buildok/thirtyone.stp with server
FAIL: buildok/thirtythree.stp with server
FAIL: buildok/thirtytwo.stp with server
FAIL: buildok/three.stp with server
FAIL: buildok/timestamp.stp with server
FAIL: buildok/tty.stp with server
FAIL: buildok/twelve.stp with server
FAIL: buildok/twenty.stp with server
FAIL: buildok/twentyeight.stp with server
FAIL: buildok/twentyfive.stp with server
FAIL: buildok/twentyfour.stp with server
FAIL: buildok/twentynine.stp with server
FAIL: buildok/twentyone.stp with server
FAIL: buildok/twentyseven.stp with server
FAIL: buildok/twentythree.stp with server
FAIL: buildok/twentytwo.stp with server
FAIL: buildok/two.stp with server
FAIL: buildok/ucontext-symbols-embedded.stp with server
FAIL: buildok/ucontext-unwind-embedded.stp with server
FAIL: buildok/udp-all-probes.stp with server
FAIL: buildok/udp-detailed.stp with server
FAIL: buildok/udp_test.stp with server
FAIL: buildok/utrace.stp with server
FAIL: buildok/vfs-all-probes.stp with server
FAIL: buildok/vfs-detailed.stp with server
FAIL: buildok/vfs-embedded.stp with server
FAIL: buildok/xtime.stp with server
Stopping the systemtap server with PID==773
Running /home/roland/redhat/systemtap/testsuite/systemtap.server/server_args.exp ...
Testing using a systemtap server
Started a systemtap server as PID==17442
FAIL: Server Argument Test 0
FAIL: Server Argument Test 1
FAIL: Server Argument Test 2
FAIL: Server Argument Test 3
FAIL: Server Argument Test 4
FAIL: Server Argument Test 5
FAIL: Server Argument Test 6
FAIL: Server Argument Test 7
FAIL: Server Argument Test 8
FAIL: Server Argument Test 9
FAIL: Server Argument Test 10
FAIL: Server Argument Test 11
FAIL: Server Argument Test 12
FAIL: Server Argument Test 13
FAIL: Server Argument Test 14
FAIL: Server Argument Test 15
FAIL: Server Argument Test 16
FAIL: Server Argument Test 17
FAIL: Server Argument Test 18
FAIL: Server Argument Test 19
FAIL: Server Argument Test 20
FAIL: Fuzzing Server Argument Test 0
FAIL: Fuzzing Server Argument Test 1
FAIL: Fuzzing Server Argument Test 2
FAIL: Fuzzing Server Argument Test 3
FAIL: Fuzzing Server Argument Test 4
FAIL: Fuzzing Server Argument Test 5
FAIL: Fuzzing Server Argument Test 6
FAIL: Fuzzing Server Argument Test 7
FAIL: Fuzzing Server Argument Test 8
FAIL: Fuzzing Server Argument Test 9
Stopping the systemtap server with PID==17442
Running /home/roland/redhat/systemtap/testsuite/systemtap.stress/all_kernel_functions.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.stress/conversions.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.stress/current.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.stress/whitelist.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.string/dot.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.string/isinstr.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.string/sprint.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.string/str_replace.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.string/strlen.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.string/strtol.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.string/substr.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.string/text_str.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.string/tokenize.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.syscall/nd_syscall.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.syscall/syscall.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.unprivileged/unprivilegedko.exp ...
Running /home/roland/redhat/systemtap/testsuite/systemtap.unprivileged/unprivilegedok.exp ...
=== systemtap Summary ===
# of expected passes 290
# of unexpected failures 351
# of unexpected successes 8
# of expected failures 225
# of known failures 14
# of untested testcases 450
make[5]: Leaving directory `/home/roland/build/systemtap/testsuite'
make[4]: Leaving directory `/home/roland/build/systemtap/testsuite'
make[3]: Leaving directory `/home/roland/build/systemtap'
make[2]: Leaving directory `/home/roland/build/systemtap'
make[1]: Leaving directory `/home/roland/build/systemtap'
Compilation finished at Thu May 20 04:25:44
^ permalink raw reply [flat|nested] 8+ messages in thread
* Re: testsuite status
2010-05-20 19:34 testsuite status Roland McGrath
@ 2010-05-20 19:37 ` David Smith
2010-05-20 20:17 ` Josh Stone
` (2 more replies)
2010-05-21 18:27 ` Mark Wielaard
1 sibling, 3 replies; 8+ messages in thread
From: David Smith @ 2010-05-20 19:37 UTC (permalink / raw)
To: Roland McGrath; +Cc: systemtap
On 05/20/2010 01:44 PM, Roland McGrath wrote:
> With current git (release-1.2-157-g00130b8) I get the following
> for 'make check'. Is this the expected status quo, or is there
> something wrong with my build?
There's something wrong with your build. On my
2.6.34-0.49.rc7.git0.fc14.x86_64 rawhide vm, I only get 1 unexpected
failure from the 'buildok' testsuite, where they almost all failed for you.
Try something simple like:
# stap -vp4 -e 'probe begin { printf("hello world\n") }'
Then try something harder like:
# stap -vp4 -e 'probe syscall.read { printf("read %d bytes\n", count) }'
> Also, I'm interested in a slightly different regression testing scenario.
> I'm doing some internal changes that should not affect output at all. So
> what I'd like to do is not even bother with a 'make installcheck' or any
> dynamic tests, but instead run on a full set (as full as possible) of test
> scripts, but only translate them to C and save all those .c files. Then I
> want to do that before and after a change, and see diffs on all the
> generated C files. Is there a way to run the testsuite like that?
Hmm, not that I know of. You might be able to:
- delete your cache directory (in the testsuite, not in your home dir)
- run the original code, then move the cache directory someplace
- compile your new code, run the testsuite
- compare old and new cache directories
The hard part here might be mapping a cached C file back to its original
script.
--
David Smith
dsmith@redhat.com
Red Hat
http://www.redhat.com
256.217.0141 (direct)
256.837.0057 (fax)
^ permalink raw reply [flat|nested] 8+ messages in thread
* Re: testsuite status
2010-05-20 19:37 ` David Smith
@ 2010-05-20 20:17 ` Josh Stone
2010-05-20 21:03 ` Josh Stone
2010-05-21 16:56 ` Roland McGrath
2 siblings, 0 replies; 8+ messages in thread
From: Josh Stone @ 2010-05-20 20:17 UTC (permalink / raw)
To: David Smith; +Cc: Roland McGrath, systemtap
On 05/20/2010 12:06 PM, David Smith wrote:
> The hard part here might be mapping a cached C file back to its original
> script.
A crude way is to grep for the first "c->last_stmt =" which is not a
".../tapset/..." path. That won't work for some of tests which reuse
the same script with different inputs, but it should be a decent
approximation...
Josh
^ permalink raw reply [flat|nested] 8+ messages in thread
* Re: testsuite status
2010-05-20 19:37 ` David Smith
2010-05-20 20:17 ` Josh Stone
@ 2010-05-20 21:03 ` Josh Stone
2010-05-21 18:16 ` Roland McGrath
2010-05-21 16:56 ` Roland McGrath
2 siblings, 1 reply; 8+ messages in thread
From: Josh Stone @ 2010-05-20 21:03 UTC (permalink / raw)
To: David Smith; +Cc: Roland McGrath, systemtap
On 05/20/2010 12:06 PM, David Smith wrote:
> On 05/20/2010 01:44 PM, Roland McGrath wrote:
>> Also, I'm interested in a slightly different regression testing scenario.
>> I'm doing some internal changes that should not affect output at all. So
>> what I'd like to do is not even bother with a 'make installcheck' or any
>> dynamic tests, but instead run on a full set (as full as possible) of test
>> scripts, but only translate them to C and save all those .c files. Then I
>> want to do that before and after a change, and see diffs on all the
>> generated C files. Is there a way to run the testsuite like that?
>
> Hmm, not that I know of. You might be able to:
>
> - delete your cache directory (in the testsuite, not in your home dir)
> - run the original code, then move the cache directory someplace
> - compile your new code, run the testsuite
> - compare old and new cache directories
Another idea -- if you want to also compare all the things that would
have been in installcheck, you could just neuter stap in the options
parsing to last_pass <= 3. The testsuite will report lots of failures,
but you'll still be able to compare the generated C.
Josh
^ permalink raw reply [flat|nested] 8+ messages in thread
* Re: testsuite status
2010-05-20 19:37 ` David Smith
2010-05-20 20:17 ` Josh Stone
2010-05-20 21:03 ` Josh Stone
@ 2010-05-21 16:56 ` Roland McGrath
2 siblings, 0 replies; 8+ messages in thread
From: Roland McGrath @ 2010-05-21 16:56 UTC (permalink / raw)
To: David Smith; +Cc: systemtap
> There's something wrong with your build. On my
> 2.6.34-0.49.rc7.git0.fc14.x86_64 rawhide vm, I only get 1 unexpected
> failure from the 'buildok' testsuite, where they almost all failed for you.
Mine is F-13, not rawhide. I did a 'make clean' and re-build and got the same.
.../configure --disable-refdocs --disable-docs CFLAGS=-g CXXFLAGS=-g
elfutils-0.147-1.fc13.x86_64
gcc-4.4.4-2.fc13.x86_64
binutils-2.20.51.0.2-20.fc13.x86_64
kernel-2.6.33.3-85.fc13.x86_64
kernel-debuginfo-2.6.33.3-85.fc13.x86_64
> Try something simple like:
>
> # stap -vp4 -e 'probe begin { printf("hello world\n") }'
>
> Then try something harder like:
>
> # stap -vp4 -e 'probe syscall.read { printf("read %d bytes\n", count) }'
Both these complete fine with ./run-stap in my build.
> Hmm, not that I know of. You might be able to:
>
> - delete your cache directory (in the testsuite, not in your home dir)
> - run the original code, then move the cache directory someplace
> - compile your new code, run the testsuite
> - compare old and new cache directories
Sounds automatable.
> The hard part here might be mapping a cached C file back to its original
> script.
I don't actually care all that much about that, since I'm just going to
look at the diffs and go back to the translator code that generates C code
that looks like that. But, maybe the testsuite could use -m options with a
name derived from the testsuite source file name or test description, and
use cache file names with that (instead of _$pid) in the name?
Or, could have .systemtap/cache/xx/stap_xxyyzz.log stored with original
command line and file names, some bits of -v-like output, etc. That is
probably worthwhile by default, just so you can always go and see a little
bit of paper trail when there is a cached .c or .ko around and something
needs investigation.
Thanks,
Roland
^ permalink raw reply [flat|nested] 8+ messages in thread
* Re: testsuite status
2010-05-20 21:03 ` Josh Stone
@ 2010-05-21 18:16 ` Roland McGrath
0 siblings, 0 replies; 8+ messages in thread
From: Roland McGrath @ 2010-05-21 18:16 UTC (permalink / raw)
To: Josh Stone; +Cc: David Smith, systemtap
> Another idea -- if you want to also compare all the things that would
> have been in installcheck, you could just neuter stap in the options
> parsing to last_pass <= 3. The testsuite will report lots of failures,
> but you'll still be able to compare the generated C.
Maybe have a STAP_MAXPASS envar or something that does this?
Please to be scripting me a 'make regression OUTPUT=foo' so
'diff -ru foo bar' from two runs says something worth seeing.
Thanks,
Roland
^ permalink raw reply [flat|nested] 8+ messages in thread
* Re: testsuite status
2010-05-20 19:34 testsuite status Roland McGrath
2010-05-20 19:37 ` David Smith
@ 2010-05-21 18:27 ` Mark Wielaard
2010-05-21 18:30 ` Roland McGrath
1 sibling, 1 reply; 8+ messages in thread
From: Mark Wielaard @ 2010-05-21 18:27 UTC (permalink / raw)
To: Roland McGrath; +Cc: systemtap
On Thu, 2010-05-20 at 11:44 -0700, Roland McGrath wrote:
> With current git (release-1.2-157-g00130b8) I get the following
> for 'make check'. Is this the expected status quo, or is there
> something wrong with my build?
There shouldn't be many, if any failures.
> -*- mode: compilation; default-directory: "~/build/systemtap/" -*-
> Compilation started at Thu May 20 03:35:31
>
> make -k -j9 check
> make check-recursive
Sadly make [install]check isn't parallel make safe.
Cheers,
Mark
^ permalink raw reply [flat|nested] 8+ messages in thread
* Re: testsuite status
2010-05-21 18:27 ` Mark Wielaard
@ 2010-05-21 18:30 ` Roland McGrath
0 siblings, 0 replies; 8+ messages in thread
From: Roland McGrath @ 2010-05-21 18:30 UTC (permalink / raw)
To: Mark Wielaard; +Cc: systemtap
> Sadly make [install]check isn't parallel make safe.
Ah! I figured since it's all one big dejagnu run, it wasn't making any
difference. But it's in MAKEFLAGS inherited through there. Probably the
test suite should be removing any incoming MAKEFLAGS from the environment
if it runs make. (I assume it's not stap letting this through, since you
can slip all kind of trouble into the kernel module build through there.)
Indeed, it looks much better with no -j.
Thanks,
Roland
^ permalink raw reply [flat|nested] 8+ messages in thread
end of thread, other threads:[~2010-05-20 20:17 UTC | newest]
Thread overview: 8+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2010-05-20 19:34 testsuite status Roland McGrath
2010-05-20 19:37 ` David Smith
2010-05-20 20:17 ` Josh Stone
2010-05-20 21:03 ` Josh Stone
2010-05-21 18:16 ` Roland McGrath
2010-05-21 16:56 ` Roland McGrath
2010-05-21 18:27 ` Mark Wielaard
2010-05-21 18:30 ` Roland McGrath
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for read-only IMAP folder(s) and NNTP newsgroup(s).