public inbox for systemtap@sourceware.org
 help / color / mirror / Atom feed
* [Bug testsuite/23493] New: Test suite makes all CPU stuck forever on kernel 2.6.16 (Fedora 27)
@ 2018-08-07 17:23 agentzh at gmail dot com
  2018-08-07 17:23 ` [Bug testsuite/23493] Test suite makes all CPU stuck forever on kernel 2.16.16 " agentzh at gmail dot com
                   ` (15 more replies)
  0 siblings, 16 replies; 17+ messages in thread
From: agentzh at gmail dot com @ 2018-08-07 17:23 UTC (permalink / raw)
  To: systemtap

https://sourceware.org/bugzilla/show_bug.cgi?id=23493

            Bug ID: 23493
           Summary: Test suite makes all CPU stuck forever on kernel
                    2.6.16 (Fedora 27)
           Product: systemtap
           Version: unspecified
            Status: UNCONFIRMED
          Severity: normal
          Priority: P2
         Component: testsuite
          Assignee: systemtap at sourceware dot org
          Reporter: agentzh at gmail dot com
  Target Milestone: ---

I tried running the tests for systemtap release 3.3 (both the tests and the
source code were from that release) on my Fedora 27 with kernel 2.6.16, but
after running the tests for one hour, all the 8 logical CPU cores stuck for
more than 8 hours without going any further and I had to reboot the VM with
force (even ssh cannot work).

Below is all the error messages after the stuck happens:

Aug  7 00:27:28 work2 kernel: Systemtap Error at _stp_mempool_init:50
Aug  7 00:27:28 work2 kernel: Memory allocation failed.
Aug  7 00:27:28 work2 kernel: Systemtap Error at _stp_register_ctl_channel:738
Aug  7 00:27:28 work2 kernel: Error creating systemtap control channel.
Aug  7 00:31:29 work2 dhclient[1149]: DHCPREQUEST on ens36 to 192.168.46.254
port 67 (xid=0x2772f551)
Aug  7 00:31:29 work2 dhclient[1149]: DHCPACK from 192.168.46.254
(xid=0x2772f551)
Aug  7 00:31:29 work2 NetworkManager[839]: <info>  [1533627089.6530] dhcp4
(ens36):   address 192.168.46.170
Aug  7 00:31:29 work2 NetworkManager[839]: <info>  [1533627089.6533] dhcp4
(ens36):   plen 24 (255.255.255.0)
Aug  7 00:31:29 work2 NetworkManager[839]: <info>  [1533627089.6533] dhcp4
(ens36):   lease time 1800
Aug  7 00:31:29 work2 NetworkManager[839]: <info>  [1533627089.6533] dhcp4
(ens36):   nameserver '192.168.46.1'
Aug  7 00:31:29 work2 NetworkManager[839]: <info>  [1533627089.6533] dhcp4
(ens36):   domain name 'localdomain'
Aug  7 00:31:29 work2 dbus-daemon[724]: [system] Activating via systemd:
service name='org.freedesktop.nm_dispatcher'
unit='dbus-org.freedesktop.nm-dispatcher.service' requested by ':1.5' (uid=0
pid=839 comm="/usr/sbin/NetworkManager --no-daemon "
label="system_u:system_r:NetworkManager_t:s0")
Aug  7 00:31:29 work2 NetworkManager[839]: <info>  [1533627089.6533] dhcp4
(ens36): state changed bound -> bound
Aug  7 00:31:29 work2 dhclient[1149]: bound to 192.168.46.170 -- renewal in 683
seconds.
Aug  7 00:31:29 work2 systemd[1]: Starting Network Manager Script Dispatcher
Service...
Aug  7 00:31:29 work2 dbus-daemon[724]: [system] Successfully activated service
'org.freedesktop.nm_dispatcher'
Aug  7 00:31:29 work2 audit[1]: SERVICE_START pid=1 uid=0 auid=4294967295
ses=4294967295 subj=system_u:system_r:init_t:s0
msg='unit=NetworkManager-dispatcher comm="systemd"
exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
Aug  7 00:31:29 work2 systemd[1]: Started Network Manager Script Dispatcher
Service.
Aug  7 00:31:29 work2 nm-dispatcher[47712]: req:1 'dhcp4-change' [ens36]: new
request (6 scripts)
Aug  7 00:31:29 work2 nm-dispatcher[47712]: req:1 'dhcp4-change' [ens36]: start
running ordered scripts...
Aug  7 00:31:40 work2 audit[1]: SERVICE_STOP pid=1 uid=0 auid=4294967295
ses=4294967295 subj=system_u:system_r:init_t:s0
msg='unit=NetworkManager-dispatcher comm="systemd"
exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
Aug  7 00:32:33 work2 audit[59170]: ANOM_ABEND auid=1000 uid=0 gid=0 ses=3
subj=unconfined_u:unconfined_r:unconfined_t:s0-s0:c0.c1023 pid=59170
comm="test"
exe="/mnt/home/agentzh/git/stap-build/testsuite/artifacts/systemtap.base/pr18649/test"
sig=11 res=1
Aug  7 00:32:33 work2 kernel: test[59170]: segfault at 0 ip 0000000000000000 sp
00000000fff42e30 error 14 in test[8048000+1000]
Aug  7 00:32:33 work2 systemd[1]: Started Process Core Dump (PID 59186/UID 0).
Aug  7 00:32:33 work2 audit[1]: SERVICE_START pid=1 uid=0 auid=4294967295
ses=4294967295 subj=system_u:system_r:init_t:s0
msg='unit=systemd-coredump@5-59186-0 comm="systemd"
exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
Aug  7 00:32:34 work2 systemd-coredump[59191]: Process 59170 (test) of user 0
dumped core.#012#012Stack trace of thread 59170:#012#0  0x0000000000000000 n/a
(n/a)
Aug  7 00:32:34 work2 audit[1]: SERVICE_STOP pid=1 uid=0 auid=4294967295
ses=4294967295 subj=system_u:system_r:init_t:s0
msg='unit=systemd-coredump@5-59186-0 comm="systemd"
exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
Aug  7 00:32:45 work2 kernel: test[62368]: segfault at 0 ip 0000000000000000 sp
00000000ffb53270 error 14 in test[8048000+1000]
Aug  7 00:32:45 work2 audit[62368]: ANOM_ABEND auid=1000 uid=0 gid=0 ses=3
subj=unconfined_u:unconfined_r:unconfined_t:s0-s0:c0.c1023 pid=62368
comm="test"
exe="/mnt/home/agentzh/git/stap-build/testsuite/artifacts/systemtap.base/pr18649/test"
sig=11 res=1
Aug  7 00:32:45 work2 systemd[1]: Started Process Core Dump (PID 62441/UID 0).
Aug  7 00:32:45 work2 audit[1]: SERVICE_START pid=1 uid=0 auid=4294967295
ses=4294967295 subj=system_u:system_r:init_t:s0
msg='unit=systemd-coredump@6-62441-0 comm="systemd"
exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
Aug  7 00:32:46 work2 systemd-coredump[62445]: Process 62368 (test) of user 0
dumped core.#012#012Stack trace of thread 62368:#012#0  0x0000000000000000 n/a
(n/a)
Aug  7 00:32:46 work2 audit[1]: SERVICE_STOP pid=1 uid=0 auid=4294967295
ses=4294967295 subj=system_u:system_r:init_t:s0
msg='unit=systemd-coredump@6-62441-0 comm="systemd"
exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
Aug  7 00:32:51 work2 audit[64501]: ANOM_ABEND auid=1000 uid=0 gid=0 ses=3
subj=unconfined_u:unconfined_r:unconfined_t:s0-s0:c0.c1023 pid=64501
comm="test"
exe="/mnt/home/agentzh/git/stap-build/testsuite/artifacts/systemtap.base/uprobe_nd_params/test"
sig=11 res=1
Aug  7 00:32:51 work2 kernel: test[64501]: segfault at 0 ip 0000000000000000 sp
00000000ff877e2c error 14 in test[8048000+1000]
Aug  7 00:32:51 work2 systemd[1]: Started Process Core Dump (PID 64521/UID 0).
Aug  7 00:32:51 work2 audit[1]: SERVICE_START pid=1 uid=0 auid=4294967295
ses=4294967295 subj=system_u:system_r:init_t:s0
msg='unit=systemd-coredump@7-64521-0 comm="systemd"
exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
Aug  7 00:32:52 work2 systemd-coredump[64529]: Process 64501 (test) of user 0
dumped core.#012#012Stack trace of thread 64501:#012#0  0x0000000000000000 n/a
(n/a)
Aug  7 00:32:52 work2 audit[1]: SERVICE_STOP pid=1 uid=0 auid=4294967295
ses=4294967295 subj=system_u:system_r:init_t:s0
msg='unit=systemd-coredump@7-64521-0 comm="systemd"
exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
Aug  7 00:33:25 work2 stapio[65395]: WARNING:
Aug  7 00:33:25 work2 stapio[65395]:
Aug  7 00:33:25 work2 stapio[65395]: Number of errors: 0, skipped probes: 23
Aug  7 00:34:16 work2 kernel: stap_e0ad497a0eaf9de8589606c16f0b585_79159:
unknown parameter 'pt' ignored

And below is the last bunch of lines in the test run output.

Running target unix
Using /usr/share/dejagnu/baseboards/unix.exp as board description file for
target.
Using /usr/share/dejagnu/config/unix.exp as generic interface file for target.
Using /mnt/home/agentzh/git/systemtap/testsuite/config/unix.exp as
tool-and-target-specific interface file.
Test run by root on Tue Aug  7 00:35:53 2018
Native configuration is x86_64-pc-linux-gnu

        === systemtap tests ===

Running
/mnt/home/agentzh/git/systemtap/testsuite/systemtap.base/kallsyms_expand_symbol.exp
...
Schedule of variations:
    unix

Running target unix
Using /usr/share/dejagnu/baseboards/unix.exp as board description file for
target.
Using /usr/share/dejagnu/config/unix.exp as generic interface file for target.
Using /mnt/home/agentzh/git/systemtap/testsuite/config/unix.exp as
tool-and-target-specific interface file.
Running /mnt/home/agentzh/git/systemtap/testsuite/systemtap.base/perf.exp ...

        === systemtap Summary ===

# of expected passes        2
make[3]: Leaving directory '/mnt/home/agentzh/git/stap-build/testsuite'
if test -e artifacts/systemtap.base/sdt_varname ; then \
echo "Using existing test result for systemtap.base/sdt_varname.exp"; \
else \
mkdir -p artifacts/systemtap.base/sdt_varname ; \
MAKEFLAGS= make  check-DEJAGNU
RUNTESTFLAGS="--outdir=artifacts/systemtap.base/sdt_varname
systemtap.base/sdt_varname.exp  --tool_opts \'install \'" STAP_PARALLEL=yes; \
fi
make[3]: Entering directory '/mnt/home/agentzh/git/stap-build/testsuite'
srcdir='../../systemtap/testsuite'; export srcdir; \
EXPECT=expect; export EXPECT; \
if /bin/sh -c "env XDG_DATA_DIRS= SYSTEMTAP_SYNC=1 LANG=C
SYSTEMTAP_TESTREMOTES= SYSTEMTAP_TESTAPPS=
SYSTEMTAP_RUNTIME=/opt/stap/share/systemtap/runtime
SYSTEMTAP_TAPSET=/opt/stap/share/systemtap/tapset
LD_LIBRARY_PATH=/opt/stap/lib/systemtap:/opt/stap/lib/dyninst
CRASH_LIBDIR=/opt/stap/lib/systemtap PATH=/opt/stap/bin:$PATH
SYSTEMTAP_PATH=/opt/stap/bin SYSTEMTAP_INCLUDES=/opt/stap/include
PKGLIBDIR=/opt/stap/libexec/systemtap PYTHON=/bin/python2
PYEXECDIR=/opt/stap/lib64/python2.7/site-packages PYTHON3=/bin/python3
PY3EXECDIR=/opt/stap/lib64/python3.6/site-packages SYSCONFDIR=/opt/stap/etc
../../systemtap/testsuite/execrc runtest --version" > /dev/null 2>&1; then \
  exit_status=0; l='systemtap'; for tool in $l; do \
    if env XDG_DATA_DIRS= SYSTEMTAP_SYNC=1 LANG=C SYSTEMTAP_TESTREMOTES=
SYSTEMTAP_TESTAPPS= SYSTEMTAP_RUNTIME=/opt/stap/share/systemtap/runtime
SYSTEMTAP_TAPSET=/opt/stap/share/systemtap/tapset
LD_LIBRARY_PATH=/opt/stap/lib/systemtap:/opt/stap/lib/dyninst
CRASH_LIBDIR=/opt/stap/lib/systemtap PATH=/opt/stap/bin:$PATH
SYSTEMTAP_PATH=/opt/stap/bin SYSTEMTAP_INCLUDES=/opt/stap/include
PKGLIBDIR=/opt/stap/libexec/systemtap PYTHON=/bin/python2
PYEXECDIR=/opt/stap/lib64/python2.7/site-packages PYTHON3=/bin/python3
PY3EXECDIR=/opt/stap/lib64/python3.6/site-packages SYSCONFDIR=/opt/stap/etc
../../systemtap/testsuite/execrc runtest  --tool $tool --tool_opts \'\'
--srcdir /mnt/home/agentzh/git/systemtap/testsuite
--outdir=artifacts/systemtap.base/sdt_varname systemtap.base/sdt_varname.exp 
--tool_opts \'install \'; \
    then :; else exit_status=1; fi; \
  done; \
else echo "WARNING: could not find 'env XDG_DATA_DIRS= SYSTEMTAP_SYNC=1 LANG=C
SYSTEMTAP_TESTREMOTES= SYSTEMTAP_TESTAPPS=
SYSTEMTAP_RUNTIME=/opt/stap/share/systemtap/runtime
SYSTEMTAP_TAPSET=/opt/stap/share/systemtap/tapset
LD_LIBRARY_PATH=/opt/stap/lib/systemtap:/opt/stap/lib/dyninst
CRASH_LIBDIR=/opt/stap/lib/systemtap PATH=/opt/stap/bin:$PATH
SYSTEMTAP_PATH=/opt/stap/bin SYSTEMTAP_INCLUDES=/opt/stap/include
PKGLIBDIR=/opt/stap/libexec/systemtap PYTHON=/bin/python2
PYEXECDIR=/opt/stap/lib64/python2.7/site-packages PYTHON3=/bin/python3
PY3EXECDIR=/opt/stap/lib64/python3.6/site-packages SYSCONFDIR=/opt/stap/etc
../../systemtap/testsuite/execrc runtest'" 1>&2; :;\
fi; \
exit $exit_status
WARNING: Couldn't find the global config file.
Checking for 64-bit support...
spawn -ignore SIGHUP gcc hello.c -g -m64 -lm -o hello-m64^M
x86_64 64-bit support available
Checking for 32-bit support...
spawn -ignore SIGHUP gcc hello.c -g -m32 -lm -o hello-m32^M
x86_64 32-bit support available
kernel location: /usr/lib/debug/lib/modules/4.16.16-200.fc27.x86_64/vmlinux
kernel version: 4.16.16-200.fc27.x86_64
systemtap location: /opt/stap/bin/stap
systemtap version: version 3.3/0.173, commit release-3.3-0-g48867d1cface
gcc location: /usr/bin/gcc
gcc version: gcc (GCC) 7.3.1 20180712 (Red Hat 7.3.1-6)
Test run by root on Tue Aug  7 00:35:57 2018
Native configuration is x86_64-pc-linux-gnu

        === systemtap tests ===

Schedule of variations:
    unix

Running target unix
Using /usr/share/dejagnu/baseboards/unix.exp as board description file for
target.
Using /usr/share/dejagnu/config/unix.exp as generic interface file for target.
Using /mnt/home/agentzh/git/systemtap/testsuite/config/unix.exp as
tool-and-target-specific interface file.
Running
/mnt/home/agentzh/git/systemtap/testsuite/systemtap.base/sdt_varname.exp ...

-- 
You are receiving this mail because:
You are the assignee for the bug.

^ permalink raw reply	[flat|nested] 17+ messages in thread
end of thread, other threads:[~2023-05-25 16:35 UTC | newest]

Thread overview: 17+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2018-08-07 17:23 [Bug testsuite/23493] New: Test suite makes all CPU stuck forever on kernel 2.6.16 (Fedora 27) agentzh at gmail dot com
2018-08-07 17:23 ` [Bug testsuite/23493] Test suite makes all CPU stuck forever on kernel 2.16.16 " agentzh at gmail dot com
2018-08-07 17:24 ` [Bug testsuite/23493] Test suite makes all CPU stuck forever on kernel 4.16.16 " agentzh at gmail dot com
2018-08-07 17:26 ` agentzh at gmail dot com
2018-08-07 17:42 ` agentzh at gmail dot com
2018-08-08 23:03 ` fche at redhat dot com
2018-08-10 18:41 ` agentzh at gmail dot com
2018-08-10 18:43 ` agentzh at gmail dot com
2018-08-10 18:50 ` agentzh at gmail dot com
2018-08-26  6:27 ` agentzh at gmail dot com
2018-08-29  1:20 ` agentzh at gmail dot com
2018-08-29 12:59 ` mark at klomp dot org
2018-08-29 17:47 ` agentzh at gmail dot com
2018-08-29 18:02 ` agentzh at gmail dot com
2020-02-20 14:26 ` fche at redhat dot com
2020-02-20 20:41 ` agentzh at gmail dot com
2023-05-25 16:35 ` fche at redhat dot com

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for read-only IMAP folder(s) and NNTP newsgroup(s).