From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: (qmail 13188 invoked by alias); 7 Aug 2018 17:23:35 -0000 Mailing-List: contact systemtap-help@sourceware.org; run by ezmlm Precedence: bulk List-Id: List-Subscribe: List-Post: List-Help: , Sender: systemtap-owner@sourceware.org Received: (qmail 10347 invoked by uid 48); 7 Aug 2018 17:23:29 -0000 From: "agentzh at gmail dot com" To: systemtap@sourceware.org Subject: [Bug testsuite/23493] New: Test suite makes all CPU stuck forever on kernel 2.6.16 (Fedora 27) Date: Tue, 07 Aug 2018 17:23:00 -0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: new X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: systemtap X-Bugzilla-Component: testsuite X-Bugzilla-Version: unspecified X-Bugzilla-Keywords: X-Bugzilla-Severity: normal X-Bugzilla-Who: agentzh at gmail dot com X-Bugzilla-Status: UNCONFIRMED X-Bugzilla-Resolution: X-Bugzilla-Priority: P2 X-Bugzilla-Assigned-To: systemtap at sourceware dot org X-Bugzilla-Target-Milestone: --- X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_id short_desc product version bug_status bug_severity priority component assigned_to reporter target_milestone Message-ID: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: http://sourceware.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-SW-Source: 2018-q3/txt/msg00060.txt.bz2 https://sourceware.org/bugzilla/show_bug.cgi?id=3D23493 Bug ID: 23493 Summary: Test suite makes all CPU stuck forever on kernel 2.6.16 (Fedora 27) Product: systemtap Version: unspecified Status: UNCONFIRMED Severity: normal Priority: P2 Component: testsuite Assignee: systemtap at sourceware dot org Reporter: agentzh at gmail dot com Target Milestone: --- I tried running the tests for systemtap release 3.3 (both the tests and the source code were from that release) on my Fedora 27 with kernel 2.6.16, but after running the tests for one hour, all the 8 logical CPU cores stuck for more than 8 hours without going any further and I had to reboot the VM with force (even ssh cannot work). Below is all the error messages after the stuck happens: Aug 7 00:27:28 work2 kernel: Systemtap Error at _stp_mempool_init:50 Aug 7 00:27:28 work2 kernel: Memory allocation failed. Aug 7 00:27:28 work2 kernel: Systemtap Error at _stp_register_ctl_channel:= 738 Aug 7 00:27:28 work2 kernel: Error creating systemtap control channel. Aug 7 00:31:29 work2 dhclient[1149]: DHCPREQUEST on ens36 to 192.168.46.254 port 67 (xid=3D0x2772f551) Aug 7 00:31:29 work2 dhclient[1149]: DHCPACK from 192.168.46.254 (xid=3D0x2772f551) Aug 7 00:31:29 work2 NetworkManager[839]: [1533627089.6530] dhcp4 (ens36): address 192.168.46.170 Aug 7 00:31:29 work2 NetworkManager[839]: [1533627089.6533] dhcp4 (ens36): plen 24 (255.255.255.0) Aug 7 00:31:29 work2 NetworkManager[839]: [1533627089.6533] dhcp4 (ens36): lease time 1800 Aug 7 00:31:29 work2 NetworkManager[839]: [1533627089.6533] dhcp4 (ens36): nameserver '192.168.46.1' Aug 7 00:31:29 work2 NetworkManager[839]: [1533627089.6533] dhcp4 (ens36): domain name 'localdomain' Aug 7 00:31:29 work2 dbus-daemon[724]: [system] Activating via systemd: service name=3D'org.freedesktop.nm_dispatcher' unit=3D'dbus-org.freedesktop.nm-dispatcher.service' requested by ':1.5' (ui= d=3D0 pid=3D839 comm=3D"/usr/sbin/NetworkManager --no-daemon " label=3D"system_u:system_r:NetworkManager_t:s0") Aug 7 00:31:29 work2 NetworkManager[839]: [1533627089.6533] dhcp4 (ens36): state changed bound -> bound Aug 7 00:31:29 work2 dhclient[1149]: bound to 192.168.46.170 -- renewal in= 683 seconds. Aug 7 00:31:29 work2 systemd[1]: Starting Network Manager Script Dispatcher Service... Aug 7 00:31:29 work2 dbus-daemon[724]: [system] Successfully activated ser= vice 'org.freedesktop.nm_dispatcher' Aug 7 00:31:29 work2 audit[1]: SERVICE_START pid=3D1 uid=3D0 auid=3D429496= 7295 ses=3D4294967295 subj=3Dsystem_u:system_r:init_t:s0 msg=3D'unit=3DNetworkManager-dispatcher comm=3D"systemd" exe=3D"/usr/lib/systemd/systemd" hostname=3D? addr=3D? terminal=3D? res=3Ds= uccess' Aug 7 00:31:29 work2 systemd[1]: Started Network Manager Script Dispatcher Service. Aug 7 00:31:29 work2 nm-dispatcher[47712]: req:1 'dhcp4-change' [ens36]: n= ew request (6 scripts) Aug 7 00:31:29 work2 nm-dispatcher[47712]: req:1 'dhcp4-change' [ens36]: s= tart running ordered scripts... Aug 7 00:31:40 work2 audit[1]: SERVICE_STOP pid=3D1 uid=3D0 auid=3D4294967= 295 ses=3D4294967295 subj=3Dsystem_u:system_r:init_t:s0 msg=3D'unit=3DNetworkManager-dispatcher comm=3D"systemd" exe=3D"/usr/lib/systemd/systemd" hostname=3D? addr=3D? terminal=3D? res=3Ds= uccess' Aug 7 00:32:33 work2 audit[59170]: ANOM_ABEND auid=3D1000 uid=3D0 gid=3D0 = ses=3D3 subj=3Dunconfined_u:unconfined_r:unconfined_t:s0-s0:c0.c1023 pid=3D59170 comm=3D"test" exe=3D"/mnt/home/agentzh/git/stap-build/testsuite/artifacts/systemtap.base/= pr18649/test" sig=3D11 res=3D1 Aug 7 00:32:33 work2 kernel: test[59170]: segfault at 0 ip 000000000000000= 0 sp 00000000fff42e30 error 14 in test[8048000+1000] Aug 7 00:32:33 work2 systemd[1]: Started Process Core Dump (PID 59186/UID = 0). Aug 7 00:32:33 work2 audit[1]: SERVICE_START pid=3D1 uid=3D0 auid=3D429496= 7295 ses=3D4294967295 subj=3Dsystem_u:system_r:init_t:s0 msg=3D'unit=3Dsystemd-coredump@5-59186-0 comm=3D"systemd" exe=3D"/usr/lib/systemd/systemd" hostname=3D? addr=3D? terminal=3D? res=3Ds= uccess' Aug 7 00:32:34 work2 systemd-coredump[59191]: Process 59170 (test) of user= 0 dumped core.#012#012Stack trace of thread 59170:#012#0 0x0000000000000000 = n/a (n/a) Aug 7 00:32:34 work2 audit[1]: SERVICE_STOP pid=3D1 uid=3D0 auid=3D4294967= 295 ses=3D4294967295 subj=3Dsystem_u:system_r:init_t:s0 msg=3D'unit=3Dsystemd-coredump@5-59186-0 comm=3D"systemd" exe=3D"/usr/lib/systemd/systemd" hostname=3D? addr=3D? terminal=3D? res=3Ds= uccess' Aug 7 00:32:45 work2 kernel: test[62368]: segfault at 0 ip 000000000000000= 0 sp 00000000ffb53270 error 14 in test[8048000+1000] Aug 7 00:32:45 work2 audit[62368]: ANOM_ABEND auid=3D1000 uid=3D0 gid=3D0 = ses=3D3 subj=3Dunconfined_u:unconfined_r:unconfined_t:s0-s0:c0.c1023 pid=3D62368 comm=3D"test" exe=3D"/mnt/home/agentzh/git/stap-build/testsuite/artifacts/systemtap.base/= pr18649/test" sig=3D11 res=3D1 Aug 7 00:32:45 work2 systemd[1]: Started Process Core Dump (PID 62441/UID = 0). Aug 7 00:32:45 work2 audit[1]: SERVICE_START pid=3D1 uid=3D0 auid=3D429496= 7295 ses=3D4294967295 subj=3Dsystem_u:system_r:init_t:s0 msg=3D'unit=3Dsystemd-coredump@6-62441-0 comm=3D"systemd" exe=3D"/usr/lib/systemd/systemd" hostname=3D? addr=3D? terminal=3D? res=3Ds= uccess' Aug 7 00:32:46 work2 systemd-coredump[62445]: Process 62368 (test) of user= 0 dumped core.#012#012Stack trace of thread 62368:#012#0 0x0000000000000000 = n/a (n/a) Aug 7 00:32:46 work2 audit[1]: SERVICE_STOP pid=3D1 uid=3D0 auid=3D4294967= 295 ses=3D4294967295 subj=3Dsystem_u:system_r:init_t:s0 msg=3D'unit=3Dsystemd-coredump@6-62441-0 comm=3D"systemd" exe=3D"/usr/lib/systemd/systemd" hostname=3D? addr=3D? terminal=3D? res=3Ds= uccess' Aug 7 00:32:51 work2 audit[64501]: ANOM_ABEND auid=3D1000 uid=3D0 gid=3D0 = ses=3D3 subj=3Dunconfined_u:unconfined_r:unconfined_t:s0-s0:c0.c1023 pid=3D64501 comm=3D"test" exe=3D"/mnt/home/agentzh/git/stap-build/testsuite/artifacts/systemtap.base/= uprobe_nd_params/test" sig=3D11 res=3D1 Aug 7 00:32:51 work2 kernel: test[64501]: segfault at 0 ip 000000000000000= 0 sp 00000000ff877e2c error 14 in test[8048000+1000] Aug 7 00:32:51 work2 systemd[1]: Started Process Core Dump (PID 64521/UID = 0). Aug 7 00:32:51 work2 audit[1]: SERVICE_START pid=3D1 uid=3D0 auid=3D429496= 7295 ses=3D4294967295 subj=3Dsystem_u:system_r:init_t:s0 msg=3D'unit=3Dsystemd-coredump@7-64521-0 comm=3D"systemd" exe=3D"/usr/lib/systemd/systemd" hostname=3D? addr=3D? terminal=3D? res=3Ds= uccess' Aug 7 00:32:52 work2 systemd-coredump[64529]: Process 64501 (test) of user= 0 dumped core.#012#012Stack trace of thread 64501:#012#0 0x0000000000000000 = n/a (n/a) Aug 7 00:32:52 work2 audit[1]: SERVICE_STOP pid=3D1 uid=3D0 auid=3D4294967= 295 ses=3D4294967295 subj=3Dsystem_u:system_r:init_t:s0 msg=3D'unit=3Dsystemd-coredump@7-64521-0 comm=3D"systemd" exe=3D"/usr/lib/systemd/systemd" hostname=3D? addr=3D? terminal=3D? res=3Ds= uccess' Aug 7 00:33:25 work2 stapio[65395]: WARNING: Aug 7 00:33:25 work2 stapio[65395]: Aug 7 00:33:25 work2 stapio[65395]: Number of errors: 0, skipped probes: 23 Aug 7 00:34:16 work2 kernel: stap_e0ad497a0eaf9de8589606c16f0b585_79159: unknown parameter 'pt' ignored And below is the last bunch of lines in the test run output. Running target unix Using /usr/share/dejagnu/baseboards/unix.exp as board description file for target. Using /usr/share/dejagnu/config/unix.exp as generic interface file for targ= et. Using /mnt/home/agentzh/git/systemtap/testsuite/config/unix.exp as tool-and-target-specific interface file. Test run by root on Tue Aug 7 00:35:53 2018 Native configuration is x86_64-pc-linux-gnu =3D=3D=3D systemtap tests =3D=3D=3D Running /mnt/home/agentzh/git/systemtap/testsuite/systemtap.base/kallsyms_expand_sy= mbol.exp ... Schedule of variations: unix Running target unix Using /usr/share/dejagnu/baseboards/unix.exp as board description file for target. Using /usr/share/dejagnu/config/unix.exp as generic interface file for targ= et. Using /mnt/home/agentzh/git/systemtap/testsuite/config/unix.exp as tool-and-target-specific interface file. Running /mnt/home/agentzh/git/systemtap/testsuite/systemtap.base/perf.exp .= .. =3D=3D=3D systemtap Summary =3D=3D=3D # of expected passes 2 make[3]: Leaving directory '/mnt/home/agentzh/git/stap-build/testsuite' if test -e artifacts/systemtap.base/sdt_varname ; then \ echo "Using existing test result for systemtap.base/sdt_varname.exp"; \ else \ mkdir -p artifacts/systemtap.base/sdt_varname ; \ MAKEFLAGS=3D make check-DEJAGNU RUNTESTFLAGS=3D"--outdir=3Dartifacts/systemtap.base/sdt_varname systemtap.base/sdt_varname.exp --tool_opts \'install \'" STAP_PARALLEL=3Dy= es; \ fi make[3]: Entering directory '/mnt/home/agentzh/git/stap-build/testsuite' srcdir=3D'../../systemtap/testsuite'; export srcdir; \ EXPECT=3Dexpect; export EXPECT; \ if /bin/sh -c "env XDG_DATA_DIRS=3D SYSTEMTAP_SYNC=3D1 LANG=3DC SYSTEMTAP_TESTREMOTES=3D SYSTEMTAP_TESTAPPS=3D SYSTEMTAP_RUNTIME=3D/opt/stap/share/systemtap/runtime SYSTEMTAP_TAPSET=3D/opt/stap/share/systemtap/tapset LD_LIBRARY_PATH=3D/opt/stap/lib/systemtap:/opt/stap/lib/dyninst CRASH_LIBDIR=3D/opt/stap/lib/systemtap PATH=3D/opt/stap/bin:$PATH SYSTEMTAP_PATH=3D/opt/stap/bin SYSTEMTAP_INCLUDES=3D/opt/stap/include PKGLIBDIR=3D/opt/stap/libexec/systemtap PYTHON=3D/bin/python2 PYEXECDIR=3D/opt/stap/lib64/python2.7/site-packages PYTHON3=3D/bin/python3 PY3EXECDIR=3D/opt/stap/lib64/python3.6/site-packages SYSCONFDIR=3D/opt/stap= /etc ../../systemtap/testsuite/execrc runtest --version" > /dev/null 2>&1; then \ exit_status=3D0; l=3D'systemtap'; for tool in $l; do \ if env XDG_DATA_DIRS=3D SYSTEMTAP_SYNC=3D1 LANG=3DC SYSTEMTAP_TESTREMOT= ES=3D SYSTEMTAP_TESTAPPS=3D SYSTEMTAP_RUNTIME=3D/opt/stap/share/systemtap/runtime SYSTEMTAP_TAPSET=3D/opt/stap/share/systemtap/tapset LD_LIBRARY_PATH=3D/opt/stap/lib/systemtap:/opt/stap/lib/dyninst CRASH_LIBDIR=3D/opt/stap/lib/systemtap PATH=3D/opt/stap/bin:$PATH SYSTEMTAP_PATH=3D/opt/stap/bin SYSTEMTAP_INCLUDES=3D/opt/stap/include PKGLIBDIR=3D/opt/stap/libexec/systemtap PYTHON=3D/bin/python2 PYEXECDIR=3D/opt/stap/lib64/python2.7/site-packages PYTHON3=3D/bin/python3 PY3EXECDIR=3D/opt/stap/lib64/python3.6/site-packages SYSCONFDIR=3D/opt/stap= /etc ../../systemtap/testsuite/execrc runtest --tool $tool --tool_opts \'\' --srcdir /mnt/home/agentzh/git/systemtap/testsuite --outdir=3Dartifacts/systemtap.base/sdt_varname systemtap.base/sdt_varname.= exp=20 --tool_opts \'install \'; \ then :; else exit_status=3D1; fi; \ done; \ else echo "WARNING: could not find 'env XDG_DATA_DIRS=3D SYSTEMTAP_SYNC=3D1= LANG=3DC SYSTEMTAP_TESTREMOTES=3D SYSTEMTAP_TESTAPPS=3D SYSTEMTAP_RUNTIME=3D/opt/stap/share/systemtap/runtime SYSTEMTAP_TAPSET=3D/opt/stap/share/systemtap/tapset LD_LIBRARY_PATH=3D/opt/stap/lib/systemtap:/opt/stap/lib/dyninst CRASH_LIBDIR=3D/opt/stap/lib/systemtap PATH=3D/opt/stap/bin:$PATH SYSTEMTAP_PATH=3D/opt/stap/bin SYSTEMTAP_INCLUDES=3D/opt/stap/include PKGLIBDIR=3D/opt/stap/libexec/systemtap PYTHON=3D/bin/python2 PYEXECDIR=3D/opt/stap/lib64/python2.7/site-packages PYTHON3=3D/bin/python3 PY3EXECDIR=3D/opt/stap/lib64/python3.6/site-packages SYSCONFDIR=3D/opt/stap= /etc ../../systemtap/testsuite/execrc runtest'" 1>&2; :;\ fi; \ exit $exit_status WARNING: Couldn't find the global config file. Checking for 64-bit support... spawn -ignore SIGHUP gcc hello.c -g -m64 -lm -o hello-m64^M x86_64 64-bit support available Checking for 32-bit support... spawn -ignore SIGHUP gcc hello.c -g -m32 -lm -o hello-m32^M x86_64 32-bit support available kernel location: /usr/lib/debug/lib/modules/4.16.16-200.fc27.x86_64/vmlinux kernel version: 4.16.16-200.fc27.x86_64 systemtap location: /opt/stap/bin/stap systemtap version: version 3.3/0.173, commit release-3.3-0-g48867d1cface gcc location: /usr/bin/gcc gcc version: gcc (GCC) 7.3.1 20180712 (Red Hat 7.3.1-6) Test run by root on Tue Aug 7 00:35:57 2018 Native configuration is x86_64-pc-linux-gnu =3D=3D=3D systemtap tests =3D=3D=3D Schedule of variations: unix Running target unix Using /usr/share/dejagnu/baseboards/unix.exp as board description file for target. Using /usr/share/dejagnu/config/unix.exp as generic interface file for targ= et. Using /mnt/home/agentzh/git/systemtap/testsuite/config/unix.exp as tool-and-target-specific interface file. Running /mnt/home/agentzh/git/systemtap/testsuite/systemtap.base/sdt_varname.exp ... --=20 You are receiving this mail because: You are the assignee for the bug.