From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: (qmail 17860 invoked by alias); 7 Jun 2010 13:01:15 -0000 Received: (qmail 14134 invoked by uid 48); 7 Jun 2010 13:00:57 -0000 Date: Tue, 08 Jun 2010 11:07:00 -0000 From: "mjw at redhat dot com" To: systemtap@sources.redhat.com Message-ID: <20100607130056.11672.mjw@redhat.com> Reply-To: sourceware-bugzilla@sourceware.org Subject: [Bug uprobes/11672] New: utrace_report_syscall_exit crash X-Bugzilla-Reason: AssignedTo Mailing-List: contact systemtap-help@sourceware.org; run by ezmlm Precedence: bulk List-Id: List-Subscribe: List-Post: List-Help: , Sender: systemtap-owner@sourceware.org X-SW-Source: 2010-q2/txt/msg00494.txt.bz2 I get this oops sometimes. It involves utrace_report_syscall_exit going bad. There is no simple reliable reproducer. It happens when I am stress testing systemtap and have several scripts doing various uprobes. BUG: unable to handle kernel paging request at ffffffffa0b10d00 IP: [] utrace_report_syscall_exit+0x96/0xf0 PGD 1003067 PUD 1007063 PMD 104a7d067 PTE 0 Oops: 0000 [#1] SMP last sysfs file: /sys/devices/pci0000:00/0000:00:1c.5/0000:01:00.0/net/eth0/statistics/tx_packets CPU 4 Modules linked in: uprobes(U) authenc(U) iptable_nat(U) nf_nat(U) ah6(U) ah4(U) esp6(U) esp4(U) xfrm4_mode_beet(U) xfrm4_tunnel(U) xfrm4_mode_tunnel(U) xfrm4_mode_transport(U) xfrm6_mode_transport(U) xfrm6_mode_ro(U) xfrm6_mode_beet(U) xfrm6_mode_tunnel(U) ipcomp(U) ipcomp6(U) xfrm6_tunnel(U) af_key(U) fuse(U) ip6table_filter(U) ip6_tables(U) ebtable_nat(U) ebtables(U) netconsole(U) configfs(U) deflate(U) zlib_deflate(U) ctr(U) camellia(U) cast5(U) rmd160(U) crypto_null(U) ccm(U) serpent(U) blowfish(U) twofish_x86_64(U) twofish_common(U) ecb(U) xcbc(U) cbc(U) sha256_generic(U) sha512_generic(U) des_generic(U) cryptd(U) aes_x86_64(U) aes_generic(U) tunnel4(U) xfrm_ipcomp(U) tunnel6(U) nfsd(U) nfs_acl(U) auth_rpcgss(U) exportfs(U) autofs4(U) lockd(U) sunrpc(U) cpufreq_ondemand(U) acpi_cpufreq(U) freq_table(U) bridge(U) stp(U) llc(U) xt_physdev(U) be2iscsi(U) bnx2i(U) cnic(U) uio(U) cxgb3i(U) cxgb3(U) mdio(U) ib_iser(U) rdma_cm(U) ib_cm(U) iw_cm(U) ib_sa(U) ib_mad(U) ib_core(U) ib_addr(U) ipv6(U) iscsi_tcp(U) libiscsi_tcp(U) libiscsi(U) scsi_transport_iscsi(U) ext3(U) jbd(U) dm_mirror(U) dm_region_hash(U) dm_log(U) kvm_intel(U) kvm(U) uinput(U) snd_hda_codec_realtek(U) snd_hda_intel(U) snd_hda_codec(U) snd_usb_audio(U) snd_seq(U) snd_pcm(U) snd_usb_lib(U) snd_rawmidi(U) snd_timer(U) snd_seq_device(U) snd_hwdep(U) serio_raw(U) snd(U) sg(U) tg3(U) i7core_edac(U) edac_core(U) soundcore(U) wmi(U) tpm_infineon(U) snd_page_alloc(U) iTCO_wdt(U) iTCO_vendor_support(U) ext4(U) mbcache(U) jbd2(U) raid456(U) async_raid6_recov(U) async_pq(U) raid6_pq(U) async_xor(U) xor(U) async_memcpy(U) async_tx(U) sd_mod(U) crc_t10dif(U) firewire_ohci(U) usb_storage(U) firewire_core(U) crc_itu_t(U) ahci(U) radeon(U) ttm(U) drm_kms_helper(U) drm(U) i2c_algo_bit(U) i2c_core(U) dm_mod(U) [last unloaded: stap_5a471983680cefbac658241d073264fb_77899] Modules linked in: uprobes(U) authenc(U) iptable_nat(U) nf_nat(U) ah6(U) ah4(U) esp6(U) esp4(U) xfrm4_mode_beet(U) xfrm4_tunnel(U) xfrm4_mode_tunnel(U) xfrm4_mode_transport(U) xfrm6_mode_transport(U) xfrm6_mode_ro(U) xfrm6_mode_beet(U) xfrm6_mode_tunnel(U) ipcomp(U) ipcomp6(U) xfrm6_tunnel(U) af_key(U) fuse(U) ip6table_filter(U) ip6_tables(U) ebtable_nat(U) ebtables(U) netconsole(U) configfs(U) deflate(U) zlib_deflate(U) ctr(U) camellia(U) cast5(U) rmd160(U) crypto_null(U) ccm(U) serpent(U) blowfish(U) twofish_x86_64(U) twofish_common(U) ecb(U) xcbc(U) cbc(U) sha256_generic(U) sha512_generic(U) des_generic(U) cryptd(U) aes_x86_64(U) aes_generic(U) tunnel4(U) xfrm_ipcomp(U) tunnel6(U) nfsd(U) nfs_acl(U) auth_rpcgss(U) exportfs(U) autofs4(U) lockd(U) sunrpc(U) cpufreq_ondemand(U) acpi_cpufreq(U) freq_table(U) bridge(U) stp(U) llc(U) xt_physdev(U) be2iscsi(U) bnx2i(U) cnic(U) uio(U) cxgb3i(U) cxgb3(U) mdio(U) ib_iser(U) rdma_cm(U) ib_cm(U) iw_cm(U) ib_sa(U) ib_mad(U) ib_core(U) ib_addr(U) ipv6(U) iscsi_tcp(U) libiscsi_tcp(U) libiscsi(U) scsi_transport_iscsi(U) ext3(U) jbd(U) dm_mirror(U) dm_region_hash(U) dm_log(U) kvm_intel(U) kvm(U) uinput(U) snd_hda_codec_realtek(U) snd_hda_intel(U) snd_hda_codec(U) snd_usb_audio(U) snd_seq(U) snd_pcm(U) snd_usb_lib(U) snd_rawmidi(U) snd_timer(U) snd_seq_device(U) snd_hwdep(U) serio_raw(U) snd(U) sg(U) tg3(U) i7core_edac(U) edac_core(U) soundcore(U) wmi(U) tpm_infineon(U) snd_page_alloc(U) iTCO_wdt(U) iTCO_vendor_support(U) ext4(U) mbcache(U) jbd2(U) raid456(U) async_raid6_recov(U) async_pq(U) raid6_pq(U) async_xor(U) xor(U) async_memcpy(U) async_tx(U) sd_mod(U) crc_t10dif(U) firewire_ohci(U) usb_storage(U) firewire_core(U) crc_itu_t(U) ahci(U) radeon(U) ttm(U) drm_kms_helper(U) drm(U) i2c_algo_bit(U) i2c_core(U) dm_mod(U) [last unloaded: stap_5a471983680cefbac658241d073264fb_77899] Pid: 11329, comm: run-mozilla.sh Tainted: G W 2.6.32-33.el6.x86_64 #1 HP Z400 Workstation RIP: 0010:[] [] utrace_report_syscall_exit+0x96/0xf0 RSP: 0000:ffff88014fee7e00 EFLAGS: 00010282 RAX: ffffffffa0b10cd0 RBX: ffff880133d9fdb8 RCX: ffff8801161700c0 RDX: ffff88014fee7f58 RSI: ffff880133d9fdb8 RDI: 0000000000000005 RBP: ffff88014fee7e50 R08: 0000000000000080 R09: ffff8801161700c0 R10: ffff880193052950 R11: dead000000200200 R12: ffff88010a0eeca0 R13: ffff8801161700c0 R14: ffff88014fee7e10 R15: ffff88010a0eeca8 FS: 00007f5759dd2700(0000) GS:ffff880028280000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b CR2: ffffffffa0b10d00 CR3: 000000014fee8000 CR4: 00000000000026e0 DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 DR3: 0000000000000000 DR6: 00000000ffff4ff0 DR7: 0000000000000400 Process run-mozilla.sh (pid: 11329, threadinfo ffff88014fee6000, task ffff8801161700c0) Stack: 0000000000000000 ffff88014fee7f58 0000000500000000 0000000100000005 <0> ffffffff8106e1b3 ffff88014fee7f58 ffff88014fee7f58 0000000000000001 <0> 0000000000000000 0000000000000000 ffff88014fee7f10 ffffffff8101eb2b Call Trace: [] ? wait_consider_task+0x7e3/0xb20 [] tracehook_report_syscall_exit+0xcb/0x120 [] ? do_wait+0x1f7/0x250 [] ? audit_syscall_exit+0x239/0x270 [] syscall_trace_leave+0x6f/0xf0 [] ? child_wait_callback+0x0/0x70 [] int_check_syscall_exit_work+0x34/0x3d Code: 00 00 00 00 00 41 b8 80 00 00 00 4c 89 e9 48 89 da 4c 89 f6 4c 89 e7 e8 29 e7 ff ff 48 85 c0 74 21 48 8b 55 b8 48 89 de 8b 7d c4 50 30 48 89 d9 41 89 c0 4c 89 f2 4c 89 e6 4c 89 ef e8 c3 e5 RIP [] utrace_report_syscall_exit+0x96/0xf0 RSP CR2: ffffffffa0b10d00 ---[ end trace 407d787c552fbee3 ]--- Kernel panic - not syncing: Fatal exception Pid: 11329, comm: run-mozilla.sh Tainted: G D W 2.6.32-33.el6.x86_64 #1 Call Trace: [] panic+0x78/0x137 [] oops_end+0xe4/0x100 [] no_context+0xfb/0x260 [] __bad_area_nosemaphore+0x125/0x1e0 [] bad_area_nosemaphore+0x13/0x20 [] do_page_fault+0x2a8/0x3a0 [] page_fault+0x25/0x30 [] ? utrace_report_syscall_exit+0x96/0xf0 [] ? wait_consider_task+0x7e3/0xb20 [] tracehook_report_syscall_exit+0xcb/0x120 [] ? do_wait+0x1f7/0x250 [] ? audit_syscall_exit+0x239/0x270 [] syscall_trace_leave+0x6f/0xf0 [] ? child_wait_callback+0x0/0x70 [] int_check_syscall_exit_work+0x34/0x3d -- Summary: utrace_report_syscall_exit crash Product: systemtap Version: unspecified Status: NEW Severity: normal Priority: P2 Component: uprobes AssignedTo: systemtap at sources dot redhat dot com ReportedBy: mjw at redhat dot com http://sourceware.org/bugzilla/show_bug.cgi?id=11672 ------- You are receiving this mail because: ------- You are the assignee for the bug, or are watching the assignee.