From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: (qmail 41105 invoked by alias); 29 Oct 2019 15:36:45 -0000 Mailing-List: contact systemtap-help@sourceware.org; run by ezmlm Precedence: bulk List-Id: List-Subscribe: List-Post: List-Help: , Sender: systemtap-owner@sourceware.org Received: (qmail 41068 invoked by uid 48); 29 Oct 2019 15:36:40 -0000 From: "wcohen at redhat dot com" To: systemtap@sourceware.org Subject: [Bug translator/25145] New: stap -L 'process("").statement("*@*:*")' very slow on aarch64 and power64le machines Date: Tue, 29 Oct 2019 15:36:00 -0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: new X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: systemtap X-Bugzilla-Component: translator X-Bugzilla-Version: unspecified X-Bugzilla-Keywords: X-Bugzilla-Severity: normal X-Bugzilla-Who: wcohen at redhat dot com X-Bugzilla-Status: NEW X-Bugzilla-Resolution: X-Bugzilla-Priority: P2 X-Bugzilla-Assigned-To: systemtap at sourceware dot org X-Bugzilla-Target-Milestone: --- X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_id short_desc product version bug_status bug_severity priority component assigned_to reporter target_milestone Message-ID: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: http://sourceware.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-SW-Source: 2019-q4/txt/msg00017.txt.bz2 https://sourceware.org/bugzilla/show_bug.cgi?id=3D25145 Bug ID: 25145 Summary: stap -L 'process("").statement("*@*:*")' very slow on aarch64 and power64le machines Product: systemtap Version: unspecified Status: NEW Severity: normal Priority: P2 Component: translator Assignee: systemtap at sourceware dot org Reporter: wcohen at redhat dot com Target Milestone: --- When doing some experiments to see what variables were visible at various statement lines in a program I found that the following command was MUCH sl= ower on aarch64 and ppc64le than x86_64. On fc30 x86_64 the following command t= ook less than 2 minutes to run: $ time stap -L 'process("./usr/bin/ld").statement("*@*:*")'|wc 71548 1016514 27678760 real 1m20.291s user 1m11.253s sys 0m8.840s On fc30 ppc64le with binaries generated with same options takes almost 20 minutes: # time stap -L 'process("./usr/bin/ld").statement("*@*:*")'|wc 77651 1170757 30577233 real 19m13.698s user 19m9.413s sys 0m4.103s Did a "perf record -a" and "perf report" for a portion of the run to see wh= ere time was being spent: # To display the perf.data header info, please use --header/--header-only options. # # # Total Lost Samples: 0 # # Samples: 39K of event 'cycles' # Event count (approx.): 28867284968 # # Children Self Command Shared Object Symbol=20= =20=20=20=20=20=20=20=20 # ........ ........ ............... ........................=20 ...........................................................................= ...........................................................................= ...........................................................................= ...........................................................................= ...........................................................................= ...........................................................................= ...........................................................................= ...........................................................................= ...........................................................................= ...........................................................................= ...........................................................................= ................ # 98.71% 0.00% stap stap [.] query_module | ---query_module dwarf_query::handle_query_module dwarf_query::query_module_dwarf dwflpp::iterate_over_cus query_cu dwflpp::iterate_over_srcfile_lines |=20=20=20=20=20=20=20=20=20=20 |--96.60%--query_srcfile_line | |=20=20=20=20=20=20=20=20=20=20 | |--67.84%--query_statement | | |=20=20=20=20=20=20=20=20=20=20 | | --67.84%--dwarf_query::add_probe_point | | |=20=20=20=20=20=20=20=20= =20=20 | |=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20= =20=20=20=20 |--65.52%--dwarf_query::add_probe_point | | | |=20=20=20=20=20= =20=20=20=20=20 | | |=20=20=20=20=20=20=20=20= =20=20 --63.80%--dwfl_module_getsym_info | | | |=20= =20=20=20=20=20=20=20=20 | | |=20=20=20=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20 |--11.73%--0x7fff91a029ab | | | |=20= =20=20=20=20=20=20=20 |=20=20=20=20=20=20=20=20=20=20 | | | |=20= =20=20=20=20=20=20=20 |--10.02%--gelf_getsymshndx | | | |=20= =20=20=20=20=20=20=20 |=20=20=20=20=20=20=20=20=20=20 | | | |=20= =20=20=20=20=20=20=20 |--0.86%--0x7fff919c9d00 | | | |=20= =20=20=20=20=20=20=20 |=20=20=20=20=20=20=20=20=20=20 | | | |=20= =20=20=20=20=20=20=20 --0.84%--0x7fff919c9d0c | | | |=20= =20=20=20=20=20=20=20=20 | | |=20=20=20=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20 |--11.67%--0x7fff91a02a0b | | | |=20= =20=20=20=20=20=20=20 |=20=20=20=20=20=20=20=20=20=20 | | | |=20= =20=20=20=20=20=20=20 |--8.89%--gelf_getshdr | | | |=20= =20=20=20=20=20=20=20 |=20=20=20=20=20=20=20=20=20=20 | | | |=20= =20=20=20=20=20=20=20 |--2.02%--0x7fff919c9ac0 | | | |=20= =20=20=20=20=20=20=20 |=20=20=20=20=20=20=20=20=20=20 | | | |=20= =20=20=20=20=20=20=20 --0.75%--0x7fff919c9acc | | | |=20= =20=20=20=20=20=20=20=20 | | |=20=20=20=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20 |--5.80%--0x7fff91a029ff | | | |=20= =20=20=20=20=20=20=20 |=20=20=20=20=20=20=20=20=20=20 | | | |=20= =20=20=20=20=20=20=20 --5.79%--elf_getscn | | | |=20= =20=20=20=20=20=20=20=20 | | |=20=20=20=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20 |--4.33%--0x7fff91a02f4b | | | |=20= =20=20=20=20=20=20=20 |=20=20=20=20=20=20=20=20=20=20 | | | |=20= =20=20=20=20=20=20=20 |--3.17%--0x7fff91a175a3 | | | |=20= =20=20=20=20=20=20=20 | |=20=20=20=20=20=20=20=20=20=20 | | | |=20= =20=20=20=20=20=20=20 | |--1.08%--0x7fff8fe93ae0 | | | |=20= =20=20=20=20=20=20=20 | |=20=20=20=20=20=20=20=20=20=20 | | | |=20= =20=20=20=20=20=20=20 | --0.76%--0x7fff8fe93ae8 | | | |=20= =20=20=20=20=20=20=20 |=20=20=20=20=20=20=20=20=20=20 | | | |=20= =20=20=20=20=20=20=20 --0.59%--0x7fff91a175b0 | | | |=20= =20=20=20=20=20=20=20=20 | | |=20=20=20=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20 |--2.41%--0x7fff91a02f78 | | | |=20= =20=20=20=20=20=20=20=20 | | |=20=20=20=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20 |--2.24%--0x7fff91a02b18 | | | |=20= =20=20=20=20=20=20=20=20 | | |=20=20=20=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20 |--1.58%--0x7fff91a029d4 | | | |=20= =20=20=20=20=20=20=20=20 | | |=20=20=20=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20 |--1.37%--0x7fff91a02b14 | | | |=20= =20=20=20=20=20=20=20=20 | | |=20=20=20=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20 |--1.32%--0x7fff91a029b8 | | | |=20= =20=20=20=20=20=20=20=20 | | |=20=20=20=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20 |--1.28%--0x7fff91a029f4 | | | |=20= =20=20=20=20=20=20=20=20 | | |=20=20=20=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20 |--1.13%--0x7fff91a02f3c | | | |=20= =20=20=20=20=20=20=20=20 | | |=20=20=20=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20 |--1.01%--0x7fff91a02a80 | | | |=20= =20=20=20=20=20=20=20=20 | | |=20=20=20=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20 |--0.77%--0x7fff91a02f54 | | | |=20= =20=20=20=20=20=20=20=20 | | |=20=20=20=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20 |--0.76%--0x7fff91a028fc | | | |=20= =20=20=20=20=20=20=20=20 | | |=20=20=20=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20 --0.59%--0x7fff91a02f4c | | |=20=20=20=20=20=20=20=20= =20=20 | |=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20= =20=20=20=20 |--1.12%--00000021.plt_call.dwfl_module_getsym_info@@ELFUTILS_0.158 | | |=20=20=20=20=20=20=20=20= =20=20 | |=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20= =20=20=20=20=20 --1.11%--uprobe_derived_probe::uprobe_derived_probe | |=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20=20=20 dwarf_derived_probe::dwarf_derived_probe | | |=20=20=20=20=20= =20=20=20=20=20 | |=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20 --0.90%--dwarf_derived_probe::saveargs | |=20=20=20=20=20=20=20=20=20=20 | |--25.22%--dwflpp::die_has_pc | | |=20=20=20=20=20=20=20=20=20=20 | | --24.94%--dwflpp::die_has_pc | | |=20=20=20=20=20=20=20=20= =20=20 | | --24.94%--dwarf_haspc | | |=20=20=20=20=20= =20=20=20=20=20 | |=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20 --23.93%--dwarf_ranges | | |=20= =20=20=20=20=20=20=20=20 | |=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20= =20 |--13.41%--dwarf_highpc | | |=20= =20=20=20=20=20=20=20 |=20=20=20=20=20=20=20=20=20=20 | | |=20= =20=20=20=20=20=20=20 |--7.17%--dwarf_attr | | |=20= =20=20=20=20=20=20=20 | |=20=20=20=20=20=20=20=20=20=20 | | |=20= =20=20=20=20=20=20=20 | |--2.90%--0x7fff919cf717 | | |=20= =20=20=20=20=20=20=20 | | |=20=20=20=20=20=20=20=20=20=20 | | |=20= =20=20=20=20=20=20=20 | | |--0.86%--0x7fff919e2248 | | |=20= =20=20=20=20=20=20=20 | | |=20=20=20=20=20=20=20=20=20=20 | | |=20= =20=20=20=20=20=20=20 | | --0.61%--0x7fff919e23a8 | | |=20= =20=20=20=20=20=20=20 | |=20=20=20=20=20=20=20=20=20=20 | | |=20= =20=20=20=20=20=20=20 | |--0.78%--0x7fff919cf734 | | |=20= =20=20=20=20=20=20=20 | |=20=20=20=20=20=20=20=20=20=20 | | |=20= =20=20=20=20=20=20=20 | --0.55%--0x7fff919cf4a4 | | |=20= =20=20=20=20=20=20=20 |=20=20=20=20=20=20=20=20=20=20 | | |=20= =20=20=20=20=20=20=20 |--3.55%--dwarf_lowpc | | |=20= =20=20=20=20=20=20=20 | |=20=20=20=20=20=20=20=20=20=20 | | |=20= =20=20=20=20=20=20=20 | |--2.19%--dwarf_attr | | |=20= =20=20=20=20=20=20=20 | | |=20=20=20=20=20=20=20=20=20=20 | | |=20= =20=20=20=20=20=20=20 | | --0.99%--0x7fff919cf717 | | |=20= =20=20=20=20=20=20=20 | |=20=20=20=20=20=20=20=20=20=20 | | |=20= =20=20=20=20=20=20=20 | --0.94%--dwarf_formaddr | | |=20= =20=20=20=20=20=20=20 |=20=20=20=20=20=20=20=20=20=20 | | |=20= =20=20=20=20=20=20=20 |--0.84%--dwarf_formaddr | | |=20= =20=20=20=20=20=20=20 |=20=20=20=20=20=20=20=20=20=20 | | |=20= =20=20=20=20=20=20=20 --0.59%--dwarf_formudata | | |=20= =20=20=20=20=20=20=20=20 | |=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20= =20 |--3.44%--dwarf_lowpc | | |=20= =20=20=20=20=20=20=20 |=20=20=20=20=20=20=20=20=20=20 | | |=20= =20=20=20=20=20=20=20 |--2.33%--dwarf_attr | | |=20= =20=20=20=20=20=20=20 | |=20=20=20=20=20=20=20=20=20=20 | | |=20= =20=20=20=20=20=20=20 | --1.00%--0x7fff919cf717 | | |=20= =20=20=20=20=20=20=20 |=20=20=20=20=20=20=20=20=20=20 | | |=20= =20=20=20=20=20=20=20 --0.81%--dwarf_formaddr | | |=20= =20=20=20=20=20=20=20=20 | |=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20= =20=20 --2.14%--dwarf_attr | |=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20 |=20=20=20=20=20=20=20=20=20=20 | |=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20 --0.78%--0x7fff919cf717 | |=20=20=20=20=20=20=20=20=20=20 | --3.23%--dwarf_query::filtered_all | |=20=20=20=20=20=20=20=20=20=20 | |--1.96%--std::vector >::_M_realloc_insert | | |=20=20=20=20=20=20=20=20= =20=20 | |=20=20=20=20=20=20=20=20=20=20 --1.46%--std::vector >::_M_realloc_insert | | |=20=20=20=20=20= =20=20=20=20=20 | |=20=20=20=20=20=20=20=20=20=20=20=20= =20=20=20=20=20=20=20=20=20 --1.45%--__memcpy_power7 | |=20=20=20=20=20=20=20=20=20=20 | --1.19%--dwarf_query::filtered_all | |=20=20=20=20=20=20=20=20= =20=20 | --0.97%--__memcpy_power7 |=20=20=20=20=20=20=20=20=20=20 --1.59%--dwflpp::collect_all_lines |=20=20=20=20=20=20=20=20=20=20 |--1.03%--dwflpp::get_cu_lines_sorted_by_lineno | |=20=20=20=20=20=20=20=20=20=20 | --0.52%--?? (inlined) |=20=20=20=20=20=20=20=20=20=20 --0.56%--add_matching_lines_in_func (inlined) --=20 You are receiving this mail because: You are the assignee for the bug.