public inbox for systemtap@sourceware.org
 help / color / mirror / Atom feed
From: Hemant Kumar <hemant@linux.vnet.ibm.com>
To: linux-kernel@vger.kernel.org
Cc: srikar@linux.vnet.ibm.com, peterz@infradead.org, oleg@redhat.com,
	       hegdevasant@linux.vnet.ibm.com, mingo@redhat.com,
	anton@redhat.com,        systemtap@sourceware.org,
	namhyung@kernel.org,        masami.hiramatsu.pt@hitachi.com,
	aravinda@linux.vnet.ibm.com,        penberg@iki.fi
Subject: [PATCH v2 0/3] perf/sdt : Support for SDT markers
Date: Fri, 18 Jul 2014 10:18:00 -0000	[thread overview]
Message-ID: <20140717054826.19995.61782.stgit@hemant-fedora> (raw)

This patchset helps in listing dtrace style markers(SDT) present in user space
applications through perf.
Notes/markers are placed at important places by the
developers. They have a negligible overhead when not enabled.
We can enable them and probe at these places and find some important information
like the arguments' values, etc.

We have lots of applications which use SDT markers today, like:
Postgresql, MySql, Mozilla, Perl, Python, Java, Ruby, libvirt, QEMU, glib

To add SDT markers into user applications:
We need to have this header sys/sdt.h present.
sys/sdt.h used is version 3.
If not present, install systemtap-sdt-devel package (for fedora-18).

Please refer to the Documentation patch to see how the SDT markers are added into
a program.

With this patchset,
- Use perf to list the markers in the app:
# perf list sdt ./user_app

./user_app :
%user_app:foo_start
%user_app:fun_start

- Also, we can see the SDT markers present in our system in the usual binaries.
These usual binaries are libraries (dsos) listed by ldconfig --print-cache and some
binaries present in PATH environment variable.

First, scan the binaries using :
# perf list sdt --scan

Creating a cache of SDT markers...
perf sdt cache created!
 Use : "perf list sdt"
 to see the SDT markers

After the sdt cache file is created, use perf list to view the markers :
# perf list sdt

%rtld : init_start
%rtld : init_complete
%rtld : map_failed
%rtld : map_start
%rtld : lll_futex_wake
...
...
%libgcc : unwind
%libvirt : rpc_server_client_auth_allow
%libvirt : rpc_server_client_auth_fail
%libvirt : rpc_server_client_auth_deny

Also, by using "perf list", we can view all the SDT markers as events along with all
the other events present in the system.
Alternatively, one can view the /var/cache/perf/perf-sdt.cache directly.

This link shows an example of marker probing with Systemtap:
https://sourceware.org/systemtap/wiki/AddingUserSpaceProbingToApps

Also, this link provides important info regarding SDT notes:
http://sourceware.org/systemtap/wiki/UserSpaceProbeImplementation

- Markers in binaries :
These SDT markers are present in the ELF in the section named
".note.stapsdt".
Here, the name of the marker, its provider, type, location, base
address, semaphore address.
We can retrieve these values using the members name_off and desc_off in
Nhdr structure. If these are not enabled, they are present in the ELF as nop.

Changes since last series :
- Made the changes as discussed with Masami and Namhyung.
- Now, "perf list" will also display the SDT markers as events along with other events.
- Made some optimazations.

TODO:
- Add support to probe these SDT markers as if they are events.
- Recognizing arguments and support to probe on them.
---

Hemant Kumar (3):
      This patch enables perf to list the SDT markers present in a system. It looks
      This patch enables perf to look for SDT markers in a single file.
      This patch adds the required documentation for perf support to SDT markers.


 tools/perf/Documentation/SDT-markers.txt |  123 +++++
 tools/perf/Documentation/perf-list.txt   |    7 
 tools/perf/Makefile.perf                 |    1 
 tools/perf/builtin-list.c                |    6 
 tools/perf/util/parse-events.h           |    3 
 tools/perf/util/sdt.c                    |  778 ++++++++++++++++++++++++++++++
 tools/perf/util/symbol-elf.c             |  229 +++++++++
 tools/perf/util/symbol.h                 |   19 +
 8 files changed, 1164 insertions(+), 2 deletions(-)
 create mode 100644 tools/perf/Documentation/SDT-markers.txt
 create mode 100644 tools/perf/util/sdt.c

-- 

             reply	other threads:[~2014-07-18 10:18 UTC|newest]

Thread overview: 17+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2014-07-18 10:18 Hemant Kumar [this message]
2014-07-18 10:19 ` [PATCH v2 1/3] perf/sdt : Listing of SDT markers by perf Hemant Kumar
2014-07-18 17:50   ` Andi Kleen
2014-07-20  3:17     ` Masami Hiramatsu
2014-07-21  2:39     ` Namhyung Kim
2014-07-21  9:40       ` Hemant Kumar
2014-07-22 11:54     ` Hemant Kumar
2014-07-21  3:02   ` Namhyung Kim
2014-07-22 11:33     ` Hemant Kumar
2014-07-18 10:20 ` [PATCH v2 2/3] perf/sdt: Listing SDT markers for a single file Hemant Kumar
2014-07-18 10:20 ` [PATCH v2 3/3] perf/sdt: Documentation Hemant Kumar
2014-07-18 11:23 ` [PATCH v2 0/3] perf/sdt : Support for SDT markers Masami Hiramatsu
2014-07-19 17:33   ` Hemant Kumar
2014-07-20  3:17     ` Masami Hiramatsu
2014-07-21  2:30       ` Namhyung Kim
2014-07-21 12:24       ` Hemant Kumar
2014-07-22  5:30         ` Masami Hiramatsu

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20140717054826.19995.61782.stgit@hemant-fedora \
    --to=hemant@linux.vnet.ibm.com \
    --cc=anton@redhat.com \
    --cc=aravinda@linux.vnet.ibm.com \
    --cc=hegdevasant@linux.vnet.ibm.com \
    --cc=linux-kernel@vger.kernel.org \
    --cc=masami.hiramatsu.pt@hitachi.com \
    --cc=mingo@redhat.com \
    --cc=namhyung@kernel.org \
    --cc=oleg@redhat.com \
    --cc=penberg@iki.fi \
    --cc=peterz@infradead.org \
    --cc=srikar@linux.vnet.ibm.com \
    --cc=systemtap@sourceware.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for read-only IMAP folder(s) and NNTP newsgroup(s).