public inbox for gdb-prs@sourceware.org
help / color / mirror / Atom feed
From: "tromey at sourceware dot org" <sourceware-bugzilla@sourceware.org>
To: gdb-prs@sourceware.org
Subject: [Bug symtab/29391] [gdb/symtab] Parallelize process_queue
Date: Fri, 22 Jul 2022 20:46:20 +0000	[thread overview]
Message-ID: <bug-29391-4717-wiOBhDITCc@http.sourceware.org/bugzilla/> (raw)
In-Reply-To: <bug-29391-4717@http.sourceware.org/bugzilla/>

https://sourceware.org/bugzilla/show_bug.cgi?id=29391

--- Comment #1 from Tom Tromey <tromey at sourceware dot org> ---
It's an interesting idea but as you found there are some issues.

The main issue behind a lot of the allocation problems is that
gdb has a few per-objfile data structures that can't easily be
used from multiple threads: the obstack but also the bcache
and the demangled hash table.

Maybe these problems could all be solved by sharding, or maybe
by heap allocation.  Also I think a couple patches in the series
introduce locks where something like compare-and-swap would work
just as well.

However, I tend to think there's a better approach overall.

The way I see it, there are two main issues with CU expansion.

One is that sometimes gdb decides to expand too many CUs in
response to a request.  This is maybe covered by one of the 
dependencies of bug #29366.  I am not sure yet (haven't looked
in detail) but I suspect the fix will be something like
short-circuiting expansion for certain kinds of queries.
Like, if gdb is looking for a type, just expand the first CU
that matches.

The second problem is that CU expansion can be slow.  Here I think
gdb could do a lot better, the basic idea being lazy CU expansion.
In response to a CU expansion request, the DWARF reader would
create the symtab / compunit_symtab structures and it would also
create some "outline" struct symbols -- one for each cooked_index_entry.
Then when some attribute of a symbol is needed (say, the type),
the DWARF reader would read the rest of the symbol that that moment.

The major advantage of this approach is that most data in a CU
is not needed at all.  So, much less work would need to be done in
general.  I think it would be possible to avoid reading every DIE.

A secondary advantage is that, because the symbols are created directly
from the cooked index, we would avoid the situation where the
two readers could diverge.  That would no longer be possible at all.

There are some downsides.  It's more complex, and it is complicated to
implement and test.  Also I think it would require fixing the .debug_names
bug, and also probably removing .gdb_index support.  Finally, we'd have
to change the blockvector to be expandable.

-- 
You are receiving this mail because:
You are on the CC list for the bug.

  parent reply	other threads:[~2022-07-22 20:46 UTC|newest]

Thread overview: 5+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2022-07-21 13:11 [Bug symtab/29391] New: " vries at gcc dot gnu.org
2022-07-21 13:12 ` [Bug symtab/29391] " vries at gcc dot gnu.org
2022-07-22 20:46 ` tromey at sourceware dot org [this message]
2022-07-24  8:26 ` vries at gcc dot gnu.org
2022-12-25 20:04 ` tromey at sourceware dot org

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=bug-29391-4717-wiOBhDITCc@http.sourceware.org/bugzilla/ \
    --to=sourceware-bugzilla@sourceware.org \
    --cc=gdb-prs@sourceware.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for read-only IMAP folder(s) and NNTP newsgroup(s).