public inbox for libabigail@sourceware.org
 help / color / mirror / Atom feed
From: Dodji Seketeli <dodji@seketeli.org>
To: Matthias Maennich <maennich@google.com>
Cc: libabigail@sourceware.org,  gprocida@google.com,
	 kernel-team@android.com
Subject: Re: [PATCH 17/20] symtab/dwarf-reader: allow hinting of main symbols for aliases
Date: Wed, 17 Mar 2021 14:40:40 +0100	[thread overview]
Message-ID: <871rcdyk2v.fsf@seketeli.org> (raw)
In-Reply-To: <20210127125853.886677-18-maennich@google.com> (Matthias Maennich's message of "Wed, 27 Jan 2021 12:58:50 +0000")

Matthias Maennich <maennich@google.com> a écrit:

> In case of aliased symbols, the "main symbol" cannot be deduced from
> the symtab as this solely contains a name->addr mapping and aliases
> are represented by multiple names resolving to the same address.
> Therefore the main symbol can only be picked rather randomly and
> unpredictable.
>
> Unlike DWARF, which contains a single symbol entry for only the main
> symbol. Hence we can (late) detect the main symbol. Exploiting that
> property allows to correct the addr->symbol lookup in the symtab to
> return the correct main symbol and it also allows to correct the aliased
> symbols to maintain the correct main symbol.
>
> This patch adds the `update_main_symbol` functionality to `elf_symbol`
> to update the main symbol by name (ELF symbols need unique names) and
> adds `update_main_symbol` to `symtab` that makes use of said new method.
>
> When we discover a main symbol during DWARF reading, we instruct the
> symtab to update the mapping.
>
> This creates consistent representations across different builds of the
> same binary with the same ABI by pinning down the main symbol to the
> defined one. Knowing the main symbol also helps to keep the correct
> dwarf information in the representation in the presence of symbol
> suppressions. A later patch will address that.
>
> Some test cases in tests/data need adjustment and they have all been
> verified to be valid changes.
>
> - main symbol changed for various elf symbols
>   - test-annotate/test15-pr18892.so.abi
>   - test-annotate/test19-pr19023-libtcmalloc_and_profiler.so.abi
>   - test-annotate/test3.so.abi
>   - test-read-dwarf/test15-pr18892.so.abi
>   - test-read-dwarf/test19-pr19023-libtcmalloc_and_profiler.so.abi
>   - test-read-dwarf/test3.so.abi
>   - test-read-dwarf/test3.so.hash.abi
>
> - due to main symbol changes, the symbol diff needs to be corrected
>   - test-diff-dwarf/test12-report.txt
>   - test-diff-pkg/tbb-4.1-9.20130314.fc22.x86_64--tbb-4.3-3.20141204.fc23.x86_64-report-0.txt
>   - test-diff-pkg/tbb-4.1-9.20130314.fc22.x86_64--tbb-4.3-3.20141204.fc23.x86_64-report-1.txt
>
> - the test scenario needed adjustments as the main symbol changed
>   - test-diff-suppr/test23-alias-filter-4.suppr
>   - test-diff-suppr/test23-alias-filter-report-0.txt
>   - test-diff-suppr/test23-alias-filter-report-2.txt
>
> As usual, the complete changelog follows.

The patch itself looks good to me.

However, the part that update the tests won't apply anymore given the
cheer amount of changes that happen since the submission of this
patchset.

So I think you'll need to refresh them before being able to apply this
one.

>
> 	* include/abg-ir.h (elf_symbol::update_main_symbol): New method.
> 	* include/abg-symtab-reader.h (symtab::update_main_symbol): New method.
> 	* src/abg-dwarf-reader.cc
> 	(build_var_decl): Hint symtab about main symbol discovered in DWARF.
> 	(build_function_decl): Likewise.
> 	* src/abg-ir.cc (elf_symbol::get_main_symbol): Lock the weak_ptr
> 	  on access in both overloads.
> 	(update_main_symbol): New method to allow updating the main symbol.
> 	* src/abg-symtab-reader.cc (symtab::update_main_symbol): New method.
> 	* data/Makefile.am: Add new test data files.
> 	* tests/data/test-annotate/test15-pr18892.so.abi: Updated test file.
> 	* tests/data/test-annotate/test19-pr19023-libtcmalloc_and_profiler.so.abi: Likewise.
> 	* tests/data/test-annotate/test2.so.abi: Likewise.
> 	* tests/data/test-annotate/test3.so.abi: Likewise.
> 	* tests/data/test-diff-dwarf/test12-report.txt: Likewise.
> 	* tests/data/test-diff-dwarf/test42-PR21296-clanggcc-report0.txt: Likewise.
> 	* tests/data/test-diff-filter/test31-pr18535-libstdc++-report-0.txt: Likewise.
> 	* tests/data/test-diff-filter/test31-pr18535-libstdc++-report-0.txt: Likewise.
> 	* tests/data/test-diff-pkg/tbb-4.1-9.20130314.fc22.x86_64--tbb-4.3-3.20141204.fc23.x86_64-report-0.txt: Likewise.
> 	* tests/data/test-diff-pkg/tbb-4.1-9.20130314.fc22.x86_64--tbb-4.3-3.20141204.fc23.x86_64-report-1.txt: Likewise.
> 	* tests/data/test-diff-suppr/test23-alias-filter-4.suppr: Likewise.
> 	* tests/data/test-diff-suppr/test23-alias-filter-report-0.txt: Likewise.
> 	* tests/data/test-diff-suppr/test23-alias-filter-report-2.txt: Likewise.
> 	* tests/data/test-read-dwarf/PR22015-libboost_iostreams.so.abi: Likewise.
> 	* tests/data/test-read-dwarf/PR22122-libftdc.so.abi: Likewise.
> 	* tests/data/test-read-dwarf/test10-pr18818-gcc.so.abi: Likewise.
> 	* tests/data/test-read-dwarf/test11-pr18828.so.abi: Likewise.
> 	* tests/data/test-read-dwarf/test12-pr18844.so.abi: Likewise.
> 	* tests/data/test-read-dwarf/test15-pr18892.so.abi: Likewise.
> 	* tests/data/test-read-dwarf/test16-pr18904.so.abi: Likewise.
> 	* tests/data/test-read-dwarf/test19-pr19023-libtcmalloc_and_profiler.so.abi: Likewise.
> 	* tests/data/test-read-dwarf/test2.so.abi: Likewise.
> 	* tests/data/test-read-dwarf/test2.so.hash.abi: Likewise.
> 	* tests/data/test-read-dwarf/test22-pr19097-libstdc++.so.6.0.17.so.abi: Likewise.
> 	* tests/data/test-read-dwarf/test3.so.abi: Likewise.
> 	* tests/data/test-read-dwarf/test3.so.hash.abi: Likewise.
> 	* tests/data/test-symtab/basic/aliases.c: New test source file.
> 	* tests/data/test-symtab/basic/aliases.so: Likewise.
> 	* tests/test-symtab.cc (Symtab::AliasedFunctionSymbols): New test case.
> 	(Symtab::AliasedVariableSymbols): Likewise.
>
> Reviewed-by: Giuliano Procida <gprocida@google.com>
> Signed-off-by: Matthias Maennich <maennich@google.com>

OK to apply to master after refreshing the test updates.

Thanks!

[...]

Cheers,

-- 
		Dodji

  reply	other threads:[~2021-03-17 13:40 UTC|newest]

Thread overview: 91+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2020-06-19 21:42 [PATCH v1 00/16] Refactor (k)symtab reader Matthias Maennich
2020-06-19 21:42 ` [PATCH v1 01/16] abg-cxx-compat: add simplified version of std::optional Matthias Maennich
2020-06-19 21:42 ` [PATCH v1 02/16] abg-cxx-compat: more <functional> support: std::bind and friends Matthias Maennich
2020-06-19 21:42 ` [PATCH v1 03/16] abg-ir: elf_symbol: add is_in_ksymtab field Matthias Maennich
2020-06-19 21:42 ` [PATCH v1 04/16] abg-ir: elf_symbol: add is_suppressed field Matthias Maennich
2020-06-22  9:46   ` Giuliano Procida
2020-06-19 21:42 ` [PATCH v1 05/16] dwarf-reader split: create abg-symtab-reader.{h, cc} and test case Matthias Maennich
2020-06-19 21:42 ` [PATCH v1 06/16] Refactor ELF symbol table reading by adding a new symtab reader Matthias Maennich
2020-06-19 21:42 ` [PATCH v1 07/16] Integrate new symtab reader into corpus and read_context Matthias Maennich
2020-06-19 21:42 ` [PATCH v1 08/16] corpus: make get_(undefined_)?_(var|fun)_symbols use the new symtab Matthias Maennich
2020-06-22  9:53   ` Giuliano Procida
2020-06-19 21:42 ` [PATCH v1 09/16] corpus: make get_unreferenced_(function|variable)_symbols " Matthias Maennich
2020-06-19 21:42 ` [PATCH v1 10/16] abg-reader: avoid using the (var|function)_symbol_map Matthias Maennich
2020-06-19 21:43 ` [PATCH v1 11/16] dwarf-reader: read_context: use new symtab in *_symbols_is_exported Matthias Maennich
2020-06-19 21:43 ` [PATCH v1 12/16] Switch kernel stuff over to new symtab and drop unused code Matthias Maennich
2020-06-19 21:43 ` [PATCH v1 13/16] abg-elf-helpers: migrate ppc64 specific helpers Matthias Maennich
2020-06-19 21:43 ` [PATCH v1 14/16] symtab_reader: add support for ppc64 ELFv1 binaries Matthias Maennich
2020-06-19 21:43 ` [PATCH v1 15/16] abg-corpus: remove symbol maps and their setters Matthias Maennich
2020-06-19 21:43 ` [PATCH v1 16/16] dwarf reader: drop (now) unused code related symbol table reading Matthias Maennich
2020-06-22  9:56   ` Giuliano Procida
2020-07-03 16:46 ` [PATCH v2 00/21] Refactor (k)symtab reader Matthias Maennich
2020-07-03 16:46   ` [PATCH v2 01/21] abg-cxx-compat: add simplified version of std::optional Matthias Maennich
2020-07-03 16:46   ` [PATCH v2 02/21] abg-cxx-compat: more <functional> support: std::bind and friends Matthias Maennich
2020-07-03 16:46   ` [PATCH v2 03/21] abg-ir: elf_symbol: add is_in_ksymtab field Matthias Maennich
2020-07-03 16:46   ` [PATCH v2 04/21] abg-ir: elf_symbol: add is_suppressed field Matthias Maennich
2020-07-03 16:46   ` [PATCH v2 05/21] dwarf-reader split: create abg-symtab-reader.{h, cc} and test case Matthias Maennich
2020-07-03 16:46   ` [PATCH v2 06/21] Refactor ELF symbol table reading by adding a new symtab reader Matthias Maennich
2020-07-20 15:39     ` Dodji Seketeli
2020-07-03 16:46   ` [PATCH v2 07/21] Integrate new symtab reader into corpus and read_context Matthias Maennich
2020-07-03 16:46   ` [PATCH v2 08/21] corpus: make get_(undefined_)?_(var|fun)_symbols use the new symtab Matthias Maennich
2020-07-03 16:46   ` [PATCH v2 09/21] corpus: make get_unreferenced_(function|variable)_symbols " Matthias Maennich
2020-07-03 16:46   ` [PATCH v2 10/21] abg-reader: avoid using the (var|function)_symbol_map Matthias Maennich
2020-07-03 16:46   ` [PATCH v2 11/21] dwarf-reader: read_context: use new symtab in *_symbols_is_exported Matthias Maennich
2020-07-03 16:46   ` [PATCH v2 12/21] Switch kernel stuff over to new symtab and drop unused code Matthias Maennich
2020-07-03 16:46   ` [PATCH v2 13/21] abg-elf-helpers: migrate ppc64 specific helpers Matthias Maennich
2020-07-03 16:46   ` [PATCH v2 14/21] symtab_reader: add support for ppc64 ELFv1 binaries Matthias Maennich
2020-07-03 16:46   ` [PATCH v2 15/21] abg-corpus: remove symbol maps and their setters Matthias Maennich
2020-07-03 16:46   ` [PATCH v2 16/21] dwarf reader: drop now-unused code related to symbol table reading Matthias Maennich
2020-07-03 16:46   ` [PATCH v2 17/21] test-symtab: add tests for whitelisted functions Matthias Maennich
2020-07-03 16:46   ` [PATCH v2 18/21] symtab/dwarf-reader: allow hinting of main symbols for aliases Matthias Maennich
2020-07-03 16:46   ` [PATCH v2 19/21] dwarf-reader/writer: consider aliases when dealing with suppressions Matthias Maennich
2020-07-03 16:46   ` [PATCH v2 20/21] symtab: Add support for MODVERSIONS (CRC checksums) Matthias Maennich
2020-07-03 16:46   ` [PATCH v2 21/21] reader/symtab: Improve handling for suppressed aliases Matthias Maennich
2020-07-20 14:27   ` [PATCH v2 00/21] Refactor (k)symtab reader Dodji Seketeli
2021-01-27 12:58 ` [PATCH 00/20] " Matthias Maennich
2021-01-27 12:58   ` [PATCH 01/20] abg-cxx-compat: add simplified version of std::optional Matthias Maennich
2021-03-09  9:43     ` Dodji Seketeli
2021-01-27 12:58   ` [PATCH 02/20] abg-ir: elf_symbol: add is_in_ksymtab field Matthias Maennich
2021-03-09 14:05     ` Dodji Seketeli
2021-01-27 12:58   ` [PATCH 03/20] abg-ir: elf_symbol: add is_suppressed field Matthias Maennich
2021-03-09 18:03     ` Dodji Seketeli
2021-01-27 12:58   ` [PATCH 04/20] dwarf-reader split: create abg-symtab-reader.{h, cc} and test case Matthias Maennich
2021-03-10 18:00     ` [PATCH 04/20] dwarf-reader split: create abg-symtab-reader.{h,cc} " Dodji Seketeli
2021-01-27 12:58   ` [PATCH 05/20] Refactor ELF symbol table reading by adding a new symtab reader Matthias Maennich
2021-03-12 11:18     ` Dodji Seketeli
2021-01-27 12:58   ` [PATCH 06/20] Integrate new symtab reader into corpus and read_context Matthias Maennich
2021-03-12 15:04     ` Dodji Seketeli
2021-01-27 12:58   ` [PATCH 07/20] corpus: make get_(undefined_)?_(var|fun)_symbols use the new symtab Matthias Maennich
2021-03-15 10:05     ` Dodji Seketeli
2021-01-27 12:58   ` [PATCH 08/20] corpus: make get_unreferenced_(function|variable)_symbols " Matthias Maennich
2021-03-15 12:06     ` Dodji Seketeli
2021-01-27 12:58   ` [PATCH 09/20] abg-reader: avoid using the (var|function)_symbol_map Matthias Maennich
2021-03-15 14:23     ` Dodji Seketeli
2021-01-27 12:58   ` [PATCH 10/20] dwarf-reader: read_context: use new symtab in *_symbols_is_exported Matthias Maennich
2021-03-15 18:13     ` Dodji Seketeli
2021-01-27 12:58   ` [PATCH 11/20] Switch kernel stuff over to new symtab and drop unused code Matthias Maennich
2021-03-16 10:38     ` Dodji Seketeli
2021-01-27 12:58   ` [PATCH 12/20] abg-elf-helpers: migrate ppc64 specific helpers Matthias Maennich
2021-03-16 10:59     ` Dodji Seketeli
2021-01-27 12:58   ` [PATCH 13/20] symtab_reader: add support for ppc64 ELFv1 binaries Matthias Maennich
2021-03-16 11:39     ` Dodji Seketeli
2021-01-27 12:58   ` [PATCH 14/20] abg-corpus: remove symbol maps and their setters Matthias Maennich
2021-03-16 18:08     ` Dodji Seketeli
2021-01-27 12:58   ` [PATCH 15/20] dwarf reader: drop (now) unused code related to symbol table reading Matthias Maennich
2021-03-16 18:42     ` Dodji Seketeli
2021-01-27 12:58   ` [PATCH 16/20] test-symtab: add tests for whitelisted functions Matthias Maennich
2021-03-17 11:07     ` Dodji Seketeli
2021-01-27 12:58   ` [PATCH 17/20] symtab/dwarf-reader: allow hinting of main symbols for aliases Matthias Maennich
2021-03-17 13:40     ` Dodji Seketeli [this message]
2021-01-27 12:58   ` [PATCH 18/20] dwarf-reader/writer: consider aliases when dealing with suppressions Matthias Maennich
2021-03-17 15:44     ` Dodji Seketeli
2021-01-27 12:58   ` [PATCH 19/20] abg-writer.cc: fix write_elf_symbol_reference loop Matthias Maennich
2021-03-17 16:11     ` Dodji Seketeli
2021-01-27 12:58   ` [PATCH 20/20] symtab: Add support for MODVERSIONS (CRC checksums) Matthias Maennich
2021-03-17 17:13     ` Dodji Seketeli
2021-03-17 23:29       ` Giuliano Procida
2021-03-18 22:10         ` Matthias Maennich
2021-03-19 16:55           ` Dodji Seketeli
2021-03-19 18:15     ` Dodji Seketeli
2021-03-29 13:19   ` [GIT PULL] Refactor (k)symtab reader Matthias Maennich
2021-04-02 14:28     ` Dodji Seketeli

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=871rcdyk2v.fsf@seketeli.org \
    --to=dodji@seketeli.org \
    --cc=gprocida@google.com \
    --cc=kernel-team@android.com \
    --cc=libabigail@sourceware.org \
    --cc=maennich@google.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for read-only IMAP folder(s) and NNTP newsgroup(s).