From: Ulf Samuelsson <binutils@emagii.com>
To: Nick Clifton <nickc@redhat.com>, binutils@sourceware.org
Subject: Re: [PATCH v4 2/5] CRC64 testsuite
Date: Thu, 23 Feb 2023 11:53:51 +0100 [thread overview]
Message-ID: <f2030d96-2b46-d095-b5b7-d3fcf495d8a8@emagii.com> (raw)
In-Reply-To: <e361db21-95a6-c818-0ca0-84db3ca5c8d6@redhat.com>
[-- Attachment #1: Type: text/plain, Size: 2597 bytes --]
On 2023-02-23 11:10, Nick Clifton wrote:
> Hi Ulf,
>
>
>>> Did you actually try running these new tests ?
>>>
>> No, I am yet to learn how to do the tests
>> so I hoped that copying the the resulting text segment
>> would be sufficient, and if not, someone would tell me.
>>
>> Is there any documentation on how to run the tests?
>
> Just run "make check". (In the top level directory where
> you built the binutils).
>
> Or if you only want to run one specific testsuite, eg the
> linker testsuite then change into the relevant directory and
> run "make check"
>
> Or, if you only want to run a sub-set of a specific testsuite
> then use the RUNTESTFLAGS option to specify the test script
> you want to run. For example if you only want to run the
> linker script tests then:
>
> % cd <binutils-build-dir>/ld
> & make check RUNTESTFLAGS="ld-scripts/script.exp"
>
Thank You.
I figured out how to run the test (I didn't have 'dejagnu' installed before)
and I got to run the script.exp and all the CRC stuff failed (not
unexpectedly),
while the rest were OK.
==============
Had a problem with my system disk, and decided to upgrade
to from Ubuntu 18.04 to 22.04 and installed ubuntu-mate-desktop
Now everything fails :-(.
==============
Running
/home/ulf/projects/binutils/binutils-gdb-digest/ld/testsuite/ld-scripts/script.exp
...
FAIL: script
FAIL: MRI script
FAIL: MEMORY
FAIL: MEMORY with symbols
FAIL: ld-scripts/asciz
FAIL: ld-scripts/ascii
FAIL: ld-scripts/crc64-ecma
FAIL: ld-scripts/crc64-iso
FAIL: ld-scripts/crc64-poly
FAIL: ld-scripts/crc64-polyi
FAIL: ld-scripts/crc32
FAIL: ld-scripts/crc32-poly
FAIL: ld-scripts/crc32-polyi
FAIL: ld-scripts/pr20302
FAIL: ld-scripts/output-section-types
FAIL: SEGMENT_START expression not absolute (default)
FAIL: SEGMENT_START expression not absolute (overridden)
It looks like there is some basic error.
I get this: "WARNING: Couldn't find tool init file", but I do not know
if it is significant.
==============
If I get a FAIL, is there a log to look at to find out why it fails?
==============
Best Regards
Ulf
> Note - when you are creating a patch that affects generic
> binutils code, such as your CRC64 patch series, it is a good
> idea to test multiple versions of the binutils each built for
> a different target architecture. At a minimum I would suggest
> using builds configure with:
>
> --target=x86_64-pc-linux-gnu
> --target=x86_64-w64-mingw32
> --target=aarch64-linux-gnu
> --target=powerpc64-linux-gnu
> --target=mips-elf
> --enable-targets=all --enable-64-bit-bfd
>
Cheers
> Nick
>
>
[-- Attachment #2: testsuite.log --]
[-- Type: text/x-log, Size: 14662 bytes --]
make[1]: Går till katalogen ”/home/ulf/projects/binutils/build/binutils-gdb-digest/build”
make[2]: Går till katalogen ”/home/ulf/projects/binutils/build/binutils-gdb-digest/build/bfd”
make check-recursive
make[3]: Går till katalogen ”/home/ulf/projects/binutils/build/binutils-gdb-digest/build/bfd”
Making check in po
make[4]: Går till katalogen ”/home/ulf/projects/binutils/build/binutils-gdb-digest/build/bfd/po”
make[4]: Inget behöver göras för ”check”.
make[4]: Lämnar katalogen ”/home/ulf/projects/binutils/build/binutils-gdb-digest/build/bfd/po”
make[4]: Går till katalogen ”/home/ulf/projects/binutils/build/binutils-gdb-digest/build/bfd”
make[4]: Lämnar katalogen ”/home/ulf/projects/binutils/build/binutils-gdb-digest/build/bfd”
make[3]: Lämnar katalogen ”/home/ulf/projects/binutils/build/binutils-gdb-digest/build/bfd”
make[2]: Lämnar katalogen ”/home/ulf/projects/binutils/build/binutils-gdb-digest/build/bfd”
make[2]: Går till katalogen ”/home/ulf/projects/binutils/build/binutils-gdb-digest/build/opcodes”
Making check in .
make[3]: Går till katalogen ”/home/ulf/projects/binutils/build/binutils-gdb-digest/build/opcodes”
make[3]: Lämnar katalogen ”/home/ulf/projects/binutils/build/binutils-gdb-digest/build/opcodes”
Making check in po
make[3]: Går till katalogen ”/home/ulf/projects/binutils/build/binutils-gdb-digest/build/opcodes/po”
make[3]: Inget behöver göras för ”check”.
make[3]: Lämnar katalogen ”/home/ulf/projects/binutils/build/binutils-gdb-digest/build/opcodes/po”
make[2]: Lämnar katalogen ”/home/ulf/projects/binutils/build/binutils-gdb-digest/build/opcodes”
make[2]: Går till katalogen ”/home/ulf/projects/binutils/build/binutils-gdb-digest/build/binutils”
make check-recursive
make[3]: Går till katalogen ”/home/ulf/projects/binutils/build/binutils-gdb-digest/build/binutils”
Making check in po
make[4]: Går till katalogen ”/home/ulf/projects/binutils/build/binutils-gdb-digest/build/binutils/po”
make[4]: Inget behöver göras för ”check”.
make[4]: Lämnar katalogen ”/home/ulf/projects/binutils/build/binutils-gdb-digest/build/binutils/po”
make[4]: Går till katalogen ”/home/ulf/projects/binutils/build/binutils-gdb-digest/build/binutils”
make check-DEJAGNU
make[5]: Går till katalogen ”/home/ulf/projects/binutils/build/binutils-gdb-digest/build/binutils”
srcdir=`cd /home/ulf/projects/binutils/binutils-gdb-digest/binutils && pwd`; export srcdir; \
r=`pwd`; export r; \
LC_ALL=C; export LC_ALL; \
EXPECT=expect; export EXPECT; \
runtest=runtest; \
if /bin/bash -c "$runtest --version" > /dev/null 2>&1; then \
CC="gcc" CC_FOR_BUILD="gcc" \
CC_FOR_TARGET="gcc" CFLAGS_FOR_TARGET="-g -O2 " \
$runtest --tool binutils --srcdir ${srcdir}/testsuite \
ld-scripts/script.exp; \
else echo "WARNING: could not find \`runtest'" 1>&2; :;\
fi
WARNING: Couldn't find tool init file
Test run by ulf on Thu Feb 23 11:42:03 2023
Native configuration is x86_64-pc-linux-gnu
=== binutils tests ===
Schedule of variations:
unix
Running target unix
Using /usr/share/dejagnu/baseboards/unix.exp as board description file for target.
Using /usr/share/dejagnu/config/unix.exp as generic interface file for target.
Using /home/ulf/projects/binutils/binutils-gdb-digest/binutils/testsuite/config/default.exp as tool-and-target-specific interface file.
=== binutils Summary ===
make[5]: Lämnar katalogen ”/home/ulf/projects/binutils/build/binutils-gdb-digest/build/binutils”
make[4]: Lämnar katalogen ”/home/ulf/projects/binutils/build/binutils-gdb-digest/build/binutils”
make[3]: Lämnar katalogen ”/home/ulf/projects/binutils/build/binutils-gdb-digest/build/binutils”
make[2]: Lämnar katalogen ”/home/ulf/projects/binutils/build/binutils-gdb-digest/build/binutils”
make[2]: Går till katalogen ”/home/ulf/projects/binutils/build/binutils-gdb-digest/build/etc”
make[2]: Inget behöver göras för ”check”.
make[2]: Lämnar katalogen ”/home/ulf/projects/binutils/build/binutils-gdb-digest/build/etc”
make[2]: Går till katalogen ”/home/ulf/projects/binutils/build/binutils-gdb-digest/build/gas”
Making check in po
make[3]: Går till katalogen ”/home/ulf/projects/binutils/build/binutils-gdb-digest/build/gas/po”
make[3]: Inget behöver göras för ”check”.
make[3]: Lämnar katalogen ”/home/ulf/projects/binutils/build/binutils-gdb-digest/build/gas/po”
make[3]: Går till katalogen ”/home/ulf/projects/binutils/build/binutils-gdb-digest/build/gas”
make check-DEJAGNU
make[4]: Går till katalogen ”/home/ulf/projects/binutils/build/binutils-gdb-digest/build/gas”
if [ -d testsuite ]; then \
true; \
else \
mkdir testsuite; \
fi
rm -f testsuite/site.exp
cp site.exp testsuite/site.exp
rootme=`pwd`; export rootme; \
srcdir=`cd /home/ulf/projects/binutils/binutils-gdb-digest/gas; pwd` ; export srcdir ; \
LC_ALL=C; export LC_ALL; \
EXPECT=expect ; export EXPECT ; \
runtest=runtest; \
cd testsuite; \
if /bin/bash -c "$runtest --version" > /dev/null 2>&1; then \
$runtest --tool gas --srcdir ${srcdir}/testsuite \
ld-scripts/script.exp; \
else echo "WARNING: could not find \`runtest'" 1>&2; :;\
fi
WARNING: Couldn't find tool init file
Test run by ulf on Thu Feb 23 11:42:03 2023
Native configuration is x86_64-pc-linux-gnu
=== gas tests ===
Schedule of variations:
unix
Running target unix
Using /usr/share/dejagnu/baseboards/unix.exp as board description file for target.
Using /usr/share/dejagnu/config/unix.exp as generic interface file for target.
Using /home/ulf/projects/binutils/binutils-gdb-digest/gas/testsuite/config/default.exp as tool-and-target-specific interface file.
=== gas Summary ===
/home/ulf/projects/binutils/build/binutils-gdb-digest/build/gas/as-new 2.40.50.20230221
make[4]: Lämnar katalogen ”/home/ulf/projects/binutils/build/binutils-gdb-digest/build/gas”
make[3]: Lämnar katalogen ”/home/ulf/projects/binutils/build/binutils-gdb-digest/build/gas”
make[2]: Lämnar katalogen ”/home/ulf/projects/binutils/build/binutils-gdb-digest/build/gas”
make[2]: Går till katalogen ”/home/ulf/projects/binutils/build/binutils-gdb-digest/build/gprof”
make check-recursive
make[3]: Går till katalogen ”/home/ulf/projects/binutils/build/binutils-gdb-digest/build/gprof”
Making check in po
make[4]: Går till katalogen ”/home/ulf/projects/binutils/build/binutils-gdb-digest/build/gprof/po”
make[4]: Inget behöver göras för ”check”.
make[4]: Lämnar katalogen ”/home/ulf/projects/binutils/build/binutils-gdb-digest/build/gprof/po”
make[4]: Går till katalogen ”/home/ulf/projects/binutils/build/binutils-gdb-digest/build/gprof”
make[4]: Lämnar katalogen ”/home/ulf/projects/binutils/build/binutils-gdb-digest/build/gprof”
make[3]: Lämnar katalogen ”/home/ulf/projects/binutils/build/binutils-gdb-digest/build/gprof”
make[2]: Lämnar katalogen ”/home/ulf/projects/binutils/build/binutils-gdb-digest/build/gprof”
make[2]: Går till katalogen ”/home/ulf/projects/binutils/build/binutils-gdb-digest/build/gprofng”
Making check in libcollector
make[3]: Går till katalogen ”/home/ulf/projects/binutils/build/binutils-gdb-digest/build/gprofng/libcollector”
make[3]: Lämnar katalogen ”/home/ulf/projects/binutils/build/binutils-gdb-digest/build/gprofng/libcollector”
Making check in src
make[3]: Går till katalogen ”/home/ulf/projects/binutils/build/binutils-gdb-digest/build/gprofng/src”
make check-am
make[4]: Går till katalogen ”/home/ulf/projects/binutils/build/binutils-gdb-digest/build/gprofng/src”
make[4]: Inget behöver göras för ”check-am”.
make[4]: Lämnar katalogen ”/home/ulf/projects/binutils/build/binutils-gdb-digest/build/gprofng/src”
make[3]: Lämnar katalogen ”/home/ulf/projects/binutils/build/binutils-gdb-digest/build/gprofng/src”
Making check in gp-display-html
make[3]: Går till katalogen ”/home/ulf/projects/binutils/build/binutils-gdb-digest/build/gprofng/gp-display-html”
make[3]: Inget behöver göras för ”check”.
make[3]: Lämnar katalogen ”/home/ulf/projects/binutils/build/binutils-gdb-digest/build/gprofng/gp-display-html”
Making check in doc
make[3]: Går till katalogen ”/home/ulf/projects/binutils/build/binutils-gdb-digest/build/gprofng/doc”
make[3]: Inget behöver göras för ”check”.
make[3]: Lämnar katalogen ”/home/ulf/projects/binutils/build/binutils-gdb-digest/build/gprofng/doc”
make[3]: Går till katalogen ”/home/ulf/projects/binutils/build/binutils-gdb-digest/build/gprofng”
make jdk_inc="-I/usr/lib/jvm/java-11-openjdk-amd64/include -I/usr/lib/jvm/java-11-openjdk-amd64/include/linux" LD_NO_AS_NEEDED="-Wl,--no-as-needed" GPROFNG_CFLAGS="-Wall" GPROFNG_CPPFLAGS="-U_ASM" check-DEJAGNU
make[4]: Går till katalogen ”/home/ulf/projects/binutils/build/binutils-gdb-digest/build/gprofng”
srcroot=`cd /home/ulf/projects/binutils/binutils-gdb-digest/gprofng && pwd`; export srcroot; \
r=`pwd`; export r; \
LC_ALL=C; export LC_ALL; \
EXPECT=expect; export EXPECT; \
jdk_inc="-I/usr/lib/jvm/java-11-openjdk-amd64/include -I/usr/lib/jvm/java-11-openjdk-amd64/include/linux"; export jdk_inc; \
runtest=runtest; \
if /bin/bash -c "$runtest --version" > /dev/null 2>&1; then \
$runtest --tool gprofng --srcdir ${srcroot}/testsuite \
JDK_INC="-I/usr/lib/jvm/java-11-openjdk-amd64/include -I/usr/lib/jvm/java-11-openjdk-amd64/include/linux" \
GPROFNG_BROKEN_JAVAC="no" \
MAKE="make" CC="gcc" CFLAGS="-g -O2 -pthread" \
LDFLAGS="" LIBS=" " \
BUILDDIR="/home/ulf/projects/binutils/build/binutils-gdb-digest/build/gprofng" ld-scripts/script.exp; \
else echo "WARNING: could not find \`runtest'" 1>&2; :;\
fi
WARNING: Couldn't find tool init file
Test run by ulf on Thu Feb 23 11:42:04 2023
Native configuration is x86_64-pc-linux-gnu
=== gprofng tests ===
Schedule of variations:
unix
Running target unix
Using /usr/share/dejagnu/baseboards/unix.exp as board description file for target.
Using /usr/share/dejagnu/config/unix.exp as generic interface file for target.
Using /home/ulf/projects/binutils/binutils-gdb-digest/gprofng/testsuite/config/default.exp as tool-and-target-specific interface file.
=== gprofng Summary ===
make[4]: Lämnar katalogen ”/home/ulf/projects/binutils/build/binutils-gdb-digest/build/gprofng”
make[3]: Lämnar katalogen ”/home/ulf/projects/binutils/build/binutils-gdb-digest/build/gprofng”
make[2]: Lämnar katalogen ”/home/ulf/projects/binutils/build/binutils-gdb-digest/build/gprofng”
make[2]: Går till katalogen ”/home/ulf/projects/binutils/build/binutils-gdb-digest/build/intl”
make[2]: Inget behöver göras för ”check”.
make[2]: Lämnar katalogen ”/home/ulf/projects/binutils/build/binutils-gdb-digest/build/intl”
make[2]: Går till katalogen ”/home/ulf/projects/binutils/build/binutils-gdb-digest/build/ld”
make check-recursive
make[3]: Går till katalogen ”/home/ulf/projects/binutils/build/binutils-gdb-digest/build/ld”
Making check in po
make[4]: Går till katalogen ”/home/ulf/projects/binutils/build/binutils-gdb-digest/build/ld/po”
make[4]: Inget behöver göras för ”check”.
make[4]: Lämnar katalogen ”/home/ulf/projects/binutils/build/binutils-gdb-digest/build/ld/po”
make[4]: Går till katalogen ”/home/ulf/projects/binutils/build/binutils-gdb-digest/build/ld”
make check-DEJAGNU
make[5]: Går till katalogen ”/home/ulf/projects/binutils/build/binutils-gdb-digest/build/ld”
(cd .libs; test -e ldscripts || test ! -e ld-new || ln -s ../ldscripts .)
srcroot=`cd /home/ulf/projects/binutils/binutils-gdb-digest/ld && pwd`; export srcroot; \
r=`pwd`; export r; \
LC_ALL=C; export LC_ALL; \
EXPECT=expect; export EXPECT; \
runtest=runtest; \
if /bin/bash -c "$runtest --version" > /dev/null 2>&1; then \
$runtest --tool ld --srcdir ${srcroot}/testsuite \
CC="gcc" CFLAGS="-g -O2 " \
CXX="g++" CXXFLAGS="-g -O2 " \
CC_FOR_TARGET="gcc" \
CFLAGS_FOR_TARGET="-g -O2" \
CXX_FOR_TARGET="g++" \
CXXFLAGS_FOR_TARGET="-g -O2 -D_GNU_SOURCE" \
OFILES="ldgram.o ldlex-wrapper.o lexsup.o ldlang.o lddigest.o ldcrc32.o ldcrc64.o mri.o ldctor.o ldmain.o plugin.o ldwrite.o ldexp.o ldemul.o ldver.o ldmisc.o ldfile.o ldcref.o eelf_x86_64.o eelf32_x86_64.o eelf_i386.o eelf_iamcu.o ldelf.o ldelfgen.o ldbuildid.o" BFDLIB="../bfd/.libs/libbfd.a" CTFLIB="../libctf/.libs/libctf.a -L./../zlib -lz" \
SFRAMELIB="../libsframe/.libs/libsframe.a" \
JANSSON_LIBS="" ZSTD_LIBS="" \
LIBIBERTY="../libiberty/libiberty.a " LIBS="" \
DO_COMPARE="`echo 'cmp --ignore-initial=16 $f1 $f2' | sed -e 's,\\$,,g'`" \
ld-scripts/script.exp; \
else echo "WARNING: could not find \`runtest'" 1>&2; :;\
fi
WARNING: Couldn't find tool init file
Test run by ulf on Thu Feb 23 11:42:04 2023
Native configuration is x86_64-pc-linux-gnu
=== ld tests ===
Schedule of variations:
unix
Running target unix
Using /usr/share/dejagnu/baseboards/unix.exp as board description file for target.
Using /usr/share/dejagnu/config/unix.exp as generic interface file for target.
Using /home/ulf/projects/binutils/binutils-gdb-digest/ld/testsuite/config/default.exp as tool-and-target-specific interface file.
Running /home/ulf/projects/binutils/binutils-gdb-digest/ld/testsuite/ld-scripts/script.exp ...
FAIL: script
FAIL: MRI script
FAIL: MEMORY
FAIL: MEMORY with symbols
FAIL: ld-scripts/asciz
FAIL: ld-scripts/ascii
FAIL: ld-scripts/crc64-ecma
FAIL: ld-scripts/crc64-iso
FAIL: ld-scripts/crc64-poly
FAIL: ld-scripts/crc64-polyi
FAIL: ld-scripts/crc32
FAIL: ld-scripts/crc32-poly
FAIL: ld-scripts/crc32-polyi
FAIL: ld-scripts/pr20302
FAIL: ld-scripts/output-section-types
FAIL: SEGMENT_START expression not absolute (default)
FAIL: SEGMENT_START expression not absolute (overridden)
=== ld Summary ===
# of expected passes 5
# of unexpected failures 17
# of untested testcases 1
./ld-new 2.40.50.20230221
make[5]: *** [Makefile:2649: check-DEJAGNU] Fel 1
make[5]: Lämnar katalogen ”/home/ulf/projects/binutils/build/binutils-gdb-digest/build/ld”
make[4]: *** [Makefile:1977: check-am] Fel 2
make[4]: Lämnar katalogen ”/home/ulf/projects/binutils/build/binutils-gdb-digest/build/ld”
make[3]: *** [Makefile:1846: check-recursive] Fel 1
make[3]: Lämnar katalogen ”/home/ulf/projects/binutils/build/binutils-gdb-digest/build/ld”
make[2]: *** [Makefile:1979: check] Fel 2
make[2]: Lämnar katalogen ”/home/ulf/projects/binutils/build/binutils-gdb-digest/build/ld”
make[1]: *** [Makefile:8588: check-ld] Fel 2
make[1]: Lämnar katalogen ”/home/ulf/projects/binutils/build/binutils-gdb-digest/build”
make: *** [Makefile:2531: do-check] Fel 2
next prev parent reply other threads:[~2023-02-23 10:53 UTC|newest]
Thread overview: 25+ messages / expand[flat|nested] mbox.gz Atom feed top
2023-02-19 19:45 [PATCH v4 0/5 Add support for CRC64 generation in linker binutils
2023-02-19 19:45 ` [PATCH v4 1/5] CRC64 commands documentation binutils
2023-02-19 19:50 ` [PATCH v4 0/5] Add support for CRC64 generation in linker Ulf Samuelsson
2023-02-21 12:02 ` Nick Clifton
2023-02-21 13:10 ` Ulf Samuelsson
2023-02-21 13:30 ` Ulf Samuelsson
2023-02-21 12:53 ` [PATCH v4 1/5] CRC64 commands documentation Nick Clifton
2023-02-21 13:24 ` Ulf Samuelsson
2023-02-19 19:45 ` [PATCH v4 2/5] CRC64 testsuite binutils
2023-02-21 12:42 ` Nick Clifton
2023-02-21 15:13 ` Ulf Samuelsson
2023-02-23 10:10 ` Nick Clifton
2023-02-23 10:53 ` Ulf Samuelsson [this message]
2023-02-23 11:01 ` Nick Clifton
2023-02-28 11:11 ` Ulf Samuelsson
2023-02-28 12:37 ` Nick Clifton
2023-02-28 13:01 ` Ulf Samuelsson
2023-02-28 13:06 ` Nick Clifton
2023-02-28 14:24 ` Ulf Samuelsson
2023-02-28 13:45 ` Ulf Samuelsson
2023-02-19 19:45 ` [PATCH v4 3/5] ldlex.l: CRC64 binutils
2023-02-19 19:45 ` [PATCH v4 4/5] ldgram.y: CRC64 binutils
2023-02-19 19:45 ` [PATCH v4 5/5] Calculate CRC64 over the .text area binutils
2023-02-21 13:26 ` Nick Clifton
2023-02-23 8:36 ` Ulf Samuelsson
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=f2030d96-2b46-d095-b5b7-d3fcf495d8a8@emagii.com \
--to=binutils@emagii.com \
--cc=binutils@sourceware.org \
--cc=nickc@redhat.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for read-only IMAP folder(s) and NNTP newsgroup(s).