GCC make test errors

GCC make test errors

[Jackson Pfeffer]

[-- Attachment #1: test_summary.txt --]
[-- Type: text/plain, Size: 10858 bytes --]

cat <<'EOF' |
LAST_UPDATED: Obtained from git: releases/gcc-11 revision 50bc9185c2821350f0b785d6e23a6e9dcde58466

Native configuration is x86_64-pc-linux-gnu

		=== brig tests ===


Running target unix

		=== brig Summary ===

# of unsupported tests		1
		=== gcc tests ===


Running target unix

		=== gcc Summary ===

# of expected passes		160238
# of expected failures		860
# of unsupported tests		2403
/home/jackson/Downloads/objdirs/native/gcc/xgcc  version 11.1.0 (GCC) 

		=== gdc tests ===


Running target unix

		=== gdc Summary ===

# of expected passes		10091
# of unsupported tests		331
/home/jackson/Downloads/objdirs/native/gcc/gdc  version 11.1.0 (GCC) 

		=== gfortran tests ===


Running target unix

		=== gfortran Summary ===

# of expected passes		56706
# of expected failures		232
# of unsupported tests		96
/home/jackson/Downloads/objdirs/native/gcc/gfortran  version 11.1.0 (GCC) 

		=== g++ tests ===


Running target unix
XPASS: g++.dg/cpp0x/constexpr-52830.C  -std=c++14 (internal compiler error)
FAIL: g++.dg/cpp0x/constexpr-52830.C  -std=c++14 (test for excess errors)
XPASS: g++.dg/cpp0x/constexpr-52830.C  -std=c++17 (internal compiler error)
FAIL: g++.dg/cpp0x/constexpr-52830.C  -std=c++17 (test for excess errors)
XPASS: g++.dg/cpp0x/constexpr-52830.C  -std=c++2a (internal compiler error)
FAIL: g++.dg/cpp0x/constexpr-52830.C  -std=c++2a (test for excess errors)

		=== g++ Summary ===

# of expected passes		208074
# of unexpected failures	3
# of unexpected successes	3
# of expected failures		1054
# of unsupported tests		8962
/home/jackson/Downloads/objdirs/native/gcc/xg++  version 11.1.0 (GCC) 

		=== go tests ===


Running target unix
FAIL: ./index0-out.go execution,  -O0 -g -fno-var-tracking-assignments 
FAIL: go.test/test/fixedbugs/issue10441.go   -O  (test for excess errors)

		=== go Summary ===

# of expected passes		8893
# of unexpected failures	2
# of untested testcases		6
# of unsupported tests		27
/home/jackson/Downloads/objdirs/native/gcc/gccgo  version 11.1.0 (GCC) 

		=== obj-c++ tests ===


Running target unix

		=== obj-c++ Summary ===

# of expected passes		1482
# of expected failures		10
# of unsupported tests		77
/home/jackson/Downloads/objdirs/native/gcc/xg++  version 11.1.0 (GCC) 

		=== objc tests ===


Running target unix

		=== objc Summary ===

# of expected passes		2820
# of expected failures		6
# of unsupported tests		68
/home/jackson/Downloads/objdirs/native/gcc/xgcc  version 11.1.0 (GCC) 

		=== gotools tests ===


		=== gotools Summary ===
# of expected passes		399
# of untested testcases		121
/home/jackson/Downloads/objdirs/native/./gcc/gccgo version 11.1.0 (GCC)

		=== libatomic tests ===


Running target unix

		=== libatomic Summary ===

# of expected passes		54
		=== libffi tests ===


Running target unix

		=== libffi Summary ===

# of expected passes		2214
		=== libgo tests ===


Running target unix
FAIL: net
FAIL: runtime
FAIL: runtime/pprof
FAIL: syscall

		=== libgo Summary for unix ===

# of expected passes		180
# of unexpected failures	4

Running target unix/-m32
FAIL: syscall
FAIL: time

		=== libgo Summary for unix/-m32 ===

# of expected passes		182
# of unexpected failures	2

		=== libgo Summary ===

# of expected passes		362
# of unexpected failures	6
/home/jackson/Downloads/objdirs/native/./gcc/gccgo version 11.1.0 (GCC)

		=== libgomp tests ===


Running target unix

		=== libgomp Summary ===

# of expected passes		8404
# of expected failures		6
# of unsupported tests		546
		=== libitm tests ===


Running target unix

		=== libitm Summary ===

# of expected passes		42
# of expected failures		3
# of unsupported tests		1
		=== libphobos tests ===


Running target unix

		=== libphobos Summary ===

# of expected passes		788
		=== libstdc++ tests ===


Running target unix
FAIL: 27_io/filesystem/iterators/directory_iterator.cc execution test
FAIL: 27_io/filesystem/iterators/recursive_directory_iterator.cc execution test
FAIL: 27_io/filesystem/operations/exists.cc execution test
FAIL: 27_io/filesystem/operations/is_empty.cc execution test
FAIL: 27_io/filesystem/operations/remove.cc execution test
FAIL: 27_io/filesystem/operations/remove_all.cc execution test
FAIL: 27_io/filesystem/operations/status.cc execution test
FAIL: 27_io/filesystem/operations/symlink_status.cc execution test
FAIL: 27_io/filesystem/operations/temp_directory_path.cc execution test
FAIL: experimental/filesystem/iterators/directory_iterator.cc execution test
FAIL: experimental/filesystem/iterators/recursive_directory_iterator.cc execution test
FAIL: experimental/filesystem/operations/exists.cc execution test
FAIL: experimental/filesystem/operations/is_empty.cc execution test
FAIL: experimental/filesystem/operations/remove.cc execution test
FAIL: experimental/filesystem/operations/remove_all.cc execution test
FAIL: experimental/filesystem/operations/temp_directory_path.cc execution test

		=== libstdc++ Summary ===

# of expected passes		14242
# of unexpected failures	16
# of expected failures		104
# of unsupported tests		609

Compiler version: 11.1.0 (GCC) 
Platform: x86_64-pc-linux-gnu
configure flags: --program-suffix=11.1.0 --enable-multiarch --enable-threads=posix --enable-__cxa_atexit --enable-gnu-indirect-function --enable-version-specific-runtime-libs --enable-languages=all --enable-large-address-aware --enable-fix-cortex-a53-835769 --enable-fix-cortex-a53-843419
EOF
Mail -s "Results for 11.1.0 (GCC) testsuite on x86_64-pc-linux-gnu" gcc-testresults@gcc.gnu.org &&
mv /home/jackson/Downloads/objdirs/native/./gcc/testsuite/brig/brig.sum /home/jackson/Downloads/objdirs/native/./gcc/testsuite/brig/brig.sum.sent &&
mv /home/jackson/Downloads/objdirs/native/./gcc/testsuite/gcc/gcc.sum /home/jackson/Downloads/objdirs/native/./gcc/testsuite/gcc/gcc.sum.sent &&
mv /home/jackson/Downloads/objdirs/native/./gcc/testsuite/gdc/gdc.sum /home/jackson/Downloads/objdirs/native/./gcc/testsuite/gdc/gdc.sum.sent &&
mv /home/jackson/Downloads/objdirs/native/./gcc/testsuite/gfortran/gfortran.sum /home/jackson/Downloads/objdirs/native/./gcc/testsuite/gfortran/gfortran.sum.sent &&
mv /home/jackson/Downloads/objdirs/native/./gcc/testsuite/g++/g++.sum /home/jackson/Downloads/objdirs/native/./gcc/testsuite/g++/g++.sum.sent &&
mv /home/jackson/Downloads/objdirs/native/./gcc/testsuite/go/go.sum /home/jackson/Downloads/objdirs/native/./gcc/testsuite/go/go.sum.sent &&
mv /home/jackson/Downloads/objdirs/native/./gcc/testsuite/obj-c++/obj-c++.sum /home/jackson/Downloads/objdirs/native/./gcc/testsuite/obj-c++/obj-c++.sum.sent &&
mv /home/jackson/Downloads/objdirs/native/./gcc/testsuite/objc/objc.sum /home/jackson/Downloads/objdirs/native/./gcc/testsuite/objc/objc.sum.sent &&
mv /home/jackson/Downloads/objdirs/native/./gotools/gotools.sum /home/jackson/Downloads/objdirs/native/./gotools/gotools.sum.sent &&
mv /home/jackson/Downloads/objdirs/native/./x86_64-pc-linux-gnu/libatomic/testsuite/libatomic.sum /home/jackson/Downloads/objdirs/native/./x86_64-pc-linux-gnu/libatomic/testsuite/libatomic.sum.sent &&
mv /home/jackson/Downloads/objdirs/native/./x86_64-pc-linux-gnu/libffi/testsuite/libffi.sum /home/jackson/Downloads/objdirs/native/./x86_64-pc-linux-gnu/libffi/testsuite/libffi.sum.sent &&
mv /home/jackson/Downloads/objdirs/native/./x86_64-pc-linux-gnu/libgo/libgo.sum /home/jackson/Downloads/objdirs/native/./x86_64-pc-linux-gnu/libgo/libgo.sum.sent &&
mv /home/jackson/Downloads/objdirs/native/./x86_64-pc-linux-gnu/libgomp/testsuite/libgomp.sum /home/jackson/Downloads/objdirs/native/./x86_64-pc-linux-gnu/libgomp/testsuite/libgomp.sum.sent &&
mv /home/jackson/Downloads/objdirs/native/./x86_64-pc-linux-gnu/libitm/testsuite/libitm.sum /home/jackson/Downloads/objdirs/native/./x86_64-pc-linux-gnu/libitm/testsuite/libitm.sum.sent &&
mv /home/jackson/Downloads/objdirs/native/./x86_64-pc-linux-gnu/libphobos/testsuite/libphobos.sum /home/jackson/Downloads/objdirs/native/./x86_64-pc-linux-gnu/libphobos/testsuite/libphobos.sum.sent &&
mv /home/jackson/Downloads/objdirs/native/./x86_64-pc-linux-gnu/libstdc++-v3/testsuite/libstdc++.sum /home/jackson/Downloads/objdirs/native/./x86_64-pc-linux-gnu/libstdc++-v3/testsuite/libstdc++.sum.sent &&
mv /home/jackson/Downloads/objdirs/native/./gcc/testsuite/brig/brig.log /home/jackson/Downloads/objdirs/native/./gcc/testsuite/brig/brig.log.sent &&
mv /home/jackson/Downloads/objdirs/native/./gcc/testsuite/gcc/gcc.log /home/jackson/Downloads/objdirs/native/./gcc/testsuite/gcc/gcc.log.sent &&
mv /home/jackson/Downloads/objdirs/native/./gcc/testsuite/gdc/gdc.log /home/jackson/Downloads/objdirs/native/./gcc/testsuite/gdc/gdc.log.sent &&
mv /home/jackson/Downloads/objdirs/native/./gcc/testsuite/gfortran/gfortran.log /home/jackson/Downloads/objdirs/native/./gcc/testsuite/gfortran/gfortran.log.sent &&
mv /home/jackson/Downloads/objdirs/native/./gcc/testsuite/g++/g++.log /home/jackson/Downloads/objdirs/native/./gcc/testsuite/g++/g++.log.sent &&
mv /home/jackson/Downloads/objdirs/native/./gcc/testsuite/go/go.log /home/jackson/Downloads/objdirs/native/./gcc/testsuite/go/go.log.sent &&
mv /home/jackson/Downloads/objdirs/native/./gcc/testsuite/obj-c++/obj-c++.log /home/jackson/Downloads/objdirs/native/./gcc/testsuite/obj-c++/obj-c++.log.sent &&
mv /home/jackson/Downloads/objdirs/native/./gcc/testsuite/objc/objc.log /home/jackson/Downloads/objdirs/native/./gcc/testsuite/objc/objc.log.sent &&
mv /home/jackson/Downloads/objdirs/native/./gotools/gotools.log /home/jackson/Downloads/objdirs/native/./gotools/gotools.log.sent &&
mv /home/jackson/Downloads/objdirs/native/./x86_64-pc-linux-gnu/libatomic/testsuite/libatomic.log /home/jackson/Downloads/objdirs/native/./x86_64-pc-linux-gnu/libatomic/testsuite/libatomic.log.sent &&
mv /home/jackson/Downloads/objdirs/native/./x86_64-pc-linux-gnu/libffi/testsuite/libffi.log /home/jackson/Downloads/objdirs/native/./x86_64-pc-linux-gnu/libffi/testsuite/libffi.log.sent &&
mv /home/jackson/Downloads/objdirs/native/./x86_64-pc-linux-gnu/libgo/libgo.log /home/jackson/Downloads/objdirs/native/./x86_64-pc-linux-gnu/libgo/libgo.log.sent &&
mv /home/jackson/Downloads/objdirs/native/./x86_64-pc-linux-gnu/libgomp/testsuite/libgomp.log /home/jackson/Downloads/objdirs/native/./x86_64-pc-linux-gnu/libgomp/testsuite/libgomp.log.sent &&
mv /home/jackson/Downloads/objdirs/native/./x86_64-pc-linux-gnu/libitm/testsuite/libitm.log /home/jackson/Downloads/objdirs/native/./x86_64-pc-linux-gnu/libitm/testsuite/libitm.log.sent &&
mv /home/jackson/Downloads/objdirs/native/./x86_64-pc-linux-gnu/libphobos/testsuite/libphobos.log /home/jackson/Downloads/objdirs/native/./x86_64-pc-linux-gnu/libphobos/testsuite/libphobos.log.sent &&
mv /home/jackson/Downloads/objdirs/native/./x86_64-pc-linux-gnu/libstdc++-v3/testsuite/libstdc++.log /home/jackson/Downloads/objdirs/native/./x86_64-pc-linux-gnu/libstdc++-v3/testsuite/libstdc++.log.sent &&
true

Re: GCC make test errors

[Jonathan Wakely]

Do you have a question?

Those errors are not expected.

I'd be curious what is shown in the
/home/jackson/Downloads/objdirs/native/./x86_64-pc-linux-gnu/libstdc++-v3/testsuite/libstdc++.log
file for the tests that FAIL.

Re: GCC make test errors

[Jonathan Wakely]

On Thu, 3 Jun 2021 at 17:42, Jackson Pfeffer <crazykidjack@gmail.com> wrote:
>
> To be honest I wasn’t even sure if I had a question because I wasn’t sure if those errors were expected.
>
> Since you have now clarified that, my question is just “would you help me figure out how to fix those errors so that I can get gcc to be ready for install”
>
>
>
> The file you asked for is too large to attach to email, so here is a google drive link… I hope that’s ok: https://drive.google.com/drive/folders/1mXD0BWitzUzzKdIrG1z4g9kTqBao5v_g?usp=sharing

Thanks, I'll take a look.

Re: GCC make test errors

[Jonathan Wakely]

On Thu, 3 Jun 2021 at 17:42, Jackson Pfeffer <crazykidjack@gmail.com> wrote:
>
> To be honest I wasn’t even sure if I had a question because I wasn’t sure if those errors were expected.
>
> Since you have now clarified that, my question is just “would you help me figure out how to fix those errors so that I can get gcc to be ready for install”
>
>
>
> The file you asked for is too large to attach to email, so here is a google drive link… I hope that’s ok: https://drive.google.com/drive/folders/1mXD0BWitzUzzKdIrG1z4g9kTqBao5v_g?usp=sharing

The libstdc++ failures all seem to be related to EPERM errors where an
expected error doesn't occur. Are you using an unusual filesystem?
Maybe a Windows share or something?

They don't indicate a problem with the C++ library, just that the
tests expect any filesystem on linux to support POSIX file
permissions, so that a directory can be unreadable and give errors
when accessed. So the tests aren't as portable as they could be.

I don't know about the other failures you're seeing.

Re: GCC make test errors

[Xi Ruoyao]

On Thu, 2021-06-03 at 00:54 -0500, Jackson Pfeffer via Gcc-help wrote:
> 
>                 === g++ tests ===
> 
> 
> Running target unix
> XPASS: g++.dg/cpp0x/constexpr-52830.C  -std=c++14 (internal compiler
> error)
> FAIL: g++.dg/cpp0x/constexpr-52830.C  -std=c++14 (test for excess
> errors)
> XPASS: g++.dg/cpp0x/constexpr-52830.C  -std=c++17 (internal compiler
> error)
> FAIL: g++.dg/cpp0x/constexpr-52830.C  -std=c++17 (test for excess
> errors)
> XPASS: g++.dg/cpp0x/constexpr-52830.C  -std=c++2a (internal compiler
> error)
> FAIL: g++.dg/cpp0x/constexpr-52830.C  -std=c++2a (test for excess
> errors)

These are known.  The tests fail in "another way": the compiler no
longer crashes, but still rejects a valid code.
-- 
Xi Ruoyao <xry111@mengyan1223.wang>
School of Aerospace Science and Technology, Xidian University

Re: GCC make test errors

[Jonathan Wakely]

On Thu, 3 Jun 2021 at 19:36, Jackson Pfeffer <crazykidjack@gmail.com> wrote:
>
> I’m running all of this in a Manjaro Linux (Arch) virtual machine which uses and Ext4 filesystem0. I’m not aware of any deviation from standard POSIX permissions.
>
>
>
> With that said.. I was running as root (I know… probably dumb… I just happened to be doing other things that do actually require root at the same time and I didn’t want to switch between users and stuff…).

Ah yes, that explains it.

> Anyways, could running as root cause the problem since root can probably do whatever it wants? I’m not sure exactly what file permission error it was expecting, but I could see that being an issue

Right. The superuser can always access a directory even if it has mode 000.

Re: GCC make test errors

[Jonathan Wakely]

On Thu, 3 Jun 2021, 22:59 Jackson Pfeffer, <crazykidjack@gmail.com> wrote:

> Thanks for the clarification, speedy response, and the help! So in that
> case
>
>
>
> #1 I should be able to safely ignore the libstdc++ errors correct?
>

Yes. Or don't build and test as root if you want to be sure.


>
> #2 I think you said you were not able to help me with the non-libstdc++
> errors right? If that is the case, is there any other forum or anything I
> can turn to get help on those errors? Because so far you are the only
> person to respond to me on this email list :/
>

Xi Ruoyao replied, but didn't CC you. Check the list archives. He said the
C++ failures are known, and fixed now.



>
>
>

Re: GCC make test errors

[Xi Ruoyao]

On Thu, 2021-06-03 at 17:40 -0500, Jackson Pfeffer wrote:
> Hi Xi Ruoyao sorry I didn’t see your message earlier. Thank you for your
> response.

My bad, I shouldn't assumpt that you've registered to the list.

> Would you happen to know anything about the other errors as well? (The
> non-c++) ones?

I'm a member of LFS project (which provides a book telling how to build
a Linux system from source code). We've seen this errors building LFS. 
Since in LFS everything would be built with GCC, we've investigated GCC
test failures to ensure they won't cause some instablility of the
system.

This failure is mentioned in
https://linuxfromscratch.org/lfs/view/development/chapter08/gcc.html,
and the related discussion is in
https://wiki.linuxfromscratch.org/lfs/ticket/4847.

You can post your test results to gcc-testresults@gcc.gnu.org, and
compare the results with already posted ones.
-- 
Xi Ruoyao <xry111@mengyan1223.wang>
School of Aerospace Science and Technology, Xidian University