Re: testsuite results

Re: testsuite results

[Mike Stump]

> Date: Sun, 12 Oct 1997 19:44:51 +0200 (MEST)
> From: Peter Schmid <schmid@ltoi.iap.physik.th-darmstadt.de>
> To: egcs@cygnus.com

> 2. While compiling g++.mike/ambig1.C I get an recoverable compiler error.
>   What is that?

Well, the general rule is to fix the first problem listed, and then
recompile.  In this case, that is what should be done, though, since
this testcase just wants to generate error messages, of course, there
is no problem.

If you want a more complete description, imagine a compiler that could
detect when it was in error, then corrected it's problem before
screwing the user, and found a way to get the developers to fix the
underlying problem, to further enhance the compiler...  Well, that is
what it does.  In this case, since there was a prior error, it is less
meaningful, but in theory we could teach the compiler to recover from
the first error in a more complete way.  Currently, it doesn't recover
from the first error as well as it should.

One might be tempted to call this software fault tolerance, personally
I think it is more useful than core dumping the compiler.

testsuite results

[Peter Schmid]

These are the results of the gcc, g++ and g77 testsuite.
I am using libc-5.4.40 and binutils-2.8.1.0.15



Native configuration is i386-pc-linux-gnulibc1

		=== gcc tests ===

		=== gcc Summary ===

# of expected passes		4883
# of expected failures		5
# of unsupported tests		7
/dos/peter/ftp/gcc/egcs-971127/gcc/xgcc version egcs-2.90.19 971127 (gcc2-970802 experimental)


		=== g++ tests ===
		=== g++ Summary ===

# of expected passes		3400
# of unexpected successes	3
# of expected failures		80
# of untested testcases		6
/dos/peter/ftp/gcc/egcs-971127/gcc/testsuite/../xgcc version egcs-2.90.19 971127 (gcc2-970802 experimental)

XPASS: g++.jason/destruct3.C - (test for bogus messages, line 38)
XPASS: g++.mike/dyncast1.C  Execution test
XPASS: g++.mike/dyncast2.C  Execution test


		=== g77 tests ===
		=== g77 Summary ===

# of expected passes		130
# of unexpected failures	2
/dos/peter/ftp/gcc/egcs-971127/gcc/g77 version egcs-2.90.19 971127 (gcc2-970802 experimental)

FAIL: g77.f-torture/execute/dnrm2.f execution,  -O2 -fomit-frame-pointer -finline-functions -funroll-loops 
FAIL: g77.f-torture/execute/dnrm2.f execution,  -O2 -fomit-frame-pointer -finline-functions -funroll-all-loops 


The 
XPASS:g++.jason/destruct3.C - (test for bogus messages, line 38)
is an internal compiler error in disguise:
Executing on host: /dos/peter/ftp/gcc/egcs-971127/gcc/testsuite/../xgcc -B/dos/peter/ftp/gcc/egcs-971127/gcc/testsuite/../ /dos/peter/ftp/gcc/egcs-971127/gcc/testsuite/g++.old-deja/g++.jason/destruct3.C  -ansi -pedantic-errors  -I/dos/peter/ftp/gcc/egcs-9
71127/libio -I/dos/peter/ftp/gcc/egcs-971127/libio -I/dos/peter/ftp/gcc/egcs-971127/libstdc++ -I/dos/peter/ftp/gcc/egcs-971127/libstdc++/stl -I/dos/peter/ftp/gcc/egcs-971127/gcc/testsuite/../include -c  -o /tmp/destruct3.o   
compiler exited with status 1
output is:
/dos/peter/ftp/gcc/egcs-971127/gcc/testsuite/g++.old-deja/g++.jason/destruct3.C:35: warning: direct base `ccUnwind' inaccessible in `ccVSTool' due to ambiguity
/dos/peter/ftp/gcc/egcs-971127/gcc/testsuite/g++.old-deja/g++.jason/destruct3.C:35: Internal compiler error 369.
/dos/peter/ftp/gcc/egcs-971127/gcc/testsuite/g++.old-deja/g++.jason/destruct3.C:35: Please submit a full bug report to `egcs-bugs@cygnus.com'.

Are you going to fix this?
At least the compiler should not crash.

Peter Schmid 

Re: testsuite results

[Jeffrey A Law]

  In message < 199711251724.JAA09811@atrus.synopsys.com >you write:
  > > 
  > > >>>>> Peter Schmid <schmid@ltoi.iap.physik.tu-darmstadt.de> writes:
  > > 
  > > > FAIL: g++.benjamin/warn01.C (test for excess errors)
  > > > FAIL: g++.eh/spec3.C  Execution test
  > > 
  > > These are both tests for features that didn't make it into the release
  > > branch.
  > 
  > Since this has been decided (that these features won't be fixed before
  > the release), I suggest changing the status of the tests to XFAIL until
  > after the first release.
Done.
jeff

Re: testsuite results

[Joe Buck]

> 
> >>>>> Peter Schmid <schmid@ltoi.iap.physik.tu-darmstadt.de> writes:
> 
> > FAIL: g++.benjamin/warn01.C (test for excess errors)
> > FAIL: g++.eh/spec3.C  Execution test
> 
> These are both tests for features that didn't make it into the release
> branch.

Since this has been decided (that these features won't be fixed before
the release), I suggest changing the status of the tests to XFAIL until
after the first release.

Re: testsuite results

[Jason Merrill]

>>>>> Peter Schmid <schmid@ltoi.iap.physik.tu-darmstadt.de> writes:

> FAIL: g++.benjamin/warn01.C (test for excess errors)
> FAIL: g++.eh/spec3.C  Execution test

These are both tests for features that didn't make it into the release
branch.

Jason

testsuite results

[Peter Schmid]

These are the results of the gcc, g++ and g77 testsuite on my linux box.
I am using libc-5.4.40 and binutils-2.8.1.0.15.

Native configuration is i386-pc-linux-gnulibc1

		=== gcc tests ===
		=== gcc Summary ===

# of expected passes		4883
# of expected failures		5
# of unsupported tests		7

		=== g++ tests ===
		=== g++ Summary ===

# of expected passes		3398
# of unexpected failures	3
# of unexpected successes	3
# of expected failures		80
# of untested testcases		6
Executing on host: /dos/peter/ftp/gcc/egcs-971122/gcc/testsuite/../xgcc -v   
/dos/peter/ftp/gcc/egcs-971122/gcc/testsuite/../xgcc version egcs-2.90.18 971122 (gcc2-970802 experimental)

FAIL: g++.benjamin/warn01.C (test for excess errors)
FAIL: g++.eh/spec3.C  Execution test
1) FAIL: g++.mike/p9732b.C (test for excess errors)
XPASS: g++.jason/destruct3.C - (test for bogus messages, line 38)
XPASS: g++.mike/dyncast1.C  Execution test
XPASS: g++.mike/dyncast2.C  Execution test

Executing on host: /dos/peter/ftp/gcc/egcs-971122/gcc/testsuite/../xgcc -B/dos/peter/ftp/gcc/egcs-971122/gcc/testsuite/../ /dos/peter/ftp/gcc/egcs-971122/gcc/testsuite/g++.old-deja/g++.mike/p9732b.C  -ansi -pedantic-errors  -I/dos/peter/ftp/gcc/egcs-97112
2/libio -I/dos/peter/ftp/gcc/egcs-971122/libio -I/dos/peter/ftp/gcc/egcs-971122/libstdc++ -I/dos/peter/ftp/gcc/egcs-971122/libstdc++/stl -I/dos/peter/ftp/gcc/egcs-971122/gcc/testsuite/../include -lstdc++  -L/dos/peter/ftp/gcc/egcs-971122//libstdc++ -L/dos
/peter/ftp/gcc/egcs-971122//libiberty   -lm  -o /tmp/a.out   
compiler exited with status 1
output is:
/dos/peter/ftp/gcc/egcs-971122/gcc/testsuite/g++.old-deja/g++.mike/p9732b.C: In method `D::~D()':
/dos/peter/ftp/gcc/egcs-971122/gcc/testsuite/g++.old-deja/g++.mike/p9732b.C:24: implicit declaration of function `int _exit(...)'

FAIL: g++.mike/p9732b.C (test for excess errors)

1) This works if I include <unistd.h>.

/dos/peter/ftp/gcc/egcs-971122/gcc/testsuite/g++.old-deja/g++.mike/p9732b.C:24: implicit declaration of function `int _exit(...)'

		=== g77 tests ===


		=== g77 Summary ===

# of expected passes		122
# of unexpected failures	2
Executing on host: /dos/peter/ftp/gcc/egcs-971122/gcc/g77 -v   
/dos/peter/ftp/gcc/egcs-971122/gcc/g77 version egcs-2.90.18 971122 (gcc2-970802 experimental)
FAIL: g77.f-torture/execute/dnrm2.f execution,  -O2 -fomit-frame-pointer -finline-functions -funroll-loops 
FAIL: g77.f-torture/execute/dnrm2.f execution,  -O2 -fomit-frame-pointer -finline-functions -funroll-all-loops 

Thanks for your great work.
Peter Schmid

testsuite results

[Peter Schmid]

These are my results of the gcc and g++ testsuite. 
I have no patches applied except for adding  -fexceptions to LIBGCC2_CFLAGS in gcc/Makefile.in.
 
CFLAGS = "-O2 -g"

Test Run By peter on Sat Oct 25 14:40:51 1997
Native configuration is i386-pc-linux-gnulibc1
I am using libc-5.4.39 and binutils-2.8.1.0.13

The results are the same as for the previous snapshot.

		=== gcc tests ===
		=== gcc Summary ===

# of expected passes		4883
# of unexpected failures	4
# of expected failures		4
# of unsupported tests		7
Executing on host: /dos/peter/ftp/gcc/egcs-971023/gcc/xgcc -v   
/dos/peter/ftp/gcc/egcs-971023/gcc/xgcc version egcs-2.90.14 971023 (gcc2-970802 experimental)

FAIL: gcc.c-torture/compile/961203-1.c,  -O0  
FAIL: gcc.c-torture/compile/961203-1.c,  -O1  
FAIL: gcc.c-torture/compile/961203-1.c,  -O2  
FAIL: gcc.c-torture/compile/961203-1.c,  -O2 -fomit-frame-pointer -finline-functions  

		=== g++ tests ===

		=== g++ Summary ===

# of expected passes		3378
# of unexpected failures	3
# of unexpected successes	3
# of expected failures		79
# of untested testcases		6
Executing on host: /dos/peter/ftp/gcc/egcs-971023/gcc/testsuite/../xgcc -v   
/dos/peter/ftp/gcc/egcs-971023/gcc/testsuite/../xgcc version egcs-2.90.14 971023 (gcc2-970802 experimental)

FAIL: g++.benjamin/warn01.C (test for excess errors)
FAIL: g++.jason/template31.C (test for excess errors)
FAIL: g++.mike/eh35.C  Execution test
XPASS: g++.jason/destruct3.C - (test for bogus messages, line 38)
XPASS: g++.mike/dyncast1.C  Execution test
XPASS: g++.mike/dyncast2.C  Execution test

Thanks for your great work! 

Peter

testsuite results

[Peter Schmid]

These are my results of the gcc and g++ testsuite. 
I have no patches applied.

CFLAGS = "-O2 -g" used when building the compiler

Test Run By peter on Fri Oct 17 22:32:13 1997
Native configuration is i386-pc-linux-gnulibc1
I am using libc-5.4.39 and binutils-2.8.1.0.13

		=== gcc tests ===

		=== gcc Summary ===

# of expected passes		4883
# of unexpected failures	4
# of expected failures		4
# of unsupported tests		7
Executing on host: /dos/peter/ftp/gcc/egcs-971016/gcc/xgcc -v   
/dos/peter/ftp/gcc/egcs-971016/gcc/xgcc version egcs-2.90.13 971016 (gcc2-970802 experimental)

FAIL: gcc.c-torture/compile/961203-1.c,  -O0  
FAIL: gcc.c-torture/compile/961203-1.c,  -O1  
FAIL: gcc.c-torture/compile/961203-1.c,  -O2  
FAIL: gcc.c-torture/compile/961203-1.c,  -O2 -fomit-frame-pointer -finline-functions  

		=== g++ Summary ===

# of expected passes		3378
# of unexpected failures	3
# of unexpected successes	3
# of expected failures		79
# of untested testcases		6

3) FAIL: g++.benjamin/warn01.C (test for excess errors)
1) FAIL: g++.jason/template31.C (test for excess errors)
FAIL: g++.mike/eh35.C  Execution test
2) XPASS: g++.jason/destruct3.C - (test for bogus messages, line 38)
XPASS: g++.mike/dyncast1.C  Execution test
XPASS: g++.mike/dyncast2.C  Execution test

1) The failure is due to warnings coming from stl-header files.

Executing on host: /dos/peter/ftp/gcc/egcs-971016/gcc/testsuite/../xgcc -B/dos/peter/ftp/gcc/egcs-971016/gcc/testsuite/../ /dos/peter/ftp/gcc/egcs-971016/gcc/testsuite/g++.old-deja/g++.jason/template31.C  -ansi -pedantic-errors  -I/dos/peter/ftp/gcc/egcs-
971016/libio -I/dos/peter/ftp/gcc/egcs-971016/./libio -I/dos/peter/ftp/gcc/egcs-971016/libstdc++ -I/dos/peter/ftp/gcc/egcs-971016/libstdc++/stl -I/dos/peter/ftp/gcc/egcs-971016/gcc/testsuite/../include -lstdc++  -L/dos/peter/ftp/gcc/egcs-971016/./libstdc+
+ -L/dos/peter/ftp/gcc/egcs-971016/./libiberty   -lm  -o /tmp/a.out   
output is:
/dos/peter/ftp/gcc/egcs-971016/libstdc++/stl/algobase.h: In function `class Component * __uninitialized_copy_aux<const Component *, Component *>(const class Component *, const class Component *, class Component *, struct __false_type)':
/dos/peter/ftp/gcc/egcs-971016/libstdc++/stl/algobase.h:548: warning: control reaches end of non-void function `__uninitialized_copy_aux<const Component *, Component *>(const Component *, const Component *, Component *, __false_type)'
/dos/peter/ftp/gcc/egcs-971016/libstdc++/stl/vector.h: In method `class Component * vector<Component,__default_alloc_template<false,0> >::allocate_and_copy<Component, __default_alloc_template<false,0>>(unsigned int, const class Component *, const class Co
mponent *)':
/dos/peter/ftp/gcc/egcs-971016/libstdc++/stl/vector.h:221: warning: control reaches end of non-void function `vector<Component,__default_alloc_template<false,0> >::allocate_and_copy<Component, __default_alloc_template<false,0>>(unsigned int, const Compone
nt *, const Component *)'
FAIL: g++.jason/template31.C (test for excess errors)

2) This is an internal compiler error in disguise.  

Executing on host: /dos/peter/ftp/gcc/egcs-971016/gcc/testsuite/../xgcc
-B/dos/peter/ftp/gcc/egcs-971016/gcc/testsuite/../
/dos/peter/ftp/gcc/egcs-971016/gcc/testsuite/g++.old-deja/g++.jason/destruct3.C
-ansi -pedantic-errors -I/dos/peter/ftp/gcc/egcs-9 71016/libio
-I/dos/peter/ftp/gcc/egcs-971016/./libio
-I/dos/peter/ftp/gcc/egcs-971016/libstdc++
-I/dos/peter/ftp/gcc/egcs-971016/libstdc++/stl
-I/dos/peter/ftp/gcc/egcs-971016/gcc/testsuite/../include -c -o
/tmp/destruct3.o compiler exited with status 1 output is: 
/dos/peter/ftp/gcc/egcs-971016/gcc/testsuite/g++.old-deja/g++.jason/destruct3.C:35: 
warning: direct base `ccUnwind' inaccessible in `ccVSTool' due to
ambiguity
/dos/peter/ftp/gcc/egcs-971016/gcc/testsuite/g++.old-deja/g++.jason/destruct3.C:35: 
Internal compiler error 369.
/dos/peter/ftp/gcc/egcs-971016/gcc/testsuite/g++.old-deja/g++.jason/destruct3.C:35: 
Please submit a full bug report to `egcs-bugs@cygnus.com'.

XFAIL: g++.jason/destruct3.C - (test for bogus messages, line 35)
XPASS: g++.jason/destruct3.C - (test for bogus messages, line 38)
PASS: g++.jason/destruct3.C (test for excess errors)

3)

Executing on host: /dos/peter/ftp/gcc/egcs-971016/gcc/testsuite/../xgcc
-B/dos/peter/ftp/gcc/egcs-971016/gcc/testsuite/../
/dos/peter/ftp/gcc/egcs-971016/gcc/testsuite/g++.old-deja/g++.benjamin/warn01.C
-Wall -Weffc++ -I/dos/peter/ftp/gcc/egcs-971016/ libio 
-I/dos/peter/ftp/gcc/egcs-971016/./libio -I/dos/peter/ftp/gcc/egcs-971016/libstdc++ -I/dos/peter/ftp/gcc/egcs-971016/libstdc++/stl -I/dos/peter/ftp/gcc/egcs-971016/gcc/testsuite/../include -c -o
/tmp/warn01.o output is: 
/dos/peter/ftp/gcc/egcs-971016/gcc/testsuite/g++.old-deja/g++.benjamin/warn01.C:63:
warning: `__unused__' attribute does not apply to types
/dos/peter/ftp/gcc/egcs-971016/gcc/testsuite/g++.old-deja/g++.benjamin/warn01.C:72:
warning: `__unused__' attribute does not apply to types
/dos/peter/ftp/gcc/egcs-971016/gcc/testsuite/g++.old-deja/g++.benjamin/warn01.C:91:
warning: `warn' attribute directive ignored PASS: g++.benjamin/warn01.C
(test for warnings, line 91)  FAIL: g++.benjamin/warn01.C (test for excess
errors) 
/dos/peter/ftp/gcc/egcs-971016/gcc/testsuite/g++.old-deja/g++.benjamin/warn01.C:63:
warning: `__unused__' attribute does not apply to types
/dos/peter/ftp/gcc/egcs-971016/gcc/testsuite/g++.old-deja/g++.benjamin/warn01.C:72:
warning: `__unused__' attribute does not apply to types

Thanks for your great work! 

Peter

testsuite results

[Peter Schmid]

These are my results of the gcc and g++ testsuite. 
I have no patches applied.
CFLAGS = "-O2 -g" used while building the compiler.

Test Run By peter on Thu Oct  9 19:24:18 1997
Native configuration is i386-pc-linux-gnulibc1
I am using libc-5.4.39 and binutils-2.8.1.0.13


		=== gcc Summary ===

# of expected passes		4883
# of unexpected failures	4
# of expected failures		4
# of unsupported tests		7
Executing on host: /dos/peter/ftp/gcc/egcs-971008/gcc/xgcc -v   
/dos/peter/ftp/gcc/egcs-971008/gcc/xgcc version egcs-2.90.12 971008 (gcc2-970802 experimental)

runtest completed at Thu Oct  9 23:13:11 1997

FAIL: gcc.c-torture/compile/961203-1.c,  -O0  
FAIL: gcc.c-torture/compile/961203-1.c,  -O1  
FAIL: gcc.c-torture/compile/961203-1.c,  -O2  
FAIL: gcc.c-torture/compile/961203-1.c,  -O2 -fomit-frame-pointer -finline-functions  

		=== g++ Summary ===

# of expected passes		3378
# of unexpected failures	2
# of expected failures		80
# of untested testcases		6
Executing on host: /dos/peter/ftp/gcc/egcs-971008/gcc/testsuite/../xgcc -v   
/dos/peter/ftp/gcc/egcs-971008/gcc/testsuite/../xgcc version egcs-2.90.12 971008 (gcc2-970802 experimental)

runtest completed at Fri Oct 10 02:03:05 1997
FAIL: g++.jason/template31.C (test for excess errors)
FAIL: g++.mike/eh35.C  Execution test

1. The first failure is due to warnings coming from stl-header files.

Executing on host: /dos/peter/ftp/gcc/egcs-971008/gcc/testsuite/../xgcc -B/dos/peter/ftp/gcc/egcs-971008/gcc/testsuite/../ /dos/peter/ftp/gcc/egcs-971008/gcc/testsuite/g++.old-deja/g++.jason/template31.C  -ansi -pedantic-errors  -I/dos/peter/ftp/gcc/egcs-
971008/libio -I/dos/peter/ftp/gcc/egcs-971008/./libio -I/dos/peter/ftp/gcc/egcs-971008/libstdc++ -I/dos/peter/ftp/gcc/egcs-971008/libstdc++/stl -I/dos/peter/ftp/gcc/egcs-971008/gcc/testsuite/../include -lstdc++  -L/dos/peter/ftp/gcc/egcs-971008/./libstdc+
+ -L/dos/peter/ftp/gcc/egcs-971008/./libiberty   -lm  -o /tmp/a.out   
output is:
/dos/peter/ftp/gcc/egcs-971008/libstdc++/stl/algobase.h: In function `class Component * __uninitialized_copy_aux<const Component *, Component *>(const class Component *, const class Component *, class Component *, struct __false_type)':
/dos/peter/ftp/gcc/egcs-971008/libstdc++/stl/algobase.h:548: warning: control reaches end of non-void function `__uninitialized_copy_aux<const Component *, Component *>(const Component *, const Component *, Component *, __false_type)'
/dos/peter/ftp/gcc/egcs-971008/libstdc++/stl/vector.h: In method `class Component * vector<Component,__default_alloc_template<false,0> >::allocate_and_copy<Component, __default_alloc_template<false,0>>(unsigned int, const class Component *, const class Co
mponent *)':
/dos/peter/ftp/gcc/egcs-971008/libstdc++/stl/vector.h:221: warning: control reaches end of non-void function `vector<Component,__default_alloc_template<false,0> >::allocate_and_copy<Component, __default_alloc_template<false,0>>(unsigned int, const Compone
nt *, const Component *)'
FAIL: g++.jason/template31.C (test for excess errors)
/dos/peter/ftp/gcc/egcs-971008/libstdc++/stl/algobase.h:548: warning: control reaches end of non-void function `__uninitialized_copy_aux<const Component *, Component *>(const Component *, const Component *, Component *, __false_type)'
/dos/peter/ftp/gcc/egcs-971008/libstdc++/stl/vector.h:221: warning: control reaches end of non-void function `vector<Component,__default_alloc_template<false,0> >::allocate_and_copy<Component, __default_alloc_template<false,0>>(unsigned int, const Compone
nt *, const Component *)'



2. While compiling g++.mike/ambig1.C I get an recoverable compiler error.
  What is that?

/dos/peter/ftp/gcc/egcs-971008/gcc/testsuite/g++.old-deja/g++.mike/ambig1.C:24:
everyvirtual function must have a unique final overrider
/dos/peter/ftp/gcc/egcs-971008/gcc/testsuite/g++.old-deja/g++.mike/ambig1.C:24: 
found two (or more) `M' class subobjects in `D'
/dos/peter/ftp/gcc/egcs-971008/gcc/testsuite/g++.old-deja/g++.mike/ambig1.C:24: 
with virtual `M::f()' from virtual base class
/dos/peter/ftp/gcc/egcs-971008/gcc/testsuite/g++.old-deja/g++.mike/ambig1.C:
In method `D::D()': 
/dos/peter/ftp/gcc/egcs-971008/gcc/testsuite/g++.old-deja/g++.mike/ambig1.C:24:
warning: recoverable compiler error, fixups for virtual function

Thanks for your great work! 

Peter