970929 g++ OpenServer test results.

970929 g++ OpenServer test results.

[Robert Lipe]

My EH tests are in an uproar right now.   It's almost certainly
becuase I have DWARF2_UNWIND set to zero and have some half-done
stuff to try to make it all fly right on this wierd ELF/COFF mixture.
I thought it was falling back to sjlj, but I must be wrong.

Also, (Taaa Daaa), this is the first time I've been able to execute
runtest and have it automatically run for both ELF and COFF.  Many
thanx to Jeff and Bob for the help on that.

Test Run By robertl on Wed Oct  1 16:38:27 1997
Native configuration is i586-pc-sco3.2v5.0.4

                === g++ tests ===

Running target unix/-mcoff
Using /usr/local/bin/../share/dejagnu/baseboards/unix.exp as board description f
ile for target.
Using /usr/local/bin/../share/dejagnu/config/unix.exp as generic interface file
for target.
Using /play/egcs-970917/gcc/testsuite/config/default.exp as tool-and-target-spec
ific interface file.
Running /play/egcs-970917/gcc/testsuite/g++.old-deja/old-deja.exp ...
FAIL: g++.brendan/template9.C (test for excess errors)
FAIL: g++.bugs/900514_03.C (test for excess errors)
FAIL: g++.jason/operator.C overloaded (test for errors, line 13)
FAIL: g++.jason/operator.C overloaded (test for errors, line 14)
FAIL: g++.jason/tempinst1.C (test for excess errors)
FAIL: g++.jason/template13.C (test for excess errors)
FAIL: g++.jason/template31.C (test for excess errors)
FAIL: g++.jason/template38.C (test for excess errors)
FAIL: g++.law/missed-error2.C extern (test for errors, line 20)
FAIL: g++.law/profile1.C (test for excess errors)
FAIL: g++.law/template2.C (test for excess errors)
XPASS: g++.law/temps7.C (test for excess errors)
FAIL: g++.mike/dyncast1.C  Execution test
FAIL: g++.mike/dyncast2.C  Execution test
FAIL: g++.mike/eh10.C  Execution test
FAIL: g++.mike/eh12.C  Execution test
FAIL: g++.mike/eh14.C  Execution test
FAIL: g++.mike/eh16.C  Execution test
FAIL: g++.mike/eh17.C  Execution test
FAIL: g++.mike/eh18.C  Execution test
FAIL: g++.mike/eh2.C  Execution test
FAIL: g++.mike/eh21.C  Execution test
FAIL: g++.mike/eh24.C  Execution test
FAIL: g++.mike/eh25.C  Execution test
FAIL: g++.mike/eh26.C  Execution test
FAIL: g++.mike/eh27.C  Execution test
FAIL: g++.mike/eh28.C  Execution test
FAIL: g++.mike/eh29.C  Execution test
FAIL: g++.mike/eh3.C  Execution test
FAIL: g++.mike/eh31.C  Execution test
FAIL: g++.mike/eh33.C  Execution test
FAIL: g++.mike/eh34.C  Execution test
FAIL: g++.mike/eh35.C  Execution test
FAIL: g++.mike/eh36.C  Execution test
FAIL: g++.mike/eh37.C  Execution test
FAIL: g++.mike/eh38.C  Execution test
FAIL: g++.mike/eh39.C  Execution test
FAIL: g++.mike/eh40.C  Execution test
FAIL: g++.mike/eh41.C  Execution test
FAIL: g++.mike/eh42.C  Execution test
FAIL: g++.mike/eh44.C  Execution test
FAIL: g++.mike/eh47.C  Execution test
FAIL: g++.mike/eh48.C  Execution test
FAIL: g++.mike/eh49.C  Execution test
FAIL: g++.mike/eh5.C  Execution test
FAIL: g++.mike/eh50.C  Execution test
FAIL: g++.mike/eh51.C  Execution test
FAIL: g++.mike/eh6.C  Execution test
FAIL: g++.mike/eh8.C  Execution test
FAIL: g++.mike/p710.C previous declaration as.* (test for errors, line 32)
FAIL: g++.mike/p710.C .B::operator.*overloaded (test for errors, line 35)
FAIL: g++.mike/p7912.C  Execution test
FAIL: g++.mike/p9706.C  Execution test
FAIL: g++.mike/p9732b.C  Execution test
FAIL: g++.pt/memtemp20.C (test for excess errors)

                === g++ Summary for unix/-mcoff ===

# of expected passes            3264
# of unexpected failures        54
# of unexpected successes       1
# of expected failures          85
# of untested testcases         6
Running target unix/-melf
Using /usr/local/bin/../share/dejagnu/baseboards/unix.exp as board description f
ile for target.
Using /usr/local/bin/../share/dejagnu/config/unix.exp as generic interface file
for target.
Using /play/egcs-970917/gcc/testsuite/config/default.exp as tool-and-target-spec
ific interface file.
Running /play/egcs-970917/gcc/testsuite/g++.old-deja/old-deja.exp ...
FAIL: g++.brendan/template9.C (test for excess errors)
FAIL: g++.bugs/900514_03.C (test for excess errors)
FAIL: g++.jason/operator.C overloaded (test for errors, line 13)
FAIL: g++.jason/operator.C overloaded (test for errors, line 14)
FAIL: g++.jason/tempinst1.C (test for excess errors)
FAIL: g++.jason/template13.C (test for excess errors)
FAIL: g++.jason/template31.C (test for excess errors)
FAIL: g++.jason/template38.C (test for excess errors)
FAIL: g++.law/missed-error2.C extern (test for errors, line 20)
FAIL: g++.law/profile1.C (test for excess errors)
FAIL: g++.law/template2.C (test for excess errors)
XPASS: g++.law/temps7.C (test for excess errors)
FAIL: g++.mike/dyncast1.C  Execution test
FAIL: g++.mike/dyncast2.C  Execution test
FAIL: g++.mike/eh10.C  Execution test
FAIL: g++.mike/eh12.C  Execution test
FAIL: g++.mike/eh14.C  Execution test
FAIL: g++.mike/eh16.C  Execution test
FAIL: g++.mike/eh17.C  Execution test
FAIL: g++.mike/eh18.C  Execution test
FAIL: g++.mike/eh2.C  Execution test
FAIL: g++.mike/eh21.C  Execution test
FAIL: g++.mike/eh24.C  Execution test
FAIL: g++.mike/eh25.C  Execution test
FAIL: g++.mike/eh26.C  Execution test
FAIL: g++.mike/eh27.C  Execution test
FAIL: g++.mike/eh28.C  Execution test
FAIL: g++.mike/eh29.C  Execution test
FAIL: g++.mike/eh3.C  Execution test
FAIL: g++.mike/eh31.C  Execution test
FAIL: g++.mike/eh33.C  Execution test
FAIL: g++.mike/eh34.C  Execution test
FAIL: g++.mike/eh35.C  Execution test
FAIL: g++.mike/eh36.C  Execution test
FAIL: g++.mike/eh37.C  Execution test
FAIL: g++.mike/eh38.C  Execution test
FAIL: g++.mike/eh39.C  Execution test
FAIL: g++.mike/eh40.C  Execution test
FAIL: g++.mike/eh41.C  Execution test
FAIL: g++.mike/eh42.C  Execution test
FAIL: g++.mike/eh44.C  Execution test
FAIL: g++.mike/eh47.C  Execution test
FAIL: g++.mike/eh48.C  Execution test
FAIL: g++.mike/eh49.C  Execution test
FAIL: g++.mike/eh5.C  Execution test
FAIL: g++.mike/eh50.C  Execution test
FAIL: g++.mike/eh51.C  Execution test
FAIL: g++.mike/eh6.C  Execution test
FAIL: g++.mike/eh8.C  Execution test
FAIL: g++.mike/p710.C previous declaration as.* (test for errors, line 32)
FAIL: g++.mike/p710.C .B::operator.*overloaded (test for errors, line 35)
FAIL: g++.mike/p7912.C  Execution test
FAIL: g++.mike/p9706.C  Execution test
FAIL: g++.mike/p9732b.C  Execution test
FAIL: g++.pt/memtemp20.C (test for excess errors)

                === g++ Summary for unix/-melf ===

# of expected passes            3264
# of unexpected failures        54
# of unexpected successes       1
# of expected failures          85
# of untested testcases         6

                === g++ Summary ===

# of expected passes            6528
# of unexpected failures        108
# of unexpected successes       2
# of expected failures          170
# of untested testcases         12
negcs version egcs-2.90.11 970929 (gcc2-970802 experimental)

-- 
Robert Lipe       http://www.dgii.com/people/robertl       robertl@dgii.com

Re: 970929 gcc OpenServer test results.

[Robert Lipe]

Robert Lipe wrote:

> Also, (Taaa Daaa), this is the first time I've been able to execute
> runtest and have it automatically run for both ELF and COFF.  Many
> thanx to Jeff and Bob for the help on that.

Ooooh.  Ahaaaah.   GCC works Very Well on this target now and the 
multilib-aware runtest string worked.    I'm impressed.


Test Run By robertl on Wed Oct  1 21:00:12 1997
Native configuration is i586-pc-sco3.2v5.0.4

		=== gcc tests ===

Running target unix/-mcoff
Running /play/egcs-970917/gcc/testsuite/gcc.c-torture/code_quality/code_quality.exp ...
Running /play/egcs-970917/gcc/testsuite/gcc.c-torture/compile/compile.exp ...
FAIL: gcc.c-torture/compile/961203-1.c,  -O0  
FAIL: gcc.c-torture/compile/961203-1.c,  -O1  
FAIL: gcc.c-torture/compile/961203-1.c,  -O2  
FAIL: gcc.c-torture/compile/961203-1.c,  -O2 -fomit-frame-pointer -finline-functions  
Running /play/egcs-970917/gcc/testsuite/gcc.c-torture/execute/execute.exp ...
Running /play/egcs-970917/gcc/testsuite/gcc.c-torture/execute/ieee/ieee.exp ...
Running /play/egcs-970917/gcc/testsuite/gcc.c-torture/noncompile/noncompile.exp ...
Running /play/egcs-970917/gcc/testsuite/gcc.c-torture/special/special.exp ...
Running /play/egcs-970917/gcc/testsuite/gcc.c-torture/unsorted/unsorted.exp ...
Running /play/egcs-970917/gcc/testsuite/gcc.dg/dg.exp ...
Running /play/egcs-970917/gcc/testsuite/gcc.failure/failure.exp ...
Running /play/egcs-970917/gcc/testsuite/gcc.misc-tests/acker1.exp ...
Running /play/egcs-970917/gcc/testsuite/gcc.misc-tests/dg-test.exp ...
Running /play/egcs-970917/gcc/testsuite/gcc.misc-tests/dhry.exp ...
Running /play/egcs-970917/gcc/testsuite/gcc.misc-tests/gcov.exp ...
FAIL: gcov failed: couldn't execute "gcov": no such file or directory
Running /play/egcs-970917/gcc/testsuite/gcc.misc-tests/matrix1.exp ...
Running /play/egcs-970917/gcc/testsuite/gcc.misc-tests/mg.exp ...
Running /play/egcs-970917/gcc/testsuite/gcc.misc-tests/msgs.exp ...
Running /play/egcs-970917/gcc/testsuite/gcc.misc-tests/optbench.exp ...
Running /play/egcs-970917/gcc/testsuite/gcc.misc-tests/sieve.exp ...
Running /play/egcs-970917/gcc/testsuite/gcc.misc-tests/sort2.exp ...

		=== gcc Summary for unix/-mcoff ===

# of expected passes		4874
# of unexpected failures	5
# of expected failures		4
# of unsupported tests		7
Running target unix/-melf
Running /play/egcs-970917/gcc/testsuite/gcc.c-torture/code_quality/code_quality.exp ...
Running /play/egcs-970917/gcc/testsuite/gcc.c-torture/compile/compile.exp ...
FAIL: gcc.c-torture/compile/961203-1.c,  -O0  
FAIL: gcc.c-torture/compile/961203-1.c,  -O1  
FAIL: gcc.c-torture/compile/961203-1.c,  -O2  
FAIL: gcc.c-torture/compile/961203-1.c,  -O2 -fomit-frame-pointer -finline-functions  
Running /play/egcs-970917/gcc/testsuite/gcc.c-torture/execute/execute.exp ...
Running /play/egcs-970917/gcc/testsuite/gcc.c-torture/execute/ieee/ieee.exp ...
Running /play/egcs-970917/gcc/testsuite/gcc.c-torture/noncompile/noncompile.exp ...
Running /play/egcs-970917/gcc/testsuite/gcc.c-torture/special/special.exp ...
Running /play/egcs-970917/gcc/testsuite/gcc.c-torture/unsorted/unsorted.exp ...
Running /play/egcs-970917/gcc/testsuite/gcc.dg/dg.exp ...
Running /play/egcs-970917/gcc/testsuite/gcc.failure/failure.exp ...
Running /play/egcs-970917/gcc/testsuite/gcc.misc-tests/acker1.exp ...
Running /play/egcs-970917/gcc/testsuite/gcc.misc-tests/dg-test.exp ...
Running /play/egcs-970917/gcc/testsuite/gcc.misc-tests/dhry.exp ...
Running /play/egcs-970917/gcc/testsuite/gcc.misc-tests/gcov.exp ...
FAIL: gcov failed: couldn't execute "gcov": no such file or directory
Running /play/egcs-970917/gcc/testsuite/gcc.misc-tests/matrix1.exp ...
Running /play/egcs-970917/gcc/testsuite/gcc.misc-tests/mg.exp ...
Running /play/egcs-970917/gcc/testsuite/gcc.misc-tests/msgs.exp ...
Running /play/egcs-970917/gcc/testsuite/gcc.misc-tests/optbench.exp ...
Running /play/egcs-970917/gcc/testsuite/gcc.misc-tests/sieve.exp ...
Running /play/egcs-970917/gcc/testsuite/gcc.misc-tests/sort2.exp ...

		=== gcc Summary for unix/-melf ===

# of expected passes		4874
# of unexpected failures	5
# of expected failures		4
# of unsupported tests		7

		=== gcc Summary ===

# of expected passes		9748
# of unexpected failures	10
# of expected failures		8
# of unsupported tests		14
negcs version egcs-2.90.11 970929 (gcc2-970802 experimental)

Updated g++ 970929 OpenServer results.

[Robert Lipe]

More detailed analysis in this one, becuase we're finally at a point
where we can start to focus on individual cases.   The ones that 
just plain won't compile seem like a good starting place.

Robert Lipe wrote:
> My EH tests are in an uproar right now.   It's almost certainly
> becuase I have DWARF2_UNWIND set to zero and have some half-done
> stuff to try to make it all fly right on this wierd ELF/COFF mixture.
> I thought it was falling back to sjlj, but I must be wrong.

I applied the patches that Jason and I worked out last night, performed
another 'make bootstrap'.   Now the EH tests are much less wierd and
both COFF and ELF are failing the same tests.  This is a Very Good Thing.

                === g++ tests ===

Running target unix/-mcoff
FAIL: g++.brendan/template9.C (test for excess errors)

This fails with undefined symbol for min(double, double).  This is
almost certainly a fixincludes error.   I'll look into it.


FAIL: g++.bugs/900514_03.C (test for excess errors)

/play/egcs-970917/gcc/testsuite/g++.old-deja/g++.bugs/900514_03.C:107: no match
for `t_2_st_1 & = t_2_st_0 &'
/play/egcs-970917/gcc/testsuite/g++.old-deja/g++.bugs/900514_03.C:91: candidates
 are: t_2_st_1::operator =(const t_2_st_1 &) <near match>
/play/egcs-970917/gcc/testsuite/g++.old-deja/g++.bugs/900514_03.C:113: conversio
n from `t_2_st_0' to `t_2_st_1' is ambiguous
/play/egcs-970917/gcc/testsuite/g++.old-deja/g++.bugs/900514_03.C:96: candidates
 are: t_2_st_0::operator t_2_st_1()
/play/egcs-970917/gcc/testsuite/g++.old-deja/g++.bugs/900514_03.C:89:
      t_2_st_1::t_2_st_1(t_2_st_0)




FAIL: g++.jason/operator.C overloaded (test for errors, line 13)
FAIL: g++.jason/operator.C overloaded (test for errors, line 14)
FAIL: g++.jason/tempinst1.C (test for excess errors)

tempinst1.C fails with:

Undefined                       first referenced
 symbol                             in file
operator<<(ostream &, foo<int> &)   /usr/tmp/cca0063R1.o


FAIL: g++.jason/template13.C (test for excess errors)

This is another min() problem.


FAIL: g++.jason/template31.C (test for excess errors)
FAIL: g++.jason/template38.C (test for excess errors)

template38.C fails with:

Undefined                       first referenced
 symbol                             in file
operator==(A const &, A const &)    /usr/tmp/cca0067R1.o



FAIL: g++.law/missed-error2.C extern (test for errors, line 20)
FAIL: g++.law/profile1.C (test for excess errors)
FAIL: g++.law/template2.C (test for excess errors)

A max() problem.

XPASS: g++.law/temps7.C (test for excess errors)
FAIL: g++.mike/p710.C previous declaration as.* (test for errors, line 32)
FAIL: g++.mike/p710.C .B::operator.*overloaded (test for errors, line 35)
FAIL: g++.mike/p9732b.C  Execution test
FAIL: g++.pt/memtemp20.C (test for excess errors)
This one fails with:
/play/egcs-970917/gcc/testsuite/g++.old-deja/g++.pt/memtemp20.C:15: Specializati
on of `foo' does not match any template declaration.
/play/egcs-970917/gcc/testsuite/g++.old-deja/g++.pt/memtemp20.C:33: Specializati
on of `foo' does not match any template declaration.
/play/egcs-970917/gcc/testsuite/g++.old-deja/g++.pt/memtemp20.C:33: confused by
earlier errors, bailing out

Re: Updated g++ 970929 OpenServer results.

[Jason Merrill]

A bunch of these failures are because your testsuite is out of date.

Jason

Re: Updated Updated g++ 970929 OpenServer results.

[Robert Lipe]

> A bunch of these failures are because your testsuite is out of date.

D'oh!   Excellent catch, Jason.   Thanx.

Now the g++ tests look absolutely great!

I should either change profile* to be XFAIL: or (better yet) go fix 
the startups to not use the non-existent gcrt.o.   9732b looks to be
unique to OpenServer somehow.   I don't see that it failed on Linux 
x86, Alpha, MIPS, or Sparc, so it's likely something in my target.  The
other two that fail have been seen on other targets, so I'm assuming
those are a wider problem...


Test Run By robertl on Thu Oct  2 12:51:58 1997
Native configuration is i586-pc-sco3.2v5.0.4

                === g++ tests ===

FAIL: g++.jason/template31.C (test for excess errors)
FAIL: g++.law/missed-error2.C extern (test for errors, line 20)
FAIL: g++.law/profile1.C (test for excess errors)
FAIL: g++.mike/p9732b.C  Execution test

                === g++ Summary for unix/-mcoff ===

# of expected passes            3373
# of unexpected failures        4
# of expected failures          81
# of untested testcases         6

Running target unix/-melf
FAIL: g++.jason/template31.C (test for excess errors)
FAIL: g++.law/missed-error2.C extern (test for errors, line 20)
FAIL: g++.law/profile1.C (test for excess errors)
FAIL: g++.mike/p9732b.C  Execution test

                === g++ Summary for unix/-melf ===

# of expected passes            3373
# of unexpected failures        4
# of expected failures          81
# of untested testcases         6

                === g++ Summary ===

# of expected passes            6746
# of unexpected failures        8
# of expected failures          162
# of untested testcases         12
negcs version egcs-2.90.11 970929 (gcc2-970802 experimental)