public inbox for gcc@gcc.gnu.org
 help / color / mirror / Atom feed
* Results for g++ 3.1 application testing on i686-pc-linux-gnu
@ 2002-03-03 18:44 Peter Schmid
  2002-03-03 20:45 ` Craig Rodrigues
  2002-03-04 18:25 ` Benjamin Kosnik
  0 siblings, 2 replies; 24+ messages in thread
From: Peter Schmid @ 2002-03-03 18:44 UTC (permalink / raw)
  To: libstdc++; +Cc: gcc

I tested g++ 3.1 20020302 versus some applications:

Here are the results:

current boost cvs:
All tests pass. g++ does not provide the zero sized base class
optimization. Therefore, there are seven "failures" for empty_* types in
object_type_traits_test.cpp.

blitz-20001213:
Compiling wei-ku-1.cpp crashes the compiler when
optimization is on. Cf. PR c++/5504 (gcc 3.0 regression).

root_v3.02.07:
Everything works, except for test/bench.cxx, as for gcc 3.0.

pooma-gcc:
No problems detected. All tests pass.

Code from Josuttis' Book "The C++ Standard Library":

Everything works fine, except for the parsing of doubles on input when
the locale is set to de_DE (PR libstdc++/5816, grouping related) and
the unresolved state of PR libstc++/5133.

stepanov_v1p2.C:

-O
Abstraction Penalty: 1.14
-O2
Abstraction Penalty: 1.30
-O3
Abstraction Penalty: 1.30
-O2  -finline-limit=10000
Abstraction Penalty: 1.30
-O2  -finline-limit=100000
Abstraction Penalty: 1.30

mtl-2.1.2-20:
No problems detected, after applying patches for missing typename
warnings.

STLport-4.5.3
No problems detected. All tests pass.

System setup:
SuSE 7.3
Glibc 2.2.4 + patches
Linux 2.4.17
binutils version 2.11.93.0.2
g++ -v
Reading specs from /usr/local/lib/gcc-lib/i686-pc-linux-gnu/3.1/specs
Configured with: ../gcc/configure --enable-shared --disable-nls --enable-threads --enable-languages=c,c++,f77,objc
Thread model: posix
gcc version 3.1 20020302 (prerelease)

Hope this helps,

Peter Schmid

^ permalink raw reply	[flat|nested] 24+ messages in thread
* Results for g++ 3.1 application testing on i686-pc-linux-gnu
@ 2002-04-20 16:17 Peter Schmid
  0 siblings, 0 replies; 24+ messages in thread
From: Peter Schmid @ 2002-04-20 16:17 UTC (permalink / raw)
  To: libstdc++; +Cc: gcc

There are still problems with the optimizer. Higher optimization
levels lead to a pessimization with respect to -O in some cases,
confer the results for the Stepanov and the oopack tests. This is a
regression with respect to gcc 2.95.

Here are the results:

current boost cvs:
All tests pass.

blitz-20001213:
Compiling wei-ku-1.cpp crashes the compiler when
optimization is on. Cf. PR c++/5504 (gcc 3.0 regression).

root_v3.03.02:
Everything works, except for test/bench.cxx, as for gcc 3.0.

pooma-gcc:
No problems detected. All tests pass.

Code from Josuttis' Book "The C++ Standard Library":

Everything works fine, except for the unresolved state of PR libstc++/5133.

stepanov_v1p2.C:

-O0
Abstraction Penalty: 8.54
-O
Abstraction Penalty: 1.03
-O2
Abstraction Penalty: 1.27
-O3
Abstraction Penalty: 1.26
-O2  -finline-limit=10000
Abstraction Penalty: 1.26
-O2  -finline-limit=100000
Abstraction Penalty: 1.27

OOPACK Version 1.7:
Max=100000 Matrix=1000 Complex=100000 Iterator=100000

-O
                         Seconds       Mflops
Test       Iterations     C    OOP     C    OOP  Ratio
----       ----------  -----------  -----------  -----
Max            100000    1.6   2.0   61.3  48.8    1.3
Matrix           1000    3.5   4.0   71.0  63.3    1.1
Complex        100000    9.4  17.8   84.7  44.9    1.9
Iterator       100000    1.0   2.0  192.3 100.5    1.9

-O2
                         Seconds       Mflops
Test       Iterations     C    OOP     C    OOP  Ratio
----       ----------  -----------  -----------  -----
Max            100000    1.9   2.0   51.3  51.0    1.0
Matrix           1000    2.0   2.1  125.6 120.8    1.0
Complex        100000    9.4  25.8   85.1  31.0    2.7
Iterator       100000    1.1   1.3  181.8 158.7    1.1

mtl-2.1.2-20:
No problems detected, after applying patches for missing typename
warnings.

STLport-4.5.3/STLport-5.0-0409
No problems detected. All tests pass.

FTensor--main--1.1--patch-16:
No problems detected. All tests pass. Works for the first time.
Compiling some files from the conformance/T4ddg directory takes longer
than half an hour, though (test_T4ddg.C, test_T4ddgV.C). Compiling a
source file from the other directories takes less than a minute.

ACE 5.2.1:
No problems detected. All tests pass.

System setup:
SuSE 7.3
Glibc 2.2.4 + patches
Linux 2.4.18
GNU ld version 020414 20020414
g++ -v
Reading specs from /usr/local/lib/gcc-lib/i686-pc-linux-gnu/3.1/specs
Configured with: ../gcc/configure --enable-shared --disable-nls --enable-threads=posix --enable-languages=c,c++,f77,objc
Thread model: posix
gcc version 3.1 20020418 (prerelease)

Hope this helps,

Peter Schmid

^ permalink raw reply	[flat|nested] 24+ messages in thread
* Results for g++ 3.1 application testing on i686-pc-linux-gnu
@ 2002-05-05 17:29 Peter Schmid
  0 siblings, 0 replies; 24+ messages in thread
From: Peter Schmid @ 2002-05-05 17:29 UTC (permalink / raw)
  To: gcc; +Cc: mark

I have mixed feelings with the present state of the gcc 3.1 release
candidate. Although there are no regressions with respect to previous
g++ releases concerning conformance to the c++ standard, there are
still, imho severe, regressions with respect to code quality and
the optimizer. Higher optimization levels lead to a pessimization with
respect to -O in some cases, confer the results for the Stepanov and
the oopack tests. This is a regression with respect to gcc 2.95.

Running the test script, tester.pl, from pooma-gcc takes 594.4
seconds user time for gcc 3.0 in contrast to 797.3 seconds for gcc
3.1. In my opinion these compile and code quality regressions should
be resolved before gcc 3.1 is released.

Additionally, I got no feedback on PR fortran/5900, concerning LAPACK
which could be a severe regression.

Here are the results in detail:

stepanov_v1p2.C:

-O0
Abstraction Penalty: 8.45
-O
Abstraction Penalty: 1.06
-O2
Abstraction Penalty: 1.27
-O3
Abstraction Penalty: 1.24
-O2  -finline-limit=10000
Abstraction Penalty: 1.24
-O2  -finline-limit=100000
Abstraction Penalty: 1.27

OOPACK Version 1.7:
Max=100000 Matrix=1000 Complex=100000 Iterator=100000

-O
                         Seconds       Mflops
Test       Iterations     C    OOP     C    OOP  Ratio
----       ----------  -----------  -----------  -----
Max            100000    1.7   2.1   59.9  48.3    1.2
Matrix           1000    3.5   3.9   70.6  63.6    1.1
Complex        100000    9.4  17.9   84.7  44.7    1.9
Iterator       100000    1.1   2.0  190.5 100.0    1.9

-O2
                         Seconds       Mflops
----       ----------  -----------  -----------  -----
Max            100000    2.0   2.0   50.8  50.8    1.0
Matrix           1000    2.0   2.1  125.0 119.6    1.0
Complex        100000    9.4  26.2   85.1  30.5    2.8
Iterator       100000    1.1   1.3  180.2 157.5    1.1

Max(C) and Complex(OOP) are slower at -O2; Complex is considerably
slower.

current boost cvs:
All tests pass.

blitz-20001213:
All tests pass.

root_v3.03.07:
Everything works, except for test/bench.cxx, as for gcc 3.0.

pooma-gcc:
No problems detected. All tests pass.

Code from Josuttis' Book "The C++ Standard Library":

Everything works fine, except for the unresolved state of PR libstc++/5133.

mtl-2.1.2-20:
No problems detected, after applying patches for missing typename
warnings.

STLport-4.5.3/STLport-5.0-0409
No problems detected. All tests pass.

FTensor--main--1.1--patch-16:
Problems with __restrict__, cf. PR. c++/6392, already fixed on the mainline.
Regression with respect to kcc and icc. Otherwise OK.

ACE 5.2.1:
No problems detected. All tests pass.

System setup:
SuSE 7.3
Glibc 2.2.4 + patches
Linux 2.4.18
GNU ld version 020428 20020428
g++ -v
Reading specs from /usr/local/lib/gcc-lib/i686-pc-linux-gnu/3.1/specs
Configured with: ../gcc/configure --enable-shared --disable-nls --enable-threads=posix --enable-languages=c,c++,f77,objc
Thread model: posix
gcc version 3.1 20020505 (prerelease)

Hope this helps,

Peter Schmid

^ permalink raw reply	[flat|nested] 24+ messages in thread

end of thread, other threads:[~2002-05-06  0:29 UTC | newest]

Thread overview: 24+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2002-03-03 18:44 Results for g++ 3.1 application testing on i686-pc-linux-gnu Peter Schmid
2002-03-03 20:45 ` Craig Rodrigues
2002-03-03 23:55   ` Benjamin Kosnik
2002-03-04  5:54     ` Stephen M.Webb
2002-03-04  9:13       ` Benjamin Kosnik
2002-03-05 11:47       ` Stephen M. Webb
     [not found]       ` <200203051947.UAA06990@mayo.cmla.ens-cachan.fr>
2002-03-05 12:31         ` Gabriel Dos Reis
2002-03-05 13:11           ` Benjamin Kosnik
2002-03-05 14:04             ` Gabriel Dos Reis
2002-03-05 14:09               ` Benjamin Kosnik
2002-03-05 15:03             ` Richard Henderson
2002-03-05 17:25               ` Benjamin Kosnik
2002-03-05 23:00               ` Gabriel Dos Reis
2002-03-06 13:26                 ` Richard Henderson
2002-03-06  1:21               ` Gabriel Dos Reis
2002-03-06 13:30                 ` Richard Henderson
2002-03-05 15:02           ` Richard Henderson
2002-03-05 22:56             ` Gabriel Dos Reis
2002-03-07 10:47     ` Peter Schmid
2002-03-07 23:24       ` Benjamin Kosnik
2002-03-04 18:25 ` Benjamin Kosnik
2002-03-04 21:10   ` Craig Rodrigues
2002-04-20 16:17 Peter Schmid
2002-05-05 17:29 Peter Schmid

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for read-only IMAP folder(s) and NNTP newsgroup(s).