* -O3 and -ftree-vectorize @ 2014-02-06 18:51 Uros Bizjak 2014-02-06 19:01 ` Xinliang David Li 2014-02-06 22:21 ` Tim Prince 0 siblings, 2 replies; 9+ messages in thread From: Uros Bizjak @ 2014-02-06 18:51 UTC (permalink / raw) To: GCC Development; +Cc: Jakub Jelinek, Richard Biener Hello! 4.9 does not enable -ftree-vectorize for -O3 (and Ofast) anymore. Is this intentional? $/ssd/uros/gcc-build/gcc/xgcc -B /ssd/uros/gcc-build/gcc -O3 -Q --help=optimizers ... -ftree-vectorize [disabled] ... This is the reason for low scores on SciMark v2.0 as conducted by Phoronix. Please see comment #18 in [1]. [1] http://phoronix.com/forums/showthread.php?95147-Clang-s-Competition-For-GCC-On-Intel-Haswell/page2 Uros. ^ permalink raw reply [flat|nested] 9+ messages in thread
* Re: -O3 and -ftree-vectorize 2014-02-06 18:51 -O3 and -ftree-vectorize Uros Bizjak @ 2014-02-06 19:01 ` Xinliang David Li 2014-02-06 19:20 ` Uros Bizjak 2014-02-06 22:21 ` Tim Prince 1 sibling, 1 reply; 9+ messages in thread From: Xinliang David Li @ 2014-02-06 19:01 UTC (permalink / raw) To: Uros Bizjak; +Cc: GCC Development, Jakub Jelinek, Richard Biener It is a bug in the help message dump. You can see that ftree-loop-vectorize ftree-slp-vectorize are indeed enabled. David On Thu, Feb 6, 2014 at 10:51 AM, Uros Bizjak <ubizjak@gmail.com> wrote: > Hello! > > 4.9 does not enable -ftree-vectorize for -O3 (and Ofast) anymore. Is > this intentional? > > $/ssd/uros/gcc-build/gcc/xgcc -B /ssd/uros/gcc-build/gcc -O3 -Q > --help=optimizers > > ... > -ftree-vectorize [disabled] > ... > > This is the reason for low scores on SciMark v2.0 as conducted by > Phoronix. Please see comment #18 in [1]. > > [1] http://phoronix.com/forums/showthread.php?95147-Clang-s-Competition-For-GCC-On-Intel-Haswell/page2 > > Uros. ^ permalink raw reply [flat|nested] 9+ messages in thread
* Re: -O3 and -ftree-vectorize 2014-02-06 19:01 ` Xinliang David Li @ 2014-02-06 19:20 ` Uros Bizjak 2014-02-06 19:23 ` Xinliang David Li 0 siblings, 1 reply; 9+ messages in thread From: Uros Bizjak @ 2014-02-06 19:20 UTC (permalink / raw) To: Xinliang David Li; +Cc: GCC Development, Jakub Jelinek, Richard Biener On Thu, Feb 6, 2014 at 8:01 PM, Xinliang David Li <davidxl@google.com> wrote: > It is a bug in the help message dump. You can see that > ftree-loop-vectorize ftree-slp-vectorize are indeed enabled. I see. It would be also nice to fix -O3 entry in doc/invoke.texi that currently reads: --cut here-- @item -O3 @opindex O3 Optimize yet more. @option{-O3} turns on all optimizations specified by @option{-O2} and also turns on the @option{-finline-functions}, @option{-funswitch-loops}, @option{-fpredictive-commoning}, @option{-fgcse-after-reload}, @option{-ftree-loop-vectorize}, @option{-ftree-slp-vectorize}, @option{-fvect-cost-model}, @option{-ftree-partial-pre} and @option{-fipa-cp-clone} options. --cut here-- Uros. ^ permalink raw reply [flat|nested] 9+ messages in thread
* Re: -O3 and -ftree-vectorize 2014-02-06 19:20 ` Uros Bizjak @ 2014-02-06 19:23 ` Xinliang David Li 0 siblings, 0 replies; 9+ messages in thread From: Xinliang David Li @ 2014-02-06 19:23 UTC (permalink / raw) To: Uros Bizjak; +Cc: GCC Development, Jakub Jelinek, Richard Biener The invoke.texi is correct. -ftree-vectorize is now simply a short-hand to enable both loop and slp vectorizer. I will fix the the help message appropriately. David On Thu, Feb 6, 2014 at 11:20 AM, Uros Bizjak <ubizjak@gmail.com> wrote: > On Thu, Feb 6, 2014 at 8:01 PM, Xinliang David Li <davidxl@google.com> wrote: >> It is a bug in the help message dump. You can see that >> ftree-loop-vectorize ftree-slp-vectorize are indeed enabled. > > I see. It would be also nice to fix -O3 entry in doc/invoke.texi that > currently reads: > > --cut here-- > @item -O3 > @opindex O3 > Optimize yet more. @option{-O3} turns on all optimizations specified > by @option{-O2} and also turns on the @option{-finline-functions}, > @option{-funswitch-loops}, @option{-fpredictive-commoning}, > @option{-fgcse-after-reload}, @option{-ftree-loop-vectorize}, > @option{-ftree-slp-vectorize}, @option{-fvect-cost-model}, > @option{-ftree-partial-pre} and @option{-fipa-cp-clone} options. > --cut here-- > > Uros. ^ permalink raw reply [flat|nested] 9+ messages in thread
* Re: -O3 and -ftree-vectorize 2014-02-06 18:51 -O3 and -ftree-vectorize Uros Bizjak 2014-02-06 19:01 ` Xinliang David Li @ 2014-02-06 22:21 ` Tim Prince 2014-02-06 22:29 ` Xinliang David Li 2014-02-07 15:22 ` Jakub Jelinek 1 sibling, 2 replies; 9+ messages in thread From: Tim Prince @ 2014-02-06 22:21 UTC (permalink / raw) To: gcc On 2/6/2014 1:51 PM, Uros Bizjak wrote: > Hello! > > 4.9 does not enable -ftree-vectorize for -O3 (and Ofast) anymore. Is > this intentional? > > $/ssd/uros/gcc-build/gcc/xgcc -B /ssd/uros/gcc-build/gcc -O3 -Q > --help=optimizers > > ... > -ftree-vectorize [disabled] > ... > > I'm seeing vectorization but no output from -ftree-vectorizer-verbose, and no dot product vectorization inside omp parallel regions, with gcc g++ or gfortran 4.9. Primary targets are cygwin64 and linux x86_64. I've been unable to use -O3 vectorization with gcc, although it works with gfortran and g++, so use gcc -O2 -ftree-vectorize together with additional optimization flags which don't break. I've made source code changes to take advantage of the new vectorization with merge() and ? operators; while it's useful for -march=core-avx2, it's sometimes a loss for -msse4.1. gcc vectorization with #pragma omp parallel for simd is reasonably effective in my tests only on 12 or more cores. #pragma omp simd reduction(max: ) is giving correct results but poor performance in my tests. You've probably seen my gcc testresults posts. The one major recent improvement is the ability to skip cilkplus tests on targets where it's totally unsupported. Without cilk_for et al. even on "supported" targets cilkplus seems useless. There are still lots of failing stabs tests on targets where those apparently aren't supported. So there are some mysteries about what the developers intend. I suppose this was posted on gcc list on account of such questions being ignored on gcc-help. -- Tim Prince ^ permalink raw reply [flat|nested] 9+ messages in thread
* Re: -O3 and -ftree-vectorize 2014-02-06 22:21 ` Tim Prince @ 2014-02-06 22:29 ` Xinliang David Li 2014-02-07 15:22 ` Jakub Jelinek 1 sibling, 0 replies; 9+ messages in thread From: Xinliang David Li @ 2014-02-06 22:29 UTC (permalink / raw) To: tprince; +Cc: gcc On Thu, Feb 6, 2014 at 2:21 PM, Tim Prince <n8tm@aol.com> wrote: > > On 2/6/2014 1:51 PM, Uros Bizjak wrote: >> >> Hello! >> >> 4.9 does not enable -ftree-vectorize for -O3 (and Ofast) anymore. Is >> this intentional? >> >> $/ssd/uros/gcc-build/gcc/xgcc -B /ssd/uros/gcc-build/gcc -O3 -Q >> --help=optimizers >> >> ... >> -ftree-vectorize [disabled] >> ... >> >> > I'm seeing vectorization but no output from -ftree-vectorizer-verbose, use -fopt-info. The old option is deprecated. >and > no dot product vectorization inside omp parallel regions, with gcc g++ or > gfortran 4.9. Primary targets are cygwin64 and linux x86_64. > I've been unable to use -O3 vectorization with gcc, although it works with > gfortran and g++, so use gcc -O2 -ftree-vectorize together with additional > optimization flags which don't break. Reproducible case? David > I've made source code changes to take advantage of the new vectorization > with merge() and ? operators; while it's useful for -march=core-avx2, it's > sometimes a loss for -msse4.1. > gcc vectorization with #pragma omp parallel for simd is reasonably effective > in my tests only on 12 or more cores. > #pragma omp simd reduction(max: ) is giving correct results but poor > performance in my tests. > > You've probably seen my gcc testresults posts. The one major recent > improvement is the ability to skip cilkplus tests on targets where it's > totally unsupported. Without cilk_for et al. even on "supported" targets > cilkplus seems useless. > There are still lots of failing stabs tests on targets where those > apparently aren't supported. > > So there are some mysteries about what the developers intend. I suppose > this was posted on gcc list on account of such questions being ignored on > gcc-help. > > -- > Tim Prince > ^ permalink raw reply [flat|nested] 9+ messages in thread
* Re: -O3 and -ftree-vectorize 2014-02-06 22:21 ` Tim Prince 2014-02-06 22:29 ` Xinliang David Li @ 2014-02-07 15:22 ` Jakub Jelinek 2014-02-07 16:09 ` Tim Prince 1 sibling, 1 reply; 9+ messages in thread From: Jakub Jelinek @ 2014-02-07 15:22 UTC (permalink / raw) To: tprince; +Cc: gcc On Thu, Feb 06, 2014 at 05:21:00PM -0500, Tim Prince wrote: > I'm seeing vectorization but no output from > -ftree-vectorizer-verbose, and no dot product vectorization inside > omp parallel regions, with gcc g++ or gfortran 4.9. Primary targets > are cygwin64 and linux x86_64. > I've been unable to use -O3 vectorization with gcc, although it > works with gfortran and g++, so use gcc -O2 -ftree-vectorize > together with additional optimization flags which don't break. Can you file a GCC bugzilla PR with minimal testcases for this (or point us at already filed bugreports)? > I've made source code changes to take advantage of the new > vectorization with merge() and ? operators; while it's useful for > -march=core-avx2, it's sometimes a loss for -msse4.1. > gcc vectorization with #pragma omp parallel for simd is reasonably > effective in my tests only on 12 or more cores. Likewise. > #pragma omp simd reduction(max: ) is giving correct results but poor > performance in my tests. Likewise. Jakub ^ permalink raw reply [flat|nested] 9+ messages in thread
* Re: -O3 and -ftree-vectorize 2014-02-07 15:22 ` Jakub Jelinek @ 2014-02-07 16:09 ` Tim Prince 2014-02-08 14:45 ` Tim Prince 0 siblings, 1 reply; 9+ messages in thread From: Tim Prince @ 2014-02-07 16:09 UTC (permalink / raw) To: Jakub Jelinek, tprince; +Cc: gcc On 02/07/2014 10:22 AM, Jakub Jelinek wrote: > On Thu, Feb 06, 2014 at 05:21:00PM -0500, Tim Prince wrote: >> I'm seeing vectorization but no output from >> -ftree-vectorizer-verbose, and no dot product vectorization inside >> omp parallel regions, with gcc g++ or gfortran 4.9. Primary targets >> are cygwin64 and linux x86_64. >> I've been unable to use -O3 vectorization with gcc, although it >> works with gfortran and g++, so use gcc -O2 -ftree-vectorize >> together with additional optimization flags which don't break. > Can you file a GCC bugzilla PR with minimal testcases for this (or point us > at already filed bugreports)? The question of problems with gcc -O3 (called from gfortran) have eluded me as to finding a minimal test case. When I run under debug, it appears that somewhere prior to the crash some gfortran code is over-written with data by the gcc code, overwhelming my debugging skill. I can get full performance with -O2 plus a bunch of intermediate flags. As to non-vectorization of dot product in omp parallel region, -fopt-info (which I didn't know about) is reporting vectorization, but there are no parallel simd instructions in the generated code for the omp_fn. I'll file a PR on that if it's still reproduced in a minimal case. > >> I've made source code changes to take advantage of the new >> vectorization with merge() and ? operators; while it's useful for >> -march=core-avx2, it's sometimes a loss for -msse4.1. >> gcc vectorization with #pragma omp parallel for simd is reasonably >> effective in my tests only on 12 or more cores. > Likewise. Those are cases of 2 levels of loops from netlib "vector" benchmark where only one level is vectorizable and parallelizable. By putting the vectorizable loop on the outside the parallelization scales to a large number of cores. I don't expect it to out-perform single thread optimized avx vectorization until 8 or more cores are in use, but it needs more than expected number of threads even relative to SSE vectorization. > >> #pragma omp simd reduction(max: ) is giving correct results but poor >> performance in my tests. > Likewise. I'll file a PR on this, didn't know if there might be interest. I have an Intel compiler issue "closed, will not be fixed" so the simd reduction(max: ) isn't viable for icc in the near term. Thanks, ^ permalink raw reply [flat|nested] 9+ messages in thread
* Re: -O3 and -ftree-vectorize 2014-02-07 16:09 ` Tim Prince @ 2014-02-08 14:45 ` Tim Prince 0 siblings, 0 replies; 9+ messages in thread From: Tim Prince @ 2014-02-08 14:45 UTC (permalink / raw) To: Jakub Jelinek, tprince; +Cc: gcc On 2/7/2014 11:09 AM, Tim Prince wrote: > > On 02/07/2014 10:22 AM, Jakub Jelinek wrote: >> On Thu, Feb 06, 2014 at 05:21:00PM -0500, Tim Prince wrote: >>> I'm seeing vectorization but no output from >>> -ftree-vectorizer-verbose, and no dot product vectorization inside >>> omp parallel regions, with gcc g++ or gfortran 4.9. Primary targets >>> are cygwin64 and linux x86_64. >>> I've been unable to use -O3 vectorization with gcc, although it >>> works with gfortran and g++, so use gcc -O2 -ftree-vectorize >>> together with additional optimization flags which don't break. >> Can you file a GCC bugzilla PR with minimal testcases for this (or >> point us >> at already filed bugreports)? > The question of problems with gcc -O3 (called from gfortran) have > eluded me as to finding a minimal test case. When I run under debug, > it appears that somewhere prior to the crash some gfortran code is > over-written with data by the gcc code, overwhelming my debugging > skill. I can get full performance with -O2 plus a bunch of > intermediate flags. > As to non-vectorization of dot product in omp parallel region, > -fopt-info (which I didn't know about) is reporting vectorization, but > there are no parallel simd instructions in the generated code for the > omp_fn. I'll file a PR on that if it's still reproduced in a minimal > case. > >> >>> I've made source code changes to take advantage of the new >>> vectorization with merge() and ? operators; while it's useful for >>> -march=core-avx2, it's sometimes a loss for -msse4.1. >>> gcc vectorization with #pragma omp parallel for simd is reasonably >>> effective in my tests only on 12 or more cores. >> Likewise. > Those are cases of 2 levels of loops from netlib "vector" benchmark > where only one level is vectorizable and parallelizable. By putting > the vectorizable loop on the outside the parallelization scales to a > large number of cores. I don't expect it to out-perform single thread > optimized avx vectorization until 8 or more cores are in use, but it > needs more than expected number of threads even relative to SSE > vectorization. >> >>> #pragma omp simd reduction(max: ) is giving correct results but poor >>> performance in my tests. >> Likewise. > I'll file a PR on this, didn't know if there might be interest. I > have an Intel compiler issue "closed, will not be fixed" so the simd > reduction(max: ) isn't viable for icc in the near term. > Thanks, > With further investigation, my case with reverse_copy outside and inner_product inside an omp parallel region is working very well with -O3 -ffast-math for double data type. There seems a possible performance problem with reverse_copy for float data type, so much so that gfortran does better with the loop reversal pushed down into the parallel dot_products. I have seen at least 2 cases where the new gcc vectorization of stride -1 with vpermd is superior to other compilers, even for float data type. For the cases where omp parallel for simd is set in expectation of gaining outer loop parallel simd, gcc is ignoring the simd clause. So it is understandable that a large number of cores is needed to overcome the lack of parallel simd (other than by simd intrinsics coding). I'll choose an example of omp simd reduction(max: ) for a PR. Thanks. -- Tim Prince ^ permalink raw reply [flat|nested] 9+ messages in thread
end of thread, other threads:[~2014-02-08 14:45 UTC | newest] Thread overview: 9+ messages (download: mbox.gz / follow: Atom feed) -- links below jump to the message on this page -- 2014-02-06 18:51 -O3 and -ftree-vectorize Uros Bizjak 2014-02-06 19:01 ` Xinliang David Li 2014-02-06 19:20 ` Uros Bizjak 2014-02-06 19:23 ` Xinliang David Li 2014-02-06 22:21 ` Tim Prince 2014-02-06 22:29 ` Xinliang David Li 2014-02-07 15:22 ` Jakub Jelinek 2014-02-07 16:09 ` Tim Prince 2014-02-08 14:45 ` Tim Prince
This is a public inbox, see mirroring instructions for how to clone and mirror all data and code used for this inbox; as well as URLs for read-only IMAP folder(s) and NNTP newsgroup(s).