From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-yb1-xb35.google.com (mail-yb1-xb35.google.com [IPv6:2607:f8b0:4864:20::b35]) by sourceware.org (Postfix) with ESMTPS id 3C20E3858D28 for ; Tue, 20 Sep 2022 02:26:16 +0000 (GMT) DMARC-Filter: OpenDMARC Filter v1.4.1 sourceware.org 3C20E3858D28 Authentication-Results: sourceware.org; dmarc=pass (p=none dis=none) header.from=gmail.com Authentication-Results: sourceware.org; spf=pass smtp.mailfrom=gmail.com Received: by mail-yb1-xb35.google.com with SMTP id b136so1441060yba.2 for ; Mon, 19 Sep 2022 19:26:16 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date; bh=YL54ad6oPYvDGpv8lW90rkjTVk2Znpkmkd9goaXp4Fw=; b=ONXv2e1GnSz50dXWQ9PcO7astB7qSDzp6csrLqhJdYwudUbIbd6g+Qq/9ZXGYadpb5 2CAlk+6HFKjtVzffd+YX40/cU2M4zrS/b6dWIRVYq7gbkHRj8VL38qLAOm7Kzu20XAmO T8xpWej2MhLYTdElYvey3QOmF/tHIwdtMmLrhrrm2/HufNNju5NDf2ImHcNjKG5cnXqa Uc6lWtZRucNNKqjQf1Ah8S9V5o4GqxT/Y3KYFFY/FfPoBUYYpiRlXOoL2RzEwMtgVuCe 9Hbhw5Ml76voWWyuT/1zXNI6y4GJzLy4ZjDXMveFLE4U40g7Ps5bccvI7IvKfk1ge2Fw x8Hg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date; bh=YL54ad6oPYvDGpv8lW90rkjTVk2Znpkmkd9goaXp4Fw=; b=nInYyHgHixjZghknfp+GidduY8rKfid26kX5iEp5tyQeSnN8USqAtDBHaoCJ2rmYiJ 7htoL6F5X1ajgPEV/KdJEl/FuUTD3VhgdN6SAD4cpBrkJTgUjWLKbr1VK1aZwOFugiPU WHfzcEtj/pZGFEOF4bJJpqvjYvrgFFTvkqIPLSkNrqnzCJ1Fj86MsKtDmFp8J8Xemzc7 KznBLd/GZKHy/pnb0E2VPwoj6fUCDpHp79BQ4+sCrZlUkTanExC6Q5lrjtBhYyx/0wGS ffRuWWtY75ERPE+1VJWpTndXlM7GEvqo70u0Kz2B83MaDA9Az7wroruYMasjaHDfeWQA CF8g== X-Gm-Message-State: ACrzQf2SrNqa/xt6pjKTinLhLLZgwpLxT04HRRbbv7XlVzEpPedf3n+L ZEEaIqKEX10C9JWYV80BtHOuWJK9WTEAlKNutg9DDlQuWQ8= X-Google-Smtp-Source: AMsMyM4NZ/JCRDMtXc3gwGAHpINTzhnXs1HUiHUUqe/Y9pz+lFUchsxw3AnSP9Gpv9odgyc0iVV6QP+HskZLtqcxItU= X-Received: by 2002:a25:b989:0:b0:6a7:d4d:3a34 with SMTP id r9-20020a25b989000000b006a70d4d3a34mr17191027ybg.92.1663640775597; Mon, 19 Sep 2022 19:26:15 -0700 (PDT) MIME-Version: 1.0 References: <20220920022133.64778-1-hongtao.liu@intel.com> In-Reply-To: <20220920022133.64778-1-hongtao.liu@intel.com> From: Hongtao Liu Date: Tue, 20 Sep 2022 10:28:54 +0800 Message-ID: Subject: Re: [PATCH] Fix incorrect handle in vectorizable_induction for mixed induction type. To: Richard Biener Cc: gcc-patches@gcc.gnu.org Content-Type: text/plain; charset="UTF-8" X-Spam-Status: No, score=-7.5 required=5.0 tests=BAYES_00,DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,FREEMAIL_FROM,GIT_PATCH_0,KAM_SHORT,RCVD_IN_DNSWL_NONE,SPF_HELO_NONE,SPF_PASS,TXREP autolearn=ham autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on server2.sourceware.org List-Id: On Tue, Sep 20, 2022 at 10:23 AM liuhongt wrote: > > The codes in vectorizable_induction for slp_node assume all phi_info > have same induction type(vect_step_op_add), but since we support > nonlinear induction, it could be wrong handled. > So the patch return false when slp_node has mixed induction type. > > Note codes in other place will still vectorize the induction with > separate iv update and vec_perm. But slp_node handle in > vectorizable_induction will be more optimal when all induction type > are the same, it will update ivs with one operation instead of > separate iv updates and permutation. > > Bootstrapped and regtested on x86_64-pc-linux-gnu{-m32,}. > Ok for trunk? > > gcc/ChangeLog: > > PR tree-optimization/103144 > * tree-vect-loop.cc (vectorizable_induction): Return false for > slp_node with mixed induction type. > > gcc/testsuite/ChangeLog: > > * gcc.target/i386/pr103144-mix-1.c: New test. > * gcc.target/i386/pr103144-mix-2.c: New test. > --- > .../gcc.target/i386/pr103144-mix-1.c | 17 +++++++++ > .../gcc.target/i386/pr103144-mix-2.c | 35 +++++++++++++++++++ > gcc/tree-vect-loop.cc | 34 ++++++++++++++---- > 3 files changed, 79 insertions(+), 7 deletions(-) > create mode 100644 gcc/testsuite/gcc.target/i386/pr103144-mix-1.c > create mode 100644 gcc/testsuite/gcc.target/i386/pr103144-mix-2.c > > diff --git a/gcc/testsuite/gcc.target/i386/pr103144-mix-1.c b/gcc/testsuite/gcc.target/i386/pr103144-mix-1.c > new file mode 100644 > index 00000000000..b292d66ef71 > --- /dev/null > +++ b/gcc/testsuite/gcc.target/i386/pr103144-mix-1.c > @@ -0,0 +1,17 @@ > +/* { dg-do compile } */ > +/* { dg-options "-O3 -fdump-tree-optimized" } */ > +/* { dg-final { scan-tree-dump-times "VEC_PERM_EXPR" 2 "optimized" } } */ > +/* For induction variable with differernt induction type(vect_step_op_add, vect_step_op_neg), > + It should't be handled in vectorizable_induction with just 1 single iv update(addition.), > + separate iv update and vec_perm are needed. */ > +int > +__attribute__((noipa)) > +foo (int* p, int c, int n) > +{ > + for (int i = 0; i != n; i++) > + { > + p[2* i]= i; > + p[2 * i+1] = c; > + c = -c; > + } > +} > diff --git a/gcc/testsuite/gcc.target/i386/pr103144-mix-2.c b/gcc/testsuite/gcc.target/i386/pr103144-mix-2.c > new file mode 100644 > index 00000000000..b7043d59aec > --- /dev/null > +++ b/gcc/testsuite/gcc.target/i386/pr103144-mix-2.c > @@ -0,0 +1,35 @@ > +/* { dg-do run } */ > +/* { dg-options "-O2 -mavx2 -ftree-vectorize -fvect-cost-model=unlimited -mprefer-vector-width=256" } */ > +/* { dg-require-effective-target avx2 } */ > + > +#include "avx2-check.h" > +#include > +#include "pr103144-mix-1.c" > + > +typedef int v8si __attribute__((vector_size(32))); > + > +#define N 34 > +void > +avx2_test (void) > +{ > + int* epi32_exp = (int*) malloc (N * sizeof (int)); > + int* epi32_dst = (int*) malloc (N * sizeof (int)); > + > + __builtin_memset (epi32_exp, 0, N * sizeof (int)); > + int b = 8; > + v8si init1 = __extension__(v8si) { 0, b, 1, -b, 2, b, 3, -b }; > + v8si init2 = __extension__(v8si) { 4, b, 5, -b, 6, b, 7, -b }; > + v8si init3 = __extension__(v8si) { 8, b, 9, -b, 10, b, 11, -b }; > + v8si init4 = __extension__(v8si) { 12, b, 13, -b, 14, b, 15, -b }; > + memcpy (epi32_exp, &init1, 32); > + memcpy (epi32_exp + 8, &init2, 32); > + memcpy (epi32_exp + 16, &init3, 32); > + memcpy (epi32_exp + 24, &init4, 32); > + epi32_exp[32] = 16; > + epi32_exp[33] = b; > + foo (epi32_dst, b, N / 2); > + if (__builtin_memcmp (epi32_dst, epi32_exp, N * sizeof (int)) != 0) > + __builtin_abort (); > + > + return; > +} > diff --git a/gcc/tree-vect-loop.cc b/gcc/tree-vect-loop.cc > index 9c434b66c5b..c7050a47c1c 100644 > --- a/gcc/tree-vect-loop.cc > +++ b/gcc/tree-vect-loop.cc > @@ -9007,14 +9007,34 @@ vectorizable_induction (loop_vec_info loop_vinfo, > iv_loop = loop; > gcc_assert (iv_loop == (gimple_bb (phi))->loop_father); > > - if (slp_node && !nunits.is_constant ()) > + if (slp_node) > { > - /* The current SLP code creates the step value element-by-element. */ > - if (dump_enabled_p ()) > - dump_printf_loc (MSG_MISSED_OPTIMIZATION, vect_location, > - "SLP induction not supported for variable-length" > - " vectors.\n"); > - return false; > + if (!nunits.is_constant ()) > + { > + /* The current SLP code creates the step value element-by-element. */ > + if (dump_enabled_p ()) > + dump_printf_loc (MSG_MISSED_OPTIMIZATION, vect_location, > + "SLP induction not supported for variable-length" > + " vectors.\n"); > + return false; > + } > + > + stmt_vec_info phi_info; > + FOR_EACH_VEC_ELT (SLP_TREE_SCALAR_STMTS (slp_node), i, phi_info) > + { > + if (STMT_VINFO_LOOP_PHI_EVOLUTION_TYPE (phi_info) != vect_step_op_add) > + { > + /* The below SLP code assume all induction type to be the same. > + But slp in other place will still vectorize the loop via updating > + iv update separately + vec_perm, but not from below codes. */ > + if (dump_enabled_p ()) > + dump_printf_loc (MSG_MISSED_OPTIMIZATION, vect_location, > + "SLP induction not supported for mixed induction type" > + " vectors.\n"); > + return false; > + } > + } > + > } > > if (FLOAT_TYPE_P (vectype) && !param_vect_induction_float) > -- > 2.18.1 > -- BR, Hongtao