public inbox for gcc-regression@sourceware.org
help / color / mirror / Atom feed
* [TCWG CI] 437.leslie3d grew in size by 7% after gcc: Switch vrp2 to ranger.
@ 2021-11-05  7:53 ci_notify
  0 siblings, 0 replies; only message in thread
From: ci_notify @ 2021-11-05  7:53 UTC (permalink / raw)
  To: Andrew MacLeod; +Cc: gcc-regression

After gcc commit 502ffb1f389011b28ee51815242c7397790802d5
Author: Andrew MacLeod <amacleod@redhat.com>

    Switch vrp2 to ranger.

the following benchmarks grew in size by more than 1%:
- 437.leslie3d grew in size by 7% from 60343 to 64419 bytes

Below reproducer instructions can be used to re-build both "first_bad" and "last_good" cross-toolchains used in this bisection.  Naturally, the scripts will fail when triggerring benchmarking jobs if you don't have access to Linaro TCWG CI.

For your convenience, we have uploaded tarballs with pre-processed source and assembly files at:
- First_bad save-temps: https://ci.linaro.org/job/tcwg_bmk_ci_gnu-bisect-tcwg_bmk_apm-gnu-master-aarch64-spec2k6-Os_LTO/6/artifact/artifacts/build-502ffb1f389011b28ee51815242c7397790802d5/save-temps/
- Last_good save-temps: https://ci.linaro.org/job/tcwg_bmk_ci_gnu-bisect-tcwg_bmk_apm-gnu-master-aarch64-spec2k6-Os_LTO/6/artifact/artifacts/build-1410b208013e4ccd9438cda178c7ea995684e7e8/save-temps/
- Baseline save-temps: https://ci.linaro.org/job/tcwg_bmk_ci_gnu-bisect-tcwg_bmk_apm-gnu-master-aarch64-spec2k6-Os_LTO/6/artifact/artifacts/build-baseline/save-temps/

Configuration:
- Benchmark: SPEC CPU2006
- Toolchain: GCC + Glibc + GNU Linker
- Version: all components were built from their tip of trunk
- Target: aarch64-linux-gnu
- Compiler flags: -Os -flto
- Hardware: APM Mustang 8x X-Gene1

This benchmarking CI is work-in-progress, and we welcome feedback and suggestions at linaro-toolchain@lists.linaro.org .  In our improvement plans is to add support for SPEC CPU2017 benchmarks and provide "perf report/annotate" data behind these reports.

THIS IS THE END OF INTERESTING STUFF.  BELOW ARE LINKS TO BUILDS, REPRODUCTION INSTRUCTIONS, AND THE RAW COMMIT.

This commit has regressed these CI configurations:
 - tcwg_bmk_gnu_apm/gnu-master-aarch64-spec2k6-Os_LTO

First_bad build: https://ci.linaro.org/job/tcwg_bmk_ci_gnu-bisect-tcwg_bmk_apm-gnu-master-aarch64-spec2k6-Os_LTO/6/artifact/artifacts/build-502ffb1f389011b28ee51815242c7397790802d5/
Last_good build: https://ci.linaro.org/job/tcwg_bmk_ci_gnu-bisect-tcwg_bmk_apm-gnu-master-aarch64-spec2k6-Os_LTO/6/artifact/artifacts/build-1410b208013e4ccd9438cda178c7ea995684e7e8/
Baseline build: https://ci.linaro.org/job/tcwg_bmk_ci_gnu-bisect-tcwg_bmk_apm-gnu-master-aarch64-spec2k6-Os_LTO/6/artifact/artifacts/build-baseline/
Even more details: https://ci.linaro.org/job/tcwg_bmk_ci_gnu-bisect-tcwg_bmk_apm-gnu-master-aarch64-spec2k6-Os_LTO/6/artifact/artifacts/

Reproduce builds:
<cut>
mkdir investigate-gcc-502ffb1f389011b28ee51815242c7397790802d5
cd investigate-gcc-502ffb1f389011b28ee51815242c7397790802d5

# Fetch scripts
git clone https://git.linaro.org/toolchain/jenkins-scripts

# Fetch manifests and test.sh script
mkdir -p artifacts/manifests
curl -o artifacts/manifests/build-baseline.sh https://ci.linaro.org/job/tcwg_bmk_ci_gnu-bisect-tcwg_bmk_apm-gnu-master-aarch64-spec2k6-Os_LTO/6/artifact/artifacts/manifests/build-baseline.sh --fail
curl -o artifacts/manifests/build-parameters.sh https://ci.linaro.org/job/tcwg_bmk_ci_gnu-bisect-tcwg_bmk_apm-gnu-master-aarch64-spec2k6-Os_LTO/6/artifact/artifacts/manifests/build-parameters.sh --fail
curl -o artifacts/test.sh https://ci.linaro.org/job/tcwg_bmk_ci_gnu-bisect-tcwg_bmk_apm-gnu-master-aarch64-spec2k6-Os_LTO/6/artifact/artifacts/test.sh --fail
chmod +x artifacts/test.sh

# Reproduce the baseline build (build all pre-requisites)
./jenkins-scripts/tcwg_bmk-build.sh @@ artifacts/manifests/build-baseline.sh

# Save baseline build state (which is then restored in artifacts/test.sh)
mkdir -p ./bisect
rsync -a --del --delete-excluded --exclude /bisect/ --exclude /artifacts/ --exclude /gcc/ ./ ./bisect/baseline/

cd gcc

# Reproduce first_bad build
git checkout --detach 502ffb1f389011b28ee51815242c7397790802d5
../artifacts/test.sh

# Reproduce last_good build
git checkout --detach 1410b208013e4ccd9438cda178c7ea995684e7e8
../artifacts/test.sh

cd ..
</cut>

Full commit (up to 1000 lines):
<cut>
commit 502ffb1f389011b28ee51815242c7397790802d5
Author: Andrew MacLeod <amacleod@redhat.com>
Date:   Tue Nov 2 21:26:44 2021 -0400

    Switch vrp2 to ranger.
    
    This patch flips the default for the VRP2 pass to execute ranger vrp rather
    than the assert_expr version of VRP.
    
            * params.opt (param_vrp2_mode): Make ranger the default for VRP2.
---
 gcc/params.opt | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/gcc/params.opt b/gcc/params.opt
index 8c5948f7a84..6096854aa78 100644
--- a/gcc/params.opt
+++ b/gcc/params.opt
@@ -1156,7 +1156,7 @@ Common Joined Var(param_vrp1_mode) Enum(vrp_mode) Init(VRP_MODE_VRP) Param Optim
 --param=vrp1-mode=[vrp|ranger] Specifies the mode VRP1 should operate in.
 
 -param=vrp2-mode=
-Common Joined Var(param_vrp2_mode) Enum(vrp_mode) Init(VRP_MODE_VRP) Param Optimization
+Common Joined Var(param_vrp2_mode) Enum(vrp_mode) Init(VRP_MODE_RANGER) Param Optimization
 --param=vrp2-mode=[vrp|ranger] Specifies the mode VRP2 should operate in.
 
 Enum
</cut>
>From hjl@sc.intel.com  Fri Nov  5 08:12:17 2021
Return-Path: <hjl@sc.intel.com>
X-Original-To: gcc-regression@gcc.gnu.org
Delivered-To: gcc-regression@gcc.gnu.org
Received: from mga18.intel.com (mga18.intel.com [134.134.136.126])
 by sourceware.org (Postfix) with ESMTPS id C07463858428
 for <gcc-regression@gcc.gnu.org>; Fri,  5 Nov 2021 08:12:15 +0000 (GMT)
DMARC-Filter: OpenDMARC Filter v1.4.1 sourceware.org C07463858428
X-IronPort-AV: E=McAfee;i="6200,9189,10158"; a="218761824"
X-IronPort-AV: E=Sophos;i="5.87,210,1631602800"; d="scan'208";a="218761824"
Received: from orsmga006.jf.intel.com ([10.7.209.51])
 by orsmga106.jf.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384;
 05 Nov 2021 01:12:14 -0700
X-ExtLoop1: 1
X-IronPort-AV: E=Sophos;i="5.87,210,1631602800"; d="scan'208";a="450495419"
Received: from scymds01.sc.intel.com ([10.148.94.138])
 by orsmga006.jf.intel.com with ESMTP; 05 Nov 2021 01:12:14 -0700
Received: from gnu-snb-1.sc.intel.com (gnu-snb-1.sc.intel.com [172.25.33.219])
 by scymds01.sc.intel.com with ESMTP id 1A58CDSL003474;
 Fri, 5 Nov 2021 01:12:13 -0700
Received: by gnu-snb-1.sc.intel.com (Postfix, from userid 1000)
 id DC004180E59; Fri,  5 Nov 2021 01:12:13 -0700 (PDT)
Date: Fri, 05 Nov 2021 01:12:13 -0700
To: skpgkp2@gmail.com, hjl.tools@gmail.com, gcc-regression@gcc.gnu.org
Subject: Regressions on master at commit r12-4929 vs commit r12-4877 on
 Linux/i686
User-Agent: Heirloom mailx 12.5 7/5/10
MIME-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Transfer-Encoding: 7bit
Message-Id: <20211105081213.DC004180E59@gnu-snb-1.sc.intel.com>
From: "H.J. Lu" <hjl@sc.intel.com>
X-Spam-Status: No, score=-3470.2 required=5.0 tests=BAYES_00, KAM_DMARC_STATUS,
 KAM_LAZY_DOMAIN_SECURITY, KAM_NUMSUBJECT, SPF_HELO_NONE, SPF_NONE,
 TXREP autolearn=no autolearn_force=no version=3.4.4
X-Spam-Checker-Version: SpamAssassin 3.4.4 (2020-01-24) on
 server2.sourceware.org
X-BeenThere: gcc-regression@gcc.gnu.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Gcc-regression mailing list <gcc-regression.gcc.gnu.org>
List-Unsubscribe: <https://gcc.gnu.org/mailman/options/gcc-regression>,
 <mailto:gcc-regression-request@gcc.gnu.org?subject=unsubscribe>
List-Archive: <https://gcc.gnu.org/pipermail/gcc-regression/>
List-Post: <mailto:gcc-regression@gcc.gnu.org>
List-Help: <mailto:gcc-regression-request@gcc.gnu.org?subject=help>
List-Subscribe: <https://gcc.gnu.org/mailman/listinfo/gcc-regression>,
 <mailto:gcc-regression-request@gcc.gnu.org?subject=subscribe>
X-List-Received-Date: Fri, 05 Nov 2021 08:12:17 -0000

New failures:

New passes:
FAIL: g++.dg/asan/asan_test.C   -O2  (test for excess errors)
FAIL: libstdc++-prettyprinters/cxx11.cc print arrptr
FAIL: libstdc++-prettyprinters/cxx11.cc print arrptr
FAIL: libstdc++-prettyprinters/cxx11.cc print empty_ptr
FAIL: libstdc++-prettyprinters/cxx11.cc print empty_ptr
FAIL: libstdc++-prettyprinters/cxx11.cc print rarrptr
FAIL: libstdc++-prettyprinters/cxx11.cc print rarrptr
FAIL: libstdc++-prettyprinters/cxx11.cc print rempty_ptr
FAIL: libstdc++-prettyprinters/cxx11.cc print rempty_ptr
FAIL: libstdc++-prettyprinters/cxx11.cc print ruptr
FAIL: libstdc++-prettyprinters/cxx11.cc print ruptr
FAIL: libstdc++-prettyprinters/cxx11.cc print uptr
FAIL: libstdc++-prettyprinters/cxx11.cc print uptr
FAIL: libstdc++-prettyprinters/cxx17.cc print path1
FAIL: libstdc++-prettyprinters/cxx17.cc print path1
FAIL: libstdc++-prettyprinters/cxx17.cc print path2
FAIL: libstdc++-prettyprinters/cxx17.cc print path2
FAIL: libstdc++-xmethods/unique_ptr.cc


^ permalink raw reply	[flat|nested] only message in thread

only message in thread, other threads:[~2021-11-05  7:53 UTC | newest]

Thread overview: (only message) (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2021-11-05  7:53 [TCWG CI] 437.leslie3d grew in size by 7% after gcc: Switch vrp2 to ranger ci_notify

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for read-only IMAP folder(s) and NNTP newsgroup(s).