From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from EUR05-DB8-obe.outbound.protection.outlook.com (mail-db8eur05on2072.outbound.protection.outlook.com [40.107.20.72]) by sourceware.org (Postfix) with ESMTPS id B116038618C1 for ; Thu, 23 Nov 2023 17:09:29 +0000 (GMT) DMARC-Filter: OpenDMARC Filter v1.4.2 sourceware.org B116038618C1 Authentication-Results: sourceware.org; dmarc=pass (p=none dis=none) header.from=axis.com Authentication-Results: sourceware.org; spf=pass smtp.mailfrom=axis.com ARC-Filter: OpenARC Filter v1.0.0 sourceware.org B116038618C1 Authentication-Results: server2.sourceware.org; arc=pass smtp.remote-ip=40.107.20.72 ARC-Seal: i=2; a=rsa-sha256; d=sourceware.org; s=key; t=1700759371; cv=pass; b=top4JGycm9LQgMYN3FzEKZh4m4kpL4vNBuA5MvRk6MZXchFf4Pgc/T6nOOORdIkxoboD1S/+I5UkdRJrUNNGpSaEkuAu1M4sXgNPTNSgpoeGe/do8NaN1oeomIe0M3pxxboCIV26AHaRArzpLqOQJeSIEEwz8vJPX0sxf9jiqpw= ARC-Message-Signature: i=2; a=rsa-sha256; d=sourceware.org; s=key; t=1700759371; c=relaxed/simple; bh=Br0gcWVjwoKHyXS1DF4j8hNOZdnPaUB0h1YKKs42PKc=; h=DKIM-Signature:From:To:Subject:MIME-Version:Message-ID:Date; b=oh2DMcQgGkNFywUG5E9QyNHWMeGRK/VvxgrGZduy2GwfROg/y7RNfreNATjrlitqnkufRhiXCH/T6A1+RhojSQdSBhPgD7KVnxUR/FxTA0foS7STiPRgpb3gfOZwfFdH7t+zCCtctPy3fXLJy2Dg5pbXrTL3vO9TBVjm6q0EJEE= ARC-Authentication-Results: i=2; server2.sourceware.org ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=aHarwYnIxsFkMF1TwvXhz4wCoU9awxBWC/WWxthBpOPMA/kEZfSc/T/My4t3468q7nwy7FnOUEpzLBvqWK+cvgLeJbuPRsMSIyCkUYiTRv+vqXjuw4UakzGhdprg/XJcQNS0FDBqG7gk9StmgtS23onAbHwDt+BPxeneKuGHQKlRHo2c6Y69yIjbVbfmhQEoh7S8tbqQdOY7UFUJhYC6bpNx+AyITzv1yMmeS1Jo5G0yfuxcN3M76MoHUpg9UQLKFR4OGAFQuglZDxq8A4UPHoq3eX6q2rNWduDVCFl1ciSHhofLHW46LwQ0uQQX9yb7vPDyZrx4V72rYvOqZa3iuw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=zZc134Rzalc5PR7nVDNVX29SgR34F7KqkIRh22GK3XA=; b=j799Cgi7u0FcjGZ53/3wL3chP3tNRGS2FrsEylnt4ZinkML2t9QzgFbchh55NdWGC12H9DhQuwLXg6IjAzQNNi3OInhON5rPkNgchBunvIPszr5UyUYDzwdkdQmOte+2wMbiQhWVLdyVAwwCX8vGPiyKaTkzNiVN6eDisECe6mDOlgC9gZuRB7Aq1UjgTiNL4esoD9FNB/wuCaDBH+iKBDWq7rIqYK1Lqg3xb727mVrVzPTE03vwCuwr95whIAoMlzSPO00ERGVM8slIrtwwO+2OgMlaDki+NUCbcU5FmZgiRPQc3BiXi9wqdsG0L3n0e54FjWRgpMWB2kJs8xND3g== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=fail (sender ip is 195.60.68.100) smtp.rcpttodomain=gcc.gnu.org smtp.mailfrom=axis.com; dmarc=fail (p=none sp=none pct=100) action=none header.from=axis.com; dkim=none (message not signed); arc=none (0) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=axis.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=zZc134Rzalc5PR7nVDNVX29SgR34F7KqkIRh22GK3XA=; b=nf5hUYXzOhR78Pu21+4Q7ZJhzydP3Li0NqHVztmUi0RjIjQ9gQYKfCYR1b7XW9bWVfnSYbOCaTSoau27EfSrT+h8h2BcJVNO1ACu4JsKOI1qI5YO4+NhQb7IbNKKi1QMbo7eD78U/LywkIjRALWb2JgKLkpSaKCZmuQn5SqmNa0= Received: from AM6PR0202CA0044.eurprd02.prod.outlook.com (2603:10a6:20b:3a::21) by PAXPR02MB7781.eurprd02.prod.outlook.com (2603:10a6:102:230::13) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.7025.20; Thu, 23 Nov 2023 17:09:27 +0000 Received: from AM2PEPF0001C70B.eurprd05.prod.outlook.com (2603:10a6:20b:3a:cafe::a8) by AM6PR0202CA0044.outlook.office365.com (2603:10a6:20b:3a::21) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.7025.18 via Frontend Transport; Thu, 23 Nov 2023 17:09:27 +0000 X-MS-Exchange-Authentication-Results: spf=fail (sender IP is 195.60.68.100) smtp.mailfrom=axis.com; dkim=none (message not signed) header.d=none;dmarc=fail action=none header.from=axis.com; Received-SPF: Fail (protection.outlook.com: domain of axis.com does not designate 195.60.68.100 as permitted sender) receiver=protection.outlook.com; client-ip=195.60.68.100; helo=mail.axis.com; Received: from mail.axis.com (195.60.68.100) by AM2PEPF0001C70B.mail.protection.outlook.com (10.167.16.199) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.20.7025.12 via Frontend Transport; Thu, 23 Nov 2023 17:09:27 +0000 Received: from SE-MAIL21W.axis.com (10.20.40.16) by se-mail01w.axis.com (10.20.40.7) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2375.34; Thu, 23 Nov 2023 18:09:27 +0100 Received: from se-mail01w.axis.com (10.20.40.7) by SE-MAIL21W.axis.com (10.20.40.16) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2375.34; Thu, 23 Nov 2023 18:09:26 +0100 Received: from se-intmail01x.se.axis.com (10.0.5.60) by se-mail01w.axis.com (10.20.40.7) with Microsoft SMTP Server id 15.1.2375.34 via Frontend Transport; Thu, 23 Nov 2023 18:09:26 +0100 Received: from pchp3.se.axis.com (pchp3.se.axis.com [10.88.21.53]) by se-intmail01x.se.axis.com (Postfix) with ESMTP id DA2C2E7AA; Thu, 23 Nov 2023 18:09:26 +0100 (CET) Received: by pchp3.se.axis.com (Postfix, from userid 171) id D33BA20432; Thu, 23 Nov 2023 18:09:26 +0100 (CET) From: Hans-Peter Nilsson To: CC: Subject: [PATCH 3/3] contrib/regression/btest-gcc.sh: Optionally handle XPASS. MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 8BIT Message-ID: <20231123170926.D33BA20432@pchp3.se.axis.com> Date: Thu, 23 Nov 2023 18:09:26 +0100 X-EOPAttributedMessage: 0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: AM2PEPF0001C70B:EE_|PAXPR02MB7781:EE_ X-MS-Office365-Filtering-Correlation-Id: 310191ca-2796-4dc7-7885-08dbec46f334 X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: ypuvVJOILrWuR458Xt8y0JQl1CvQTJfB9tGKQmc/bQkH5ZQdiLSlWmwvcQE08CTAWq9EgmQRz0HDZzcdVXoM+hCL9RKd1NXysrTP4tMoYETxX5hTnuaeXBxQ+gG/cY9UropygfCldW0FzKnmLxZd29RWO3pKPTa3pF5nDB4q+Wjo3MGRiip3qkdk1qIKuIsbtwONbX5jydsjCebA2Tws9yCIZTF3gpgLGkjDBzXDICj60wiTH1VIUqRbUCJPMO8KFx9JkvU2Es9u3BsM1F1XDQrlm8AxGQgXDnlo8bsP2dJpTw3VymQm/p2n7V0U3WQXNwvCkXBLtf6Z4UBehh4c75KkzKdqeJWYWgwxgGlwtwVXz9opv01N0dRONNdKMdNSFXRqfD8SbC4FQG1feY0yv815r7pociOQ2fvvfY2M3Wztp/O3cWM/QuR4VeDfMBh+jddFG/L8l8HuFrNTOMsbwVXaNYJVgk6OxhDfw9+uhJeZNi8DRHH3BnWUGQr8ES/x+8qGL0g3EtnipAlAtRx+Z3TBQuuHEquqODXrUQVK8Wt/qbtBHr1SFKmtL3oDHthRebZlKUYYaRQW4/ff5LvoUJ+UO+3MKZxrN1A2a9Qm6KU3Bu8XbC77yWW3VZaPfdX9weAJGtLStjs2/fIOs6aJarWktBM1MjUMJBdAax3y6eLO0VROsehx6DsF0JNAU8+l5BkG2bxdF4n2qqZ6d9thCq1nKbfdec4WA4+A5uzZE3i8Hk6PDdXdLmqTLyYsmYbCVBZVQGM5+Tomqnm3j8EIYQ== X-Forefront-Antispam-Report: CIP:195.60.68.100;CTRY:SE;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:mail.axis.com;PTR:InfoDomainNonexistent;CAT:NONE;SFS:(13230031)(4636009)(136003)(396003)(376002)(39860400002)(346002)(230922051799003)(64100799003)(82310400011)(1800799012)(186009)(451199024)(40470700004)(36840700001)(46966006)(40480700001)(40460700003)(70206006)(70586007)(42186006)(82740400003)(81166007)(356005)(33656002)(36860700001)(316002)(336012)(6266002)(1076003)(26005)(83380400001)(2906002)(478600001)(6916009)(426003)(5660300002)(8676002)(4326008)(47076005)(8936002)(41300700001)(36900700001);DIR:OUT;SFP:1101; X-OriginatorOrg: axis.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 23 Nov 2023 17:09:27.4756 (UTC) X-MS-Exchange-CrossTenant-Network-Message-Id: 310191ca-2796-4dc7-7885-08dbec46f334 X-MS-Exchange-CrossTenant-Id: 78703d3c-b907-432f-b066-88f7af9ca3af X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=78703d3c-b907-432f-b066-88f7af9ca3af;Ip=[195.60.68.100];Helo=[mail.axis.com] X-MS-Exchange-CrossTenant-AuthSource: AM2PEPF0001C70B.eurprd05.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Anonymous X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem X-MS-Exchange-Transport-CrossTenantHeadersStamped: PAXPR02MB7781 X-Spam-Status: No, score=-11.2 required=5.0 tests=BAYES_00,DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,GIT_PATCH_0,RCVD_IN_DNSWL_NONE,RCVD_IN_MSPIKE_H2,SPF_HELO_PASS,SPF_PASS,TXREP,T_SCC_BODY_TEXT_LINE autolearn=ham autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on server2.sourceware.org List-Id: Somewhat trivial, still tested on several runs (for cris-elf): two starting from the same state, with/without --handle-xpass-as-fail; the one "without" showing no change in state compared to an unpatched baseline (with the same input-state), and the one with --handle-xpass-as-fail some XPASSing tests I'd noticed now correctly showed up as regressions. In another, separate run, with the same input state but one of those XPASSing tests removed from "passes" in the input-state, it correctly showed up as a (non-regression) new FAIL. -- >8 -- Tests with keys that match both PASS, FAIL (or now optionally XPASS), count as fail. XPASSes were previously ignored. Handling them as FAIL seems the most useful alternative, but not counting XPASSes may be deliberate. It's also a matter of compatibility, so make it optional. Attempts to use --handle-xpass-as-fail was previously flagged as a usage error. If you pass it now, on state with previous mixed XPASS and PASS results but doesn't change in this run, the XPASS is discovered as a (new) regression. For new XPASSing tests, it's handled as a new FAIL. * btest-gcc.sh (--handle-xpass-as-fail): New option. --- contrib/regression/btest-gcc.sh | 11 ++++++++++- 1 file changed, 10 insertions(+), 1 deletion(-) diff --git a/contrib/regression/btest-gcc.sh b/contrib/regression/btest-gcc.sh index 3c031e93709b..684019f715f1 100755 --- a/contrib/regression/btest-gcc.sh +++ b/contrib/regression/btest-gcc.sh @@ -22,17 +22,22 @@ add_passes_despite_regression=0 dashj='' +handle_xpass_as_fail=false # can be # --add-passes-despite-regression: # Add new "PASSes" despite there being some regressions. # -j: # Pass '-j' to make. +# --handle-xpass-as-fail: +# Count XPASS as a FAIL (default ignored). while : ; do case "$1" in --add-passes-despite-regression) add_passes_despite_regression=1;; + --handle-xpass-as-fail) + handle_xpass_as_fail=true;; -j*) dashj=$1;; -*) echo "Invalid option: $1"; exit 2;; @@ -203,7 +208,11 @@ done # Work out what failed for LOG in $TESTLOGS ; do L=`basename $LOG` - awk '/^FAIL: / { print "'$L'",$2; }' $LOG || exit 1 + if $handle_xpass_as_fail ; then + awk '/^(FAIL|XPASS): / { print "'$L'",$2; }' $LOG || exit 1 + else + awk '/^FAIL: / { print "'$L'",$2; }' $LOG || exit 1 + fi done | sort | uniq > $FAILED || exit 1 comm -12 $FAILED $PASSES >> $REGRESS || exit 1 NUMREGRESS=`wc -l < $REGRESS | tr -d ' '` -- 2.30.2