From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: (qmail 30754 invoked by alias); 13 Dec 2018 16:49:58 -0000 Mailing-List: contact gcc-patches-help@gcc.gnu.org; run by ezmlm Precedence: bulk List-Id: List-Archive: List-Post: List-Help: Sender: gcc-patches-owner@gcc.gnu.org Received: (qmail 30734 invoked by uid 89); 13 Dec 2018 16:49:58 -0000 Authentication-Results: sourceware.org; auth=none X-Spam-SWARE-Status: No, score=-1.9 required=5.0 tests=BAYES_00,SPF_HELO_PASS autolearn=ham version=3.3.2 spammy= X-HELO: mx1.redhat.com Received: from mx1.redhat.com (HELO mx1.redhat.com) (209.132.183.28) by sourceware.org (qpsmtpd/0.93/v0.84-503-g423c35a) with ESMTP; Thu, 13 Dec 2018 16:49:56 +0000 Received: from smtp.corp.redhat.com (int-mx05.intmail.prod.int.phx2.redhat.com [10.5.11.15]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by mx1.redhat.com (Postfix) with ESMTPS id F37F781DEB; Thu, 13 Dec 2018 16:49:54 +0000 (UTC) Received: from localhost.localdomain (ovpn-112-24.rdu2.redhat.com [10.10.112.24]) by smtp.corp.redhat.com (Postfix) with ESMTP id 8B4885D760; Thu, 13 Dec 2018 16:49:52 +0000 (UTC) Subject: Re: [PATCH] Delete powerpcspe To: Segher Boessenkool , Richard Biener Cc: andrew@codesourcery.com, Jakub Jelinek , GCC Patches References: <4b748e966e3eeab17f102e1a0112616f2015bf95.1543869218.git.segher@kernel.crashing.org> <20181203214804.GE12380@tucnak> <0adf63ed-1fca-cfa1-414b-9b022478b6fd@codesourcery.com> <20181210201310.GH3803@gate.crashing.org> <07e3d956-a21c-1519-121a-b32f2f74bc78@redhat.com> <20181212173333.GN3803@gate.crashing.org> From: Jeff Law Openpgp: preference=signencrypt Message-ID: <68985bef-f065-85b9-5df4-3f76437b306a@redhat.com> Date: Thu, 13 Dec 2018 16:49:00 -0000 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:60.0) Gecko/20100101 Thunderbird/60.3.1 MIME-Version: 1.0 In-Reply-To: <20181212173333.GN3803@gate.crashing.org> Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit X-IsSubscribed: yes X-SW-Source: 2018-12/txt/msg00948.txt.bz2 On 12/12/18 10:33 AM, Segher Boessenkool wrote: > On Wed, Dec 12, 2018 at 11:36:29AM +0100, Richard Biener wrote: >> On Tue, Dec 11, 2018 at 2:37 PM Jeff Law wrote: >>> One way to deal with these problems is to create a fake simulator that >>> always returns success. That's what my tester does for the embedded >>> targets. That allows us to do reliable compile-time tests as well as >>> the various scan-whatever tests. >>> >>> It would be trivial to start sending those results to gcc-testresults. >> >> I think it would be more useful if the execute testing would be >> reported as UNSUPPORTED rather than simply PASS w/o being >> sure it does. > > Yes. Yes, but I don't think we've got a reasonable way to do that in the existing dejagnu framework. > >> But while posting to gcc-testresults is a sign of testing tracking >> regressions (and progressions!) in bugzilla and caring for those >> bugs is far more important... > > If results are posted to gcc-testresults then other people can get a > feel whether the port is detoriating, and at what rate. If no results > are posted we just have to assume the worst. Most people do not have > the time (or setup) to test it for themselves. Yup. I wish I had the time to extract more of the data the tester is gathering and produce this kind of info. I have not made it a priority to try and address all the issues I've seen in the tester. We have some ports that are incredibly flaky (epiphany for example), and many that have a lot of failures, but are stable in their set of failures. My goal to date has mostly been to identify regressions. I'm not even able to keep up with that. For example s390/s390x have been failing for about a week with their kernel builds. sparc, i686, aarch64 are consistently tripping over regressions. ia64 hasn't worked since we put in qsort consistency checking, etc etc. Jeff