From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: (qmail 16350 invoked by alias); 23 Sep 2011 00:07:12 -0000 Received: (qmail 16341 invoked by uid 22791); 23 Sep 2011 00:07:11 -0000 X-SWARE-Spam-Status: No, hits=-2.1 required=5.0 tests=AWL,BAYES_00 X-Spam-Check-By: sourceware.org Received: from dair.pair.com (HELO dair.pair.com) (209.68.1.49) by sourceware.org (qpsmtpd/0.43rc1) with SMTP; Fri, 23 Sep 2011 00:06:55 +0000 Received: (qmail 85691 invoked by uid 20157); 23 Sep 2011 00:06:54 -0000 Received: from localhost (sendmail-bs@127.0.0.1) by localhost with SMTP; 23 Sep 2011 00:06:54 -0000 Date: Fri, 23 Sep 2011 00:07:00 -0000 From: Hans-Peter Nilsson To: Diego Novillo cc: gcc@gcc.gnu.org Subject: Re: RFC: Improving support for known testsuite failures In-Reply-To: Message-ID: References: <20110907152813.GA28540@google.com> User-Agent: Alpine 2.00 (BSF 1167 2008-08-23) MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII X-IsSubscribed: yes Mailing-List: contact gcc-help@gcc.gnu.org; run by ezmlm Precedence: bulk List-Id: List-Archive: List-Post: List-Help: Sender: gcc-owner@gcc.gnu.org X-SW-Source: 2011-09/txt/msg00237.txt.bz2 On Thu, 8 Sep 2011, Diego Novillo wrote: > On Thu, Sep 8, 2011 at 04:31, Richard Guenther > wrote: > > > I think it would be more useful to have a script parse gcc-testresults@ > > postings from the various autotesters and produce a nice webpage > > with revisions and known FAIL/XPASSes for the target triplets that > > are tested. > > Sure, though that describes a different tool. I'm after a tool that > will 'exit 0' if the testsuite finished with nominal results. Not to stop you from (partly) reinventing the wheel, but that's pretty much what contrib/regression/btest-gcc.sh already does, though you have to feed it a baseline a set of processed .sum files which could (for a calling script or a modified btest-gcc.sh) live in, say, contrib/target-results/. It handles "duplicate" test names by marking it as failing if any of them has failed. Works good enough. brgds, H-P