From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: (qmail 18963 invoked by alias); 8 Sep 2011 16:41:45 -0000 Received: (qmail 18638 invoked by uid 22791); 8 Sep 2011 16:41:42 -0000 X-SWARE-Spam-Status: No, hits=-1.6 required=5.0 tests=AWL,BAYES_00 X-Spam-Check-By: sourceware.org Received: from relay1.mentorg.com (HELO relay1.mentorg.com) (192.94.38.131) by sourceware.org (qpsmtpd/0.43rc1) with ESMTP; Thu, 08 Sep 2011 16:41:28 +0000 Received: from nat-ies.mentorg.com ([192.94.31.2] helo=EU1-MAIL.mgc.mentorg.com) by relay1.mentorg.com with esmtp id 1R1hfL-0001TT-By from joseph_myers@mentor.com ; Thu, 08 Sep 2011 09:41:27 -0700 Received: from digraph.polyomino.org.uk ([172.16.63.104]) by EU1-MAIL.mgc.mentorg.com with Microsoft SMTPSVC(6.0.3790.1830); Thu, 8 Sep 2011 17:41:25 +0100 Received: from jsm28 (helo=localhost) by digraph.polyomino.org.uk with local-esmtp (Exim 4.74) (envelope-from ) id 1R1hfI-0001Nt-Kt; Thu, 08 Sep 2011 16:41:24 +0000 Date: Thu, 08 Sep 2011 16:41:00 -0000 From: "Joseph S. Myers" To: Richard Earnshaw cc: Diego Novillo , Richard Guenther , "gcc@gcc.gnu.org" Subject: Re: RFC: Improving support for known testsuite failures In-Reply-To: <4E68C1DF.805@arm.com> Message-ID: References: <20110907152813.GA28540@google.com> <4E68C1DF.805@arm.com> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII Mailing-List: contact gcc-help@gcc.gnu.org; run by ezmlm Precedence: bulk List-Id: List-Archive: List-Post: List-Help: Sender: gcc-owner@gcc.gnu.org X-SW-Source: 2011-09/txt/msg00081.txt.bz2 On Thu, 8 Sep 2011, Richard Earnshaw wrote: > And that's only going to work if all the test names are unique. I > currently see quite a few tests that appear in my log as both PASS and > FAIL in a single run. For example: Yes, that's just a bug in the testsuite that should be fixed just like any other bug. One thing a web service working with .sum files could do is automatically detect places with just duplicate test names (even if both are PASS) and report them noisily as problems - and as regressions if new instances appear. -- Joseph S. Myers joseph@codesourcery.com