From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: (qmail 19075 invoked by alias); 26 May 2011 15:59:30 -0000 Received: (qmail 19063 invoked by uid 22791); 26 May 2011 15:59:30 -0000 X-SWARE-Spam-Status: No, hits=-2.3 required=5.0 tests=AWL,BAYES_00,DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,FREEMAIL_FROM,RCVD_IN_DNSWL_LOW,RFC_ABUSE_POST,WEIRD_PORT X-Spam-Check-By: sourceware.org Received: from mail-ww0-f41.google.com (HELO mail-ww0-f41.google.com) (74.125.82.41) by sourceware.org (qpsmtpd/0.43rc1) with ESMTP; Thu, 26 May 2011 15:59:14 +0000 Received: by wwi18 with SMTP id 18so4522794wwi.2 for ; Thu, 26 May 2011 08:59:13 -0700 (PDT) MIME-Version: 1.0 Received: by 10.227.152.132 with SMTP id g4mr1006338wbw.24.1306425309683; Thu, 26 May 2011 08:55:09 -0700 (PDT) Received: by 10.227.37.152 with HTTP; Thu, 26 May 2011 08:55:09 -0700 (PDT) In-Reply-To: <6C35D651-A8CC-4B94-B673-FDE0FD69B71E@comcast.net> References: <4DDC05B3.2070007@codesourcery.com> <6C35D651-A8CC-4B94-B673-FDE0FD69B71E@comcast.net> Date: Thu, 26 May 2011 17:25:00 -0000 Message-ID: Subject: Re: [testsuite] remove XFAIL for all but ia64 for g++.dg/tree-ssa/pr43411.C From: Richard Guenther To: Mike Stump Cc: Rainer Orth , Janis Johnson , gcc-patches@gcc.gnu.org, Jan Hubicka Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable X-IsSubscribed: yes Mailing-List: contact gcc-patches-help@gcc.gnu.org; run by ezmlm Precedence: bulk List-Id: List-Archive: List-Post: List-Help: Sender: gcc-patches-owner@gcc.gnu.org X-SW-Source: 2011-05/txt/msg02066.txt.bz2 On Thu, May 26, 2011 at 5:16 PM, Mike Stump wrote: > On May 26, 2011, at 2:25 AM, Richard Guenther wrote: >> The XPASS is suprious - that's the whole point of XPASSes. =A0It should >> FAIL (well, XFAIL). =A0A patch making it PASS is bogus. > > There are deeper reasons for my position. =A0Take a look at: > > =A0http://google1.osuosl.org:8011/waterfall > > the idea is to use the expected state of the testcases to determine if th= e color should be green or not. =A0The best use of a system like this is wh= en the usual state is green, and any time a red appears, it is turned back = to green, in time measures in minutes or hours, not days or years. =A0Now, = do you think there is any value add to having a testing system that display= s testing results across many platforms on a regular basis like this? =A0If= so, how do you propose to decide on wether the color should be green or re= d? It's always red on a transition. Whether an XPASS or XFAIL is red on its own needs human interaction (understanding of the testcase and why it now XPASSes or XFAILs). The red on the transition should cause the human that did that transition to do that inspection. Richard.