From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: (qmail 16941 invoked by alias); 31 Jan 2008 19:01:53 -0000 Received: (qmail 16933 invoked by uid 22791); 31 Jan 2008 19:01:52 -0000 X-Spam-Status: No, hits=-2.4 required=5.0 tests=AWL,BAYES_00,SPF_HELO_PASS,SPF_PASS X-Spam-Check-By: sourceware.org Received: from mx1.redhat.com (HELO mx1.redhat.com) (66.187.233.31) by sourceware.org (qpsmtpd/0.31) with ESMTP; Thu, 31 Jan 2008 19:01:35 +0000 Received: from int-mx1.corp.redhat.com (int-mx1.corp.redhat.com [172.16.52.254]) by mx1.redhat.com (8.13.8/8.13.8) with ESMTP id m0VJ1Xsb007465 for ; Thu, 31 Jan 2008 14:01:33 -0500 Received: from pobox-3.corp.redhat.com (pobox-3.corp.redhat.com [10.11.255.67]) by int-mx1.corp.redhat.com (8.13.1/8.13.1) with ESMTP id m0VJ1W0b008533; Thu, 31 Jan 2008 14:01:32 -0500 Received: from touchme.toronto.redhat.com (IDENT:postfix@touchme.yyz.redhat.com [10.15.16.9]) by pobox-3.corp.redhat.com (8.13.1/8.13.1) with ESMTP id m0VJ1OvX023785; Thu, 31 Jan 2008 14:01:32 -0500 Received: from ton.toronto.redhat.com (ton.yyz.redhat.com [10.15.16.15]) by touchme.toronto.redhat.com (Postfix) with ESMTP id 3F5C98001FF; Thu, 31 Jan 2008 14:01:08 -0500 (EST) Received: from ton.toronto.redhat.com (localhost.localdomain [127.0.0.1]) by ton.toronto.redhat.com (8.13.1/8.13.1) with ESMTP id m0VJ0p3I007609; Thu, 31 Jan 2008 14:00:51 -0500 Received: (from fche@localhost) by ton.toronto.redhat.com (8.13.1/8.13.1/Submit) id m0VJ0p6F007608; Thu, 31 Jan 2008 14:00:51 -0500 X-Authentication-Warning: ton.toronto.redhat.com: fche set sender to fche@redhat.com using -f To: William Cohen Cc: systemTAP Subject: Re: KFAIL tests in testsuite References: <47A0DDCB.1090303@redhat.com> From: fche@redhat.com (Frank Ch. Eigler) Date: Thu, 31 Jan 2008 19:01:00 -0000 In-Reply-To: <47A0DDCB.1090303@redhat.com> (William Cohen's message of "Wed, 30 Jan 2008 15:27:55 -0500") Message-ID: User-Agent: Gnus/5.1008 (Gnus v5.10.8) Emacs/21.3 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-Scanned-By: MIMEDefang 2.58 on 172.16.52.254 Mailing-List: contact systemtap-help@sourceware.org; run by ezmlm Precedence: bulk List-Id: List-Subscribe: List-Post: List-Help: , Sender: systemtap-owner@sourceware.org X-SW-Source: 2008-q1/txt/msg00189.txt.bz2 William Cohen writes: > I am looking through and appropriately markiung tests that fail due to > known reasons as KFAIL. So something like the attached patch. This one is fine. > The one concern that I have about marking some tests as KFAIL is > that failure may vary on the environment. Some versions of > supporting software or kernels may cause a test to fail. However, > the test doesn't uniformly fail. [...] Right, though if this becomes a problem (so one can't tell whether one's dealing with something new), then one can conditionalize the setup_kfail clauses further, based on architecture, versions, and maybe even a bit of whatnot(tm). - FChE