From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: (qmail 23093 invoked by alias); 9 Dec 2001 20:52:47 -0000 Mailing-List: contact gcc-help@gcc.gnu.org; run by ezmlm Precedence: bulk List-Archive: List-Post: List-Help: Sender: gcc-owner@gcc.gnu.org Received: (qmail 23072 invoked from network); 9 Dec 2001 20:52:46 -0000 Received: from unknown (HELO taltos.codesourcery.com) (66.92.14.122) by sources.redhat.com with SMTP; 9 Dec 2001 20:52:46 -0000 Received: from zack by taltos.codesourcery.com with local (Exim 3.33 #1 (Debian)) id 16DAw6-0001Zo-00; Sun, 09 Dec 2001 12:52:34 -0800 Date: Sun, 09 Dec 2001 13:02:00 -0000 From: Zack Weinberg To: dewar@gnat.com Cc: kenner@vlsi1.ultra.nyu.edu, mrs@windriver.com, gcc@gcc.gnu.org Subject: Re: ACATS legal status cleared by FSF Message-ID: <20011209205234.GP280@codesourcery.com> References: <20011208025650.7B397F28C7@nile.gnat.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20011208025650.7B397F28C7@nile.gnat.com> User-Agent: Mutt/1.3.24i X-SW-Source: 2001-12/txt/msg00444.txt.bz2 On Fri, Dec 07, 2001 at 09:56:50PM -0500, dewar@gnat.com wrote: > Note that just *reading* B tests to see if the output is correct is > a very difficult task, one that only someone with quite a bit of > ACVC/ACATS validation experience can do. A formal validation run > using these tests often involves several days of painstaking manual > work by someone who is an expert in the B tests to assure > compliance. I think this may be the crux of the difference between the B tests and the existing "noncompile" tests for gcc and g++. We - all the people arguing for inclusion of noncompile tests - are used to a context where it is easy to automate verification that diagnostics are correctly issued. When diagnostics do legitimately change, the test harness has to be adjusted, but this is straightforward, easily done by the person who changed the diagnostics. You're saying that the B tests are nothing like that, and we are finding that hard to believe. I'd like to see context - is the ACATS validation suite available online somewhere I can go look at it? zw