From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: (qmail 24100 invoked by alias); 6 Dec 2001 23:19:40 -0000 Mailing-List: contact gcc-help@gcc.gnu.org; run by ezmlm Precedence: bulk List-Archive: List-Post: List-Help: Sender: gcc-owner@gcc.gnu.org Received: (qmail 24048 invoked from network); 6 Dec 2001 23:19:35 -0000 Received: from unknown (HELO vlsi1.ultra.nyu.edu) (128.122.140.213) by sources.redhat.com with SMTP; 6 Dec 2001 23:19:35 -0000 Received: by vlsi1.ultra.nyu.edu (4.1/1.34) id AA04531; Thu, 6 Dec 01 18:13:59 EST Date: Thu, 06 Dec 2001 15:40:00 -0000 From: kenner@vlsi1.ultra.nyu.edu (Richard Kenner) Message-Id: <10112062313.AA04531@vlsi1.ultra.nyu.edu> To: zack@codesourcery.com Subject: Re: ACATS legal status cleared by FSF Cc: gcc@gcc.gnu.org X-SW-Source: 2001-12/txt/msg00327.txt.bz2 I'm 100% confident that there is value to having "make check" drive at least some set of Ada tests. I don't think *anybody* disagrees with that. The question is what should that subset be? My experience with backend changes is that most of the failures are in C3, CD, CXA, and CXG, with a smaller number in C4. For changes to other than the Ada front-end, the benefit of running additional chapters is, in my opinion, small. I can't remember a time when a backend change caused an ACATS failure that didn't show up in one of those chapters. That being said, I should also point out that the ACATS suite isn't a very good test of the back-end at all, but perhaps running it with different optimization levels will help. (with the implication that writing a C testcase is impossible or at least too much work). Usually impossible. The issue is trees that can't be made in C, such as with PLACEHOLDER_EXPR. It may make sense not to run the ACATS B tests by default, but they should at least be _present_ in the repository so that everyone is on an equal footing for changes that affect error messages. I think everybody agrees with that too, but the question is what does "present" mean with respect to the baselines, which is where the real maintenance issue is.