From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: (qmail 19232 invoked by alias); 20 Dec 2002 12:16:41 -0000 Mailing-List: contact gcc-help@gcc.gnu.org; run by ezmlm Precedence: bulk List-Archive: List-Post: List-Help: Sender: gcc-owner@gcc.gnu.org Received: (qmail 19219 invoked from network); 20 Dec 2002 12:16:37 -0000 Received: from unknown (HELO numa6.igpm.rwth-aachen.de) (134.130.161.59) by 209.249.29.67 with SMTP; 20 Dec 2002 12:16:37 -0000 Received: from igpm.rwth-aachen.de (localhost [127.0.0.1]) by numa6.igpm.rwth-aachen.de (SGI-8.9.3/8.9.3) with ESMTP id OAA72149; Fri, 20 Dec 2002 14:13:26 +0100 (CST) Message-Id: <200212201313.OAA72149@numa6.igpm.rwth-aachen.de> Date: Fri, 20 Dec 2002 08:50:00 -0000 From: Volker Reichelt Subject: Re: A testcase library To: jakub@redhat.com cc: gcc@gcc.gnu.org, bangerth@ticam.utexas.edu, janis187@us.ibm.com, ehrhardt@mathematik.uni-ulm.de In-Reply-To: <20021220125202.B1310@sunsite.ms.mff.cuni.cz> MIME-Version: 1.0 Content-Type: TEXT/plain; charset=us-ascii X-SW-Source: 2002-12/txt/msg01260.txt.bz2 On 20 Dec, Jakub Jelinek wrote: > On Fri, Dec 20, 2002 at 01:40:49PM +0100, Volker Reichelt wrote: >> Since GNATS has its limitations with respect to searching for relevant >> information about testcases, I started collecting *small* testcases >> for easy grepping. Until now, I've collected (with the help of >> Wolfgang and of course the submitters) more than 200 of such testcases. >> >> Maybe the testcase library is useful for other bug-hunters, so here it >> is. I also wrote a little script that helps me keeping track of the >> information. Maybe that is of interest, too. The library and the script >> come with a small Readme, which you might want to read first. >> >> Comments and testcases for inclusion in the library are welcome. >> If this is of interest I could post the updated stuff regularly. > > Good work, thanks. > Unless they are already in gcc testsuite, shouldn't they all be checked > in after converting them to dg (or c-torture) format, ideally on all of 3.2/3.3 > branches and trunk? This is not current policy. Christian has asked a similar question before, and got the following mail snippet from Craig: ================================================================================= On Fri, Nov 29, 2002 at 09:47:24AM +0000, Nathan Sidwell wrote: > Craig Rodrigues wrote: > > A few questions: > > (1) Can I commit my testcase to the testsuite, since it is definitely > > a regression from gcc 3.1 and gcc 3.2? > No, we only commit test cases when the bug's fixed. The rationale being you > don't want to add a new failing test case -- that'd confuse people. Marking > it XFAIL isn't really the right solution, as then when you fix the bug, you > don't know whether fixing the XFAIL was accidental, and end up adding a new > test case anyway. Also, in fixing the bug, you (well I at least), can > construct a better test case having undersytood the failure mode. ================================================================================= But that doesn't keep us from doing something similar in a different location. I had some discussion over the topic in private mail with Wolfgang and we decided to wait for Bugzilla before setting up something new. But maybe there are better suggestions? Regards, Volker