From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: (qmail 13500 invoked by alias); 19 Nov 2004 17:58:38 -0000 Mailing-List: contact gcc-help@gcc.gnu.org; run by ezmlm Precedence: bulk List-Archive: List-Post: List-Help: Sender: gcc-owner@gcc.gnu.org Received: (qmail 13485 invoked from network); 19 Nov 2004 17:58:33 -0000 Received: from unknown (HELO e34.co.us.ibm.com) (32.97.110.132) by sourceware.org with SMTP; 19 Nov 2004 17:58:33 -0000 Received: from d03relay04.boulder.ibm.com (d03relay04.boulder.ibm.com [9.17.195.106]) by e34.co.us.ibm.com (8.12.10/8.12.9) with ESMTP id iAJHwWAD189110 for ; Fri, 19 Nov 2004 12:58:33 -0500 Received: from d03av02.boulder.ibm.com (d03av02.boulder.ibm.com [9.17.195.168]) by d03relay04.boulder.ibm.com (8.12.10/NCO/VER6.6) with ESMTP id iAJHwWH2133362 for ; Fri, 19 Nov 2004 10:58:32 -0700 Received: from d03av02.boulder.ibm.com (loopback [127.0.0.1]) by d03av02.boulder.ibm.com (8.12.11/8.12.11) with ESMTP id iAJHwW4d022674 for ; Fri, 19 Nov 2004 10:58:32 -0700 Received: from dyn318378bld.beaverton.ibm.com (DYN318378BLD.beaverton.ibm.com [9.47.18.189]) by d03av02.boulder.ibm.com (8.12.11/8.12.11) with ESMTP id iAJHwWkV022646; Fri, 19 Nov 2004 10:58:32 -0700 Received: from dyn318378bld.beaverton.ibm.com (localhost.localdomain [127.0.0.1]) by dyn318378bld.beaverton.ibm.com (8.12.8/8.12.8) with ESMTP id iAJHwUco004565; Fri, 19 Nov 2004 09:58:31 -0800 Received: (from janis@localhost) by dyn318378bld.beaverton.ibm.com (8.12.8/8.12.8/Submit) id iAJHwTvm004563; Fri, 19 Nov 2004 09:58:29 -0800 X-Authentication-Warning: dyn318378bld.beaverton.ibm.com: janis set sender to janis187@us.ibm.com using -f Date: Fri, 19 Nov 2004 18:37:00 -0000 From: Janis Johnson To: Eric Botcazou Cc: Janis Johnson , gcc@gcc.gnu.org Subject: Re: Running the compat testsuite in "non-mirror" mode Message-ID: <20041119175829.GA4515@us.ibm.com> References: <200411180815.10873.ebotcazou@libertysurf.fr> <200411190109.32937.ebotcazou@libertysurf.fr> <20041119001522.GA8214@us.ibm.com> <200411190914.31279.ebotcazou@libertysurf.fr> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <200411190914.31279.ebotcazou@libertysurf.fr> User-Agent: Mutt/1.4.1i X-SW-Source: 2004-11/txt/msg00687.txt.bz2 On Fri, Nov 19, 2004 at 09:17:04AM +0100, Eric Botcazou wrote: > > I'm sorry, I still don't understand what you mean my mirror and non-mirror > > modes. > > OK, sorry for being obtuse. > > The compat testsuite is currently automatically run only once, in what I call > mirror mode, that is the newly built compiler is tested against (an identical > copy of) itself. While this is useful for catching problems in the > argument/return value handling machinery of the back-end, this is only > moderately useful for compatibility purposes. Of course this is > customizable, but only externally (i.e. manually or with an external Makefile > for example). > > What I would like to have is the possibility to automatically run (i.e. with a > bare make -k check-gcc) the compat testsuite twice, once in the mirror mode > described above and once in a non-mirror mode. The latter would mean that > the newly built compiler is tested against a slight variation of itself, i.e. > typically with a non-default option, that could have an impact on the calling > conventions, turned on. So it would be possible to specify in the compat > testsuite harness (e.g. a platform-specific driver) that it should be > automatically run twice on a particular platform, in mirror mode and with an > hardcoded pair (-mfoo/-mno-foo) of options. I think I understand now. For anyone testing a particular target, the compat tests would be run first using the compiler under test to compile both parts of each test using default options, and again using different sets of options for the two parts of each test to make sure those options don't affect binary compatibility. Is that right? This is probably easy to set up in the compat.exp file for each compat testsuite; I'll take a look. Janis