From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: (qmail 18021 invoked by alias); 11 Mar 2004 06:49:29 -0000 Mailing-List: contact mauve-discuss-help@sources.redhat.com; run by ezmlm Precedence: bulk List-Subscribe: List-Archive: List-Post: List-Help: , Sender: mauve-discuss-owner@sources.redhat.com Received: (qmail 18014 invoked from network); 11 Mar 2004 06:49:28 -0000 Received: from unknown (HELO piglet.dstc.edu.au) (130.102.176.1) by sources.redhat.com with SMTP; 11 Mar 2004 06:49:28 -0000 Received: from dstc.edu.au (credence.dstc.edu.au [130.102.177.137]) by piglet.dstc.edu.au (8.12.10/8.12.10) with ESMTP id i2B6nIEA013311; Thu, 11 Mar 2004 16:49:18 +1000 (EST) Message-Id: <200403110649.i2B6nIEA013311@piglet.dstc.edu.au> To: =?ISO-8859-1?Q?Markus_G=E4lli?= cc: mauve-discuss@sources.redhat.com, crawley@dstc.edu.au Subject: Re: [Q] Number of unit tests in Mauve and of assertions in Classpath? In-Reply-To: Message from =?ISO-8859-1?Q?Markus_G=E4lli?= of "Thu, 11 Mar 2004 07:26:38 +0100." <0D727A62-7325-11D8-91E0-000A958C4F3C@iam.unibe.ch> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Date: Thu, 11 Mar 2004 06:49:00 -0000 From: Stephen Crawley X-Scanned-By: MIMEDefang 2.39 X-SW-Source: 2004-q1/txt/msg00010.txt.bz2 Markus, You wrote: > if I understand correct, Mauve is a test suite for several Java > libraries / implementations. Correct. > I am curious: Do the java implementers like Classpath use assertions in > their code or "only" your tests? Neither Classpath or Mauve uses Java assertions! Both are designed to be compilable without relying on Java language extensions from JDK 1.4. > Especially I'd like to have some numbers of the latest versions (which > one would that be?) of Mauve + Classpath: > > - How many tests are in Mauve? You can count the Mauve testcase files yourself. The testcase files that are compiled and run in a specific regression depends on the 'keys' file you use. Each testcase file typically contains a number of individual subtests; i.e. calls to a 'harness.check(..)' method. For the classpath/kissme regression, I'm not sure how many testcase files get included. The regression runs over 10000 subtests, and roughly 145 are currently failing. It is worth noting that a significant number of subtests fail when you run them on a Sun JDK. Sometimes the testcase is at fault, and sometimes the fault lies in the JDK. > - How many run green for Classpath? What do you mean by "green"? > - How many assertions (like pre- postconditions/ invariants) are there > in Classpath? See above. Neither Mauve or Classpath use Java assertions. -- Steve