public inbox for mauve-discuss@sourceware.org
 help / color / mirror / Atom feed
From: "Markus Gälli" <markus.gaelli@iam.unibe.ch>
To: Stephen Crawley <crawley@dstc.edu.au>
Cc: mauve-discuss@sources.redhat.com
Subject: Re: [Q] Number of unit tests in Mauve and of assertions in Classpath?
Date: Thu, 11 Mar 2004 08:19:00 -0000	[thread overview]
Message-ID: <D1ADCDA1-7334-11D8-B196-000A958C4F3C@iam.unibe.ch> (raw)
In-Reply-To: <200403110649.i2B6nIEA013311@piglet.dstc.edu.au>

Hi Stephen,

thanks a lot for that very fast and good answers.
>> I am curious: Do the java implementers like Classpath use assertions 
>> in
>> their code or "only" your tests?
> Neither Classpath or Mauve uses Java assertions!  Both are designed to
> be compilable without relying on Java language extensions from JDK 1.4.
Ah, ok. Sure. Petty though. I am just comparing the number of per- 
postconditions used
with the number of unit tests in some big java case studies.
>> Especially I'd like to have some numbers of the latest versions (which
>> one would that be?) of Mauve + Classpath:
(snip)
> For the classpath/kissme regression, I'm not sure how many testcase
> files get included.  The regression runs over 10000 subtests, and
> roughly 145 are currently failing.
I guess this 145 are not independent, meaning, if you fixed one, many 
others would be fixed too. Right?

I am just writing a paper stating that it makes sense to sort failing 
tests by size of covered methods beginning with the smallest.
My motivation for asking here, was that if you had assertions (which I 
surely understand that you don't have), more of the failing
tests would fail at the most specific assertion, making my sorting a 
bit more useless.
But hey, you just gave me a wonderful argument: In some big and 
important projects, assertions are even not an option!
> It is worth noting that a significant number of subtests fail when
> you run them on a Sun JDK.  Sometimes the testcase is at fault, and
> sometimes the fault lies in the JDK.
>> - How many run green for Classpath?
> What do you mean by "green"?
Running without failure. So my next questions:

- Do you think sorting failing unit tests would be helpful?
- Does Mauve sort failing unit tests?
- If not, how could it be done?
- Do you know any (as responsive :-) java open source community with 
some big project and which
uses both, JDK 1.4 (thus theoretically assertions) and unit tests?

Thanks a lot - and cheers

Markus

  reply	other threads:[~2004-03-11  8:19 UTC|newest]

Thread overview: 11+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2004-03-11  6:28 Markus Gälli
2004-03-11  6:49 ` Stephen Crawley
2004-03-11  8:19   ` Markus Gälli [this message]
2004-03-11  9:34     ` Sascha Brawer
2004-03-11 10:51       ` Markus Gälli
2004-03-15 12:46         ` PureNative Software
2004-03-15 13:21           ` Markus Gälli
2004-03-16  3:04             ` PureNative Software
2004-03-16  3:04             ` Byron Vargas
2004-03-16 12:55               ` Markus Gälli
2004-03-16 17:15                 ` PureNative Software

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=D1ADCDA1-7334-11D8-B196-000A958C4F3C@iam.unibe.ch \
    --to=markus.gaelli@iam.unibe.ch \
    --cc=crawley@dstc.edu.au \
    --cc=mauve-discuss@sources.redhat.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for read-only IMAP folder(s) and NNTP newsgroup(s).