Intel's AWT/Swing test suite

Intel's AWT/Swing test suite

[David Gilbert]

Hi All,

Last week Intel posted their AWT/Swing test suite at the Harmony project site.  I've 
been taking a look at it, to see what value there is in it for GNU Classpath...and, 
in spite of a lot overlap with Mauve, there are many new tests in there that are 
useful to us.

Unfortunately they decided to write the tests in the java.awt.* and javax.swing.* 
namespace, which makes it awkward to run the tests, both against Sun's reference 
implementation (to verify the tests) and against GNU Classpath (to find bugs in our 
implementation).  However, it has been relatively straightforward (though tedious) 
to refactor the tests to move the tests into their own namespace (I used 
test.java.awt.* and test.javax.swing.*).

You can find a jar file containing both the (JUnit-based) tests and corresponding 
source code (for around 2,600 tests so far) here:

http://www.object-refinery.com/classpath/htests-20060620.jar

To run the tests, use the following command line:

jamvm -classpath .:lib/junit.jar junit.textui.TestRunner test.java.awt.PackageTestSuite

...replacing the class name with the name of any test class, or the package level 
test suites:

test.java.awt.PackageTestSuite
test.java.awt.datatransfer.PackageTestSuite
test.java.awt.event.PackageTestSuite
test.java.awt.font.PackageTestSuite
test.java.awt.image.PackageTestSuite
test.javax.swing.PackageTestSuite
test.javax.swing.border.PackageTestSuite
test.javax.swing.colorchooser.PackageTestSuite
test.javax.swing.event.PackageTestSuite
test.javax.swing.plaf.PackageTestSuite
test.javax.swing.table.PackageTestSuite
test.javax.swing.tree.PackageTestSuite
test.javax.swing.undo.PackageTestSuite

There is also a test suite that will run all tests:

test.AWTSwingTestSuite (runs all tests)

There are still many tests that I haven't extracted from javax.swing.*, 
javax.swing.plaf.basic.*, javax.swing.plaf.metal.* and javax.swing.text.*.  I'll 
post a revised test jar file when I've completed those.

Regards,

Dave

Re: Intel's AWT/Swing test suite

[Roman Kennke]

Hi David,

that*s awesome! When things are cleaned up we certainly should add this
to some daily test script, or maybe hook up into Mauve (dunno how that
could be done wrt to licensing issues though).

I come to think that the refactoring part should be quite easy using
Eclipse, it's usually only a matter of a few clicks.

/Roman

> Last week Intel posted their AWT/Swing test suite at the Harmony project site.  I've 
> been taking a look at it, to see what value there is in it for GNU Classpath...and, 
> in spite of a lot overlap with Mauve, there are many new tests in there that are 
> useful to us.
> 
> Unfortunately they decided to write the tests in the java.awt.* and javax.swing.* 
> namespace, which makes it awkward to run the tests, both against Sun's reference 
> implementation (to verify the tests) and against GNU Classpath (to find bugs in our 
> implementation).  However, it has been relatively straightforward (though tedious) 
> to refactor the tests to move the tests into their own namespace (I used 
> test.java.awt.* and test.javax.swing.*).
> 
> You can find a jar file containing both the (JUnit-based) tests and corresponding 
> source code (for around 2,600 tests so far) here:
> 
> http://www.object-refinery.com/classpath/htests-20060620.jar
> 
> To run the tests, use the following command line:
> 
> jamvm -classpath .:lib/junit.jar junit.textui.TestRunner test.java.awt.PackageTestSuite
> 
> ...replacing the class name with the name of any test class, or the package level 
> test suites:
> 
> test.java.awt.PackageTestSuite
> test.java.awt.datatransfer.PackageTestSuite
> test.java.awt.event.PackageTestSuite
> test.java.awt.font.PackageTestSuite
> test.java.awt.image.PackageTestSuite
> test.javax.swing.PackageTestSuite
> test.javax.swing.border.PackageTestSuite
> test.javax.swing.colorchooser.PackageTestSuite
> test.javax.swing.event.PackageTestSuite
> test.javax.swing.plaf.PackageTestSuite
> test.javax.swing.table.PackageTestSuite
> test.javax.swing.tree.PackageTestSuite
> test.javax.swing.undo.PackageTestSuite
> 
> There is also a test suite that will run all tests:
> 
> test.AWTSwingTestSuite (runs all tests)
> 
> There are still many tests that I haven't extracted from javax.swing.*, 
> javax.swing.plaf.basic.*, javax.swing.plaf.metal.* and javax.swing.text.*.  I'll 
> post a revised test jar file when I've completed those.
> 
> Regards,
> 
> Dave
> 

Re: Intel's AWT/Swing test suite

[David Gilbert]

Hi All,

I've uploaded a new jar file containing modified test cases from the 
Intel test suite (the jar contains both .java and .class files, see 
below for more details).  Compared to the jar I posted last month, this 
one contains around 900 additional tests.  Most of the new tests are for 
the javax.swing.text.* package:

http://www.object-refinery.com/classpath/htests-20060724.jar

Instructions for running the tests are the same as in my previous message.

Regards,

Dave


David Gilbert wrote:

> Hi All,
>
> Last week Intel posted their AWT/Swing test suite at the Harmony 
> project site.  I've been taking a look at it, to see what value there 
> is in it for GNU Classpath...and, in spite of a lot overlap with 
> Mauve, there are many new tests in there that are useful to us.
>
> Unfortunately they decided to write the tests in the java.awt.* and 
> javax.swing.* namespace, which makes it awkward to run the tests, both 
> against Sun's reference implementation (to verify the tests) and 
> against GNU Classpath (to find bugs in our implementation).  However, 
> it has been relatively straightforward (though tedious) to refactor 
> the tests to move the tests into their own namespace (I used 
> test.java.awt.* and test.javax.swing.*).
>
> You can find a jar file containing both the (JUnit-based) tests and 
> corresponding source code (for around 2,600 tests so far) here:
>
> http://www.object-refinery.com/classpath/htests-20060620.jar
>
> To run the tests, use the following command line:
>
> jamvm -classpath .:lib/junit.jar junit.textui.TestRunner 
> test.java.awt.PackageTestSuite
>
> ...replacing the class name with the name of any test class, or the 
> package level test suites:
>
> test.java.awt.PackageTestSuite
> test.java.awt.datatransfer.PackageTestSuite
> test.java.awt.event.PackageTestSuite
> test.java.awt.font.PackageTestSuite
> test.java.awt.image.PackageTestSuite
> test.javax.swing.PackageTestSuite
> test.javax.swing.border.PackageTestSuite
> test.javax.swing.colorchooser.PackageTestSuite
> test.javax.swing.event.PackageTestSuite
> test.javax.swing.plaf.PackageTestSuite
> test.javax.swing.table.PackageTestSuite
> test.javax.swing.tree.PackageTestSuite
> test.javax.swing.undo.PackageTestSuite
>
> There is also a test suite that will run all tests:
>
> test.AWTSwingTestSuite (runs all tests)
>
> There are still many tests that I haven't extracted from 
> javax.swing.*, javax.swing.plaf.basic.*, javax.swing.plaf.metal.* and 
> javax.swing.text.*.  I'll post a revised test jar file when I've 
> completed those.
>
> Regards,
>
> Dave

Re: Intel's AWT/Swing test suite

[Roman Kennke]

Hello David,

> I've uploaded a new jar file containing modified test cases from the 
> Intel test suite (the jar contains both .java and .class files, see 
> below for more details).  Compared to the jar I posted last month, this 
> one contains around 900 additional tests.  Most of the new tests are for 
> the javax.swing.text.* package:

Thank you for this great work! This will surely help alot getting our 
Swing more stable...

We should also clean up the Mauve tests. There seem to be quite a couple 
of tests that also fail with current JDK.

/Roman