Mauve regressions for J2SDK 1.4.2

Mauve regressions for J2SDK 1.4.2

[Stephen Crawley]

[-- Attachment #1: Type: text/plain, Size: 267 bytes --]


Folks,

As a sanity check of the mauve testcases, I ran them against the Java
compiler and JVM in Sun's JDK 1.4.2.   The results are attached.

Without looking at the 106 failures in detail, I suspect that most are
due to bugs in the testcases themselves.

-- Steve

[-- Attachment #2: log --]
[-- Type: application/octet-stream , Size: 10853 bytes --]

make -C /home/stephen/mauve check KEYS=kissme 
make[1]: Entering directory `/home/stephen/mauve'
ok=no; \
if test -f .save-keys && test -f choices && test "`cat .save-keys`" = "kissme"; then \
  ok=yes; \
fi; \
here=`/bin/pwd`; \
if test "$ok" = no; then \
  echo "kissme" > .save-keys; \
  cd . && /bin/sh choose $here kissme; \
fi
make   classes.stamp
make[2]: Entering directory `/home/stephen/mauve'
ok=no; \
if test -f .save-keys && test -f choices && test "`cat .save-keys`" = "kissme"; then \
  ok=yes; \
fi; \
here=`/bin/pwd`; \
if test "$ok" = no; then \
  echo "kissme" > .save-keys; \
  cd . && /bin/sh choose $here kissme; \
fi
make[2]: `classes.stamp' is up to date.
make[2]: Leaving directory `/home/stephen/mauve'
make  check-local
make[2]: Entering directory `/home/stephen/mauve'
ok=no; \
if test -f .save-keys && test -f choices && test "`cat .save-keys`" = "kissme"; then \
  ok=yes; \
fi; \
here=`/bin/pwd`; \
if test "$ok" = no; then \
  echo "kissme" > .save-keys; \
  cd . && /bin/sh choose $here kissme; \
fi
if test -d /tmp/mauve-testdir ; then \
  chmod -R 777 /tmp/mauve-testdir ; \
  rm -rf /tmp/mauve-testdir ; \
fi
cat classes | \
CLASSPATH=$CLASSPATH:`/bin/pwd` JAVAC="/usr/java/j2sdk1.4.2/bin/javac" JAVA="/usr/java/j2sdk1.4.2/bin/java" /usr/java/j2sdk1.4.2/bin/java gnu.testlet.SimpleTestHarness 
FAIL: gnu.testlet.java.awt.geom.CubicCurve2D.solveCubic: 0.25x^3 - 1.0x^2 = 0 (number 1)
FAIL: gnu.testlet.java.awt.geom.CubicCurve2D.solveCubic: 0.25x^3 - 1.0x^2 = 0 (number 2)
FAIL: gnu.testlet.java.awt.geom.CubicCurve2D.solveCubic: 1.0x^3 + 1.0x^2 = 0 (number 1)
FAIL: gnu.testlet.java.awt.geom.CubicCurve2D.solveCubic: 1.0x^3 + 1.0x^2 = 0 (number 3)
FAIL: gnu.testlet.java.awt.geom.CubicCurve2D.solveCubic: 1.0x^3 + 0.5x^2 = 0 (number 1)
FAIL: gnu.testlet.java.awt.geom.CubicCurve2D.solveCubic: 1.0x^3 + 0.5x^2 = 0 (number 3)
FAIL: gnu.testlet.java.awt.geom.CubicCurve2D.solveCubic: 1.0x^3 - 57.0x^2 + 1071.0x - 6647.0 = 0 (number 1)
FAIL: gnu.testlet.java.awt.geom.CubicCurve2D.solveCubic: 1.0x^3 - 57.0x^2 + 1071.0x - 6647.0 = 0 (number 2)
FAIL: gnu.testlet.java.awt.geom.CubicCurve2D.solveCubic: 1.0x^3 - 11.0x^2 - 493.0x + 6647.0 = 0 (number 1)
FAIL: gnu.testlet.java.awt.geom.CubicCurve2D.solveCubic: 1.0x^3 - 11.0x^2 - 493.0x + 6647.0 = 0 (number 2)
FAIL: gnu.testlet.java.awt.geom.QuadCurve2D.solveQuadratic: 0.1x^2 + 20.0x + 1000.0 = 0 (number 1)
FAIL: gnu.testlet.java.awt.geom.QuadCurve2D.solveQuadratic: 0.1x^2 + 20.0x + 1000.0 = 0 (number 2)
FAIL: gnu.testlet.java.awt.geom.QuadCurve2D.solveQuadratic: 4.0x^2 - 20.0x + 25.0 = 0 (number 1)
FAIL: gnu.testlet.java.awt.geom.QuadCurve2D.solveQuadratic: 4.0x^2 - 20.0x + 25.0 = 0 (number 2)
FAIL: gnu.testlet.java.io.File.security: dir.canWrite() (number 1)
FAIL: gnu.testlet.java.io.File.security: dir.canRead() (number 1)
FAIL: gnu.testlet.java.io.File.security: file.createNewFile() (number 1)
FAIL: gnu.testlet.java.io.File.security: file.delete() (number 1)
FAIL: gnu.testlet.java.io.File.security: dir.list(null) (number 1)
FAIL: gnu.testlet.java.io.File.security: dir.list() (number 1)
FAIL: gnu.testlet.java.io.File.security: dir.listFiles() (number 1)
FAIL: gnu.testlet.java.io.File.security: dir.listFiles(FilenameFilter) (number 1)
FAIL: gnu.testlet.java.io.File.security: dir.listFiles(FileFilter) (number 1)
FAIL: gnu.testlet.java.io.File.security: dir.createTempFile(2-args) (number 1)
FAIL: gnu.testlet.java.io.File.security: File.createTempFile(3-args) (number 1)
FAIL: gnu.testlet.java.io.File.security: dir.setReadOnly() (number 1)
FAIL: gnu.testlet.java.io.File.security: File.listRoots() (number 1)
FAIL: gnu.testlet.java.io.File.security: file.renameTo() (number 1)
FAIL: gnu.testlet.java.io.File.security: dir.setLastModified() (number 1)
FAIL: gnu.testlet.java.io.File.security: dir.deleteOnExit() (number 1)
FAIL: gnu.testlet.java.io.FilePermission.simple: uncaught exception at  number 1
FAIL: uncaught exception loading gnu.testlet.java.io.FilterWriter.write
FAIL: gnu.testlet.java.io.ObjectInputOutput.Compat2: Compatibility test for type mismatch when calling get methods (number 2)
FAIL: gnu.testlet.java.io.ObjectInputOutput.Compat2: Compatibility test for type mismatch when calling get methods (number 3)
FAIL: gnu.testlet.java.io.Utf8Encoding.mojo: Four Byte Range Error (0) (number 1)
FAIL: gnu.testlet.java.io.Utf8Encoding.mojo: Four Byte Range Error (1) (number 1)
FAIL: gnu.testlet.java.io.Utf8Encoding.mojo: Five Bytes (0) (number 1)
FAIL: gnu.testlet.java.io.Utf8Encoding.mojo: Five Bytes (1) (number 1)
FAIL: gnu.testlet.java.io.Utf8Encoding.mojo: Six Bytes (0) (number 1)
FAIL: gnu.testlet.java.io.Utf8Encoding.mojo: Six Bytes (1) (number 1)
FAIL: gnu.testlet.java.io.Utf8Encoding.mojo: Orphan Continuation (1) (number 1)
FAIL: gnu.testlet.java.io.Utf8Encoding.mojo: Orphan Continuation (2) (number 1)
FAIL: gnu.testlet.java.io.Utf8Encoding.mojo: Four Byte Range Error (2) (number 1)
FAIL: gnu.testlet.java.lang.Character.classify12 (number 1)
FAIL: gnu.testlet.java.lang.Character.getType (number 11)
FAIL: gnu.testlet.java.lang.Character.getType (number 20)
FAIL: gnu.testlet.java.lang.Character.getType (number 22)
FAIL: gnu.testlet.java.lang.Double.DoubleTest: Error: test_toString failed - 10 (number 1)
Expected: 0.001
Got: 0.0010
FAIL: gnu.testlet.java.lang.Double.new_Double (number 1)
FAIL: gnu.testlet.java.lang.Float.FloatTest: Error: test_toString failed - 10 (number 1)
FAIL: gnu.testlet.java.lang.Thread.contextClassLoader: run with null classloader (number 1)
FAIL: gnu.testlet.java.lang.Thread.priority: New Thread can be set to priority 6 (number 1)
FAIL: gnu.testlet.java.lang.Thread.priority: New Thread can be set to priority 7 (number 1)
FAIL: gnu.testlet.java.lang.Thread.priority: New Thread can be set to priority 8 (number 1)
FAIL: gnu.testlet.java.lang.Thread.priority: New Thread can be set to priority 9 (number 1)
FAIL: gnu.testlet.java.lang.Thread.priority: New Thread can be set to priority 10 (number 1)
FAIL: gnu.testlet.java.lang.Thread.priority: Started Thread can be set to priority 6 (number 1)
FAIL: gnu.testlet.java.lang.Thread.priority: Started Thread can be set to priority 7 (number 1)
FAIL: gnu.testlet.java.lang.Thread.priority: Started Thread can be set to priority 8 (number 1)
FAIL: gnu.testlet.java.lang.Thread.priority: Started Thread can be set to priority 9 (number 1)
FAIL: gnu.testlet.java.lang.Thread.priority: Started Thread can be set to priority 10 (number 1)
FAIL: gnu.testlet.java.lang.reflect.Method.invoke: takes_int for class gnu.testlet.java.lang.reflect.Method.invoke (number 7)
FAIL: gnu.testlet.java.math.BigDecimal.DiagBigDecimal: div376 (number 1)
FAIL: gnu.testlet.java.math.BigDecimal.DiagBigDecimal: mul038 (number 1)
FAIL: gnu.testlet.java.math.BigDecimal.DiagBigDecimal: sca007 (number 1)
FAIL: gnu.testlet.java.net.DatagramPacket.DatagramPacketTest2: invalid_addr: test 1 - Should throw NullPointerException (number 1)
FAIL: gnu.testlet.java.net.DatagramPacket.DatagramPacketTest2: invalid_addr: test 2 - Should throw NullPointerException (number 1)
FAIL: gnu.testlet.java.net.DatagramPacket.DatagramPacketTest2: invalid_addr: test 3 - Should throw NullPointerException (number 1)
FAIL: gnu.testlet.java.net.MulticastSocket.MulticastSocketTest: joinGroup() twice. (number 1)
FAIL: gnu.testlet.java.net.Socket.SocketTest: wrong SocketException error message (number 1)
FAIL: gnu.testlet.java.net.URLClassLoader.getResource: Unexpected exception: java.io.IOException: Permission denied (number 1)
FAIL: gnu.testlet.java.security.Security.getProviders: Tom : getProviders("CoffeeMaker.WHAT") (number 1)
FAIL: gnu.testlet.java.security.Security.getProviders: Tom : getProviders("CoffeeMaker.FOO minCapacity:150") (number 1)
FAIL: gnu.testlet.java.security.Security.getProviders: Tom, Dick : getProviders("CoffeeMaker.FOO minCapacity:150") (number 1)
FAIL: gnu.testlet.java.security.Security.getProviders: Tom, Dick, Harry : getProviders("CoffeeMaker.FOO minCapacity:150") (number 1)
FAIL: gnu.testlet.java.text.AttributedString.Test: Attribute key count (number 1)
FAIL: gnu.testlet.java.text.AttributedString.Test: getRunLimit (number 1)
FAIL: gnu.testlet.java.text.Collator.GetSet: default decomposition (number 1)
FAIL: gnu.testlet.java.text.DateFormatSymbols.Test: invalid locale (number 1)
FAIL: gnu.testlet.java.text.DecimalFormat.format: pattern #.# (number 2)
FAIL: gnu.testlet.java.text.DecimalFormat.parse: pattern 0.0000E# (number 1)
FAIL: gnu.testlet.java.text.DecimalFormat.parse: pattern 0.0000E# (number 2)
FAIL: gnu.testlet.java.text.DecimalFormat.parse: uncaught exception at "pattern 0.0000E#" number 3
FAIL: gnu.testlet.java.text.DecimalFormat.topattern (number 1)
FAIL: gnu.testlet.java.text.DecimalFormat.topattern (number 2)
FAIL: gnu.testlet.java.text.DecimalFormat.topattern (number 3)
FAIL: gnu.testlet.java.text.DecimalFormat.topattern (number 5)
FAIL: gnu.testlet.java.text.RuleBasedCollator.jdk11: constructor rule parsing (number 21)
FAIL: gnu.testlet.java.text.RuleBasedCollator.jdk11: constructor rule parsing (number 29)
FAIL: gnu.testlet.java.text.SimpleDateFormat.regress: EST (number 1)
FAIL: gnu.testlet.java.util.ArrayList.AcuniaArrayListTest: should not throw a ConcurrentModificationException -- 2 (number 1)
FAIL: gnu.testlet.java.util.Calendar.ampm (number 1)
FAIL: gnu.testlet.java.util.Calendar.ampm (number 3)
FAIL: gnu.testlet.java.util.Calendar.ampm (number 9)
FAIL: gnu.testlet.java.util.Calendar.ampm (number 11)
FAIL: gnu.testlet.java.util.HashMap.AcuniaHashMapTest: it.hasNext after hm.remove should throw ConcurrentModificationException (number 1)
FAIL: gnu.testlet.java.util.Properties.AcuniaPropertiesTest: checkvalue -- got:$ents=$ (number 1)
FAIL: gnu.testlet.java.util.Properties.AcuniaPropertiesTest: check if all elements were found -- got: [!comment=, #morec=omments] (number 1)
FAIL: gnu.testlet.java.util.Vector.AcuniaVectorTest: should throw NullPointerException (number 1)
FAIL: gnu.testlet.java.util.Vector.AcuniaVectorTest: should throw NullPointerException (number 1)
FAIL: gnu.testlet.java.util.Vector.AcuniaVectorTest: checking capacity -- 1 (number 1)
FAIL: gnu.testlet.java.util.Vector.AcuniaVectorTest: capacityIncrement was not defined correctly (number 1)
FAIL: gnu.testlet.java.util.Vector.AcuniaVectorTest: should not throw an Exception, got java.util.ConcurrentModificationException (number 1)
FAIL: gnu.testlet.java.util.zip.ZipFile.newZipFile: java.io.IOException: Permission denied (number 1)
FAIL: gnu.testlet.java.util.regex.CharacterClasses: test: [[] (number 1)
FAIL: gnu.testlet.java.util.regex.CharacterClasses: test: [^[] (number 1)
106 of 12809 tests failed
make[2]: *** [check-local] Error 1
make[2]: Leaving directory `/home/stephen/mauve'
make[1]: *** [check-am] Error 2
make[1]: Leaving directory `/home/stephen/mauve'
make: *** [run-mauve-regression] Error 2

Re: Mauve regressions for J2SDK 1.4.2

[Sascha Brawer]

Stephen Crawley <crawley@dstc.edu.au> wrote on Sun, 29 Feb 2004 17:32:28
+1000:

>As a sanity check of the mauve testcases, I ran them against the Java
>compiler and JVM in Sun's JDK 1.4.2.   The results are attached.
>
>Without looking at the 106 failures in detail, I suspect that most are
>due to bugs in the testcases themselves.

I can only comment on the FAILs for java.awt.geom: In the Sun JDK
1.4.1_01, the methods CubicCurve2D.solveCubic and
QuadCurve2D.solveQuadratic are indeed not able to find many existing
solutions. In other words, those bugs are real, not in the test case.

Maybe we need an XFAIL mechanism? This would allow us to specify which
testlets are known to fail on what VMs.

-- Sascha

Sascha Brawer, brawer@dandelis.ch, http://www.dandelis.ch/people/brawer/