Re: Mauve regressions (Was: [cp-patches] FYI: Component.setName() fix)
Hi Mark, list. On Wed, 2006-07-26 at 23:09 +0200, Mark Wielaard wrote: Regressions: snip FAIL: java.math.BigDecimal.DiagBigDecimal FAIL: java.math.BigDecimal.construct FAIL: java.math.BigDecimal.setScale FWIW I think these were introduced in the BigDecimal merge from generics branch as noted on cp-patches at the time [1]. Doesn't help resolve but at least pinpoints where they crept in. Paul [1] http://developer.classpath.org/pipermail/classpath-patches/2006-June/002553.html -- Paul Jenner [EMAIL PROTECTED]
Mauve regressions (Was: [cp-patches] FYI: Component.setName() fix)
Hi (moved to main list), On Tue, 2006-07-25 at 17:56 -0400, Tom Tromey wrote: If you had a build of 0.91 + the corresponding jamvm you could make a Mauve baseline and run a comparison quite easily. Ideally we would do this after each release and simply reset the baseline file on builder. Then we could see regression reports versus the previous release automatically. I cleaned up the mauve Harness a bit more to make sure that all result lines were really only the PASS/FAIL and testname and fixed an issue so we can handle the early return of Object.wait(timeout) on cacao and I now have result files for 0.91 and current CVS. When builder picks up the changes I can install them there and then hopefully builder starts sending regressions since the 0.91 baseline. The results aren't that. bad (all generated against cacao on fc5 x86-64) Lots of new PASSes. One new fail: New fails: FAIL: javax.swing.JComponent.getInputMap And the following regressions: Regressions: FAIL: java.awt.Canvas.PaintTest FAIL: java.awt.Component.clickModifiers FAIL: java.awt.Component.keyPressTest FAIL: java.awt.FileDialog.TestGraphics FAIL: java.awt.Robot.keyPress FAIL: java.awt.Robot.keyRelease FAIL: java.awt.Robot.mouseMove FAIL: java.awt.Robot.mousePress FAIL: java.awt.Robot.mouseRelease FAIL: java.awt.Robot.mouseWheel FAIL: java.awt.Scrollbar.ScrollbarPaintTest FAIL: java.awt.TextArea.ScrollbarPaintTest FAIL: java.awt.TextComponent.ignoreOldMouseEvents FAIL: java.awt.image.ComponentSampleModel.getDataElements FAIL: java.lang.InheritableThreadLocal.simple FAIL: java.math.BigDecimal.DiagBigDecimal FAIL: java.math.BigDecimal.construct FAIL: java.math.BigDecimal.setScale FAIL: javax.swing.JEditorPane.getScrollableTracks FAIL: javax.swing.JMenu.getInputMap FAIL: javax.swing.RepaintManager.addDirtyRegion FAIL: javax.swing.text.AbstractDocument.BranchElement.getStartOffset FAIL: javax.swing.text.AbstractDocument.LeafElement.getStartOffset FAIL: javax.swing.text.AbstractDocument.filterTest Some of the awt tests might be spurious failures. I have not investigated any of them yet. But any help going through these would be appreaciated. Full report attached. Cheers, mark Baseline from: Wed Jul 26 15:28:12 CEST 2006 Regressions: FAIL: java.awt.Canvas.PaintTest FAIL: java.awt.Component.clickModifiers FAIL: java.awt.Component.keyPressTest FAIL: java.awt.FileDialog.TestGraphics FAIL: java.awt.Robot.keyPress FAIL: java.awt.Robot.keyRelease FAIL: java.awt.Robot.mouseMove FAIL: java.awt.Robot.mousePress FAIL: java.awt.Robot.mouseRelease FAIL: java.awt.Robot.mouseWheel FAIL: java.awt.Scrollbar.ScrollbarPaintTest FAIL: java.awt.TextArea.ScrollbarPaintTest FAIL: java.awt.TextComponent.ignoreOldMouseEvents FAIL: java.awt.image.ComponentSampleModel.getDataElements FAIL: java.lang.InheritableThreadLocal.simple FAIL: java.math.BigDecimal.DiagBigDecimal FAIL: java.math.BigDecimal.construct FAIL: java.math.BigDecimal.setScale FAIL: javax.swing.JEditorPane.getScrollableTracks FAIL: javax.swing.JMenu.getInputMap FAIL: javax.swing.RepaintManager.addDirtyRegion FAIL: javax.swing.text.AbstractDocument.BranchElement.getStartOffset FAIL: javax.swing.text.AbstractDocument.LeafElement.getStartOffset FAIL: javax.swing.text.AbstractDocument.filterTest Improvements: PASS: gnu.java.security.util.TestOfIntegerUtil PASS: gnu.javax.crypto.cipher.TestOfTripleDES PASS: gnu.javax.crypto.jce.TestOfCipherEngineInit PASS: gnu.javax.crypto.jce.TestOfCipherWrapUnwrap PASS: gnu.javax.crypto.jce.TestOfDHKeyAgreement2 PASS: gnu.javax.crypto.jce.TestOfPR27849 PASS: gnu.javax.crypto.jce.TestOfPR27853 PASS: gnu.javax.crypto.jce.TestOfTripleDESParityAdjustment PASS: gnu.javax.crypto.jce.keyring.TestOfKeystore PASS: gnu.javax.crypto.keyring.TestOfGnuPrivateKeyring PASS: gnu.javax.crypto.kwa.TestOfAESKeyWrap PASS: gnu.javax.crypto.kwa.TestOfTripleDESKeyWrap PASS: gnu.javax.crypto.pad.TestOfISO10126 PASS: java.awt.Component.invalidate PASS: java.awt.Component.isValid PASS: java.awt.Component.properties PASS: java.awt.Component.setComponentOrientation PASS: java.awt.Component.setFont PASS: java.awt.Component.setMaximumSize PASS: java.awt.Component.setMinimumSize PASS: java.awt.Component.setPreferredSize PASS: java.awt.Container.applyComponentOrientation PASS: java.awt.Container.setLayout PASS: java.awt.Graphics2D.security PASS: java.awt.Label.PaintTest PASS: java.awt.Point.setLocation PASS: java.awt.Robot.getPixelColor PASS: java.awt.TextArea.constructors PASS: java.awt.TextArea.testAppendText PASS: java.awt.TextArea.testInsertText PASS: java.awt.TextArea.testInvalidConstructorValues PASS: java.awt.TextArea.testReplaceText PASS: java.awt.TextField.constructors PASS: java.awt.Toolkit.security PASS: java.awt.font.ImageGraphicAttribute.ImageGraphicAttributeTest PASS: java.awt.font.ShapeGraphicAttribute.ShapeGraphicAttributeTest PASS: java.awt.image.BandedSampleModel.createCompatibleSampleModel PASS: java.awt.image.BandedSampleModel.createDataBuffer PASS:
Re: Mauve regressions (Was: [cp-patches] FYI: Component.setName() fix)
On Wed, 2006-07-26 at 17:33 -0400, Tom Tromey wrote: I thought the builder was running xvfb so that the AWT tests were isolated on their own X server... ? I usually run the tests directly from the command line, a la jamvm Harness -debug -showpasses -vm jamvm gnu/testlet/java/awt/Robot I believe Mark also ran the tests locally, as the builder hasn't picked up some recent changes to Mauve. Those tests might (probably will?) show up as passes on the builder too. Francis
Re: Mauve regressions (Was: [cp-patches] FYI: Component.setName() fix)
Hi, Running off the latest HEAD, the following pass on my machine: FAIL: java.awt.Component.keyPressTest FAIL: java.awt.FileDialog.TestGraphics FAIL: java.awt.Robot.keyPress FAIL: java.awt.Robot.keyRelease FAIL: java.awt.Robot.mouseMove FAIL: java.awt.Robot.mousePress FAIL: java.awt.Robot.mouseRelease FAIL: java.awt.Robot.mouseWheel FAIL: java.awt.Scrollbar.ScrollbarPaintTest FAIL: java.awt.TextArea.ScrollbarPaintTest FAIL: java.awt.TextComponent.ignoreOldMouseEvents FAIL: java.lang.InheritableThreadLocal.simple FAIL: javax.swing.RepaintManager.addDirtyRegion (Roman just fixed this) Most of those tests use the Robot in some way, and I've noticed that tests using the robot require that the computer be dedicated solely to the tests... running it in the background while doing other work can cause the tests to return incorrect results. Anyways, that narrows down the list a bit if those tests do indeed pass =) Francis
Re: Mauve regressions (Was: [cp-patches] FYI: Component.setName() fix)
Francis == Francis Kung [EMAIL PROTECTED] writes: Francis Most of those tests use the Robot in some way, and I've Francis noticed that tests using the robot require that the computer Francis be dedicated solely to the tests... running it in the Francis background while doing other work can cause the tests to Francis return incorrect results. I thought the builder was running xvfb so that the AWT tests were isolated on their own X server... ? Tom
Re: Mauve regressions (Was: [cp-patches] FYI: Component.setName() fix)
Mark == Mark Wielaard [EMAIL PROTECTED] writes: Mark The results aren't that. bad (all generated against cacao on fc5 x86-64) Mark Lots of new PASSes. One new fail: I don't think new fails matter much. I tend to ignore them myself; I think they're also ignored for the purpose of baseline computation. Mark FAIL: java.lang.InheritableThreadLocal.simple I updated Classpath and Mauve and ran this test case in my Eclipse workspace -- everything passed. Tom
Re: Mauve regressions (Was: [cp-patches] FYI: Component.setName() fix)
Hi, On Wed, 2006-07-26 at 17:33 -0400, Tom Tromey wrote: Mark FAIL: java.lang.InheritableThreadLocal.simple I updated Classpath and Mauve and ran this test case in my Eclipse workspace -- everything passed. Same here now for both jamvm and cacao when run just this test. But sometimes when I run all of the lang tests I can sometimes get it to fail with cacao. So this might be a cacao specific issue. Cheers, Mark
Re: Mauve regressions (Was: [cp-patches] FYI: Component.setName() fix)
Hi, On Wed, 2006-07-26 at 17:48 -0400, Francis Kung wrote: I believe Mark also ran the tests locally, as the builder hasn't picked up some recent changes to Mauve. Those tests might (probably will?) show up as passes on the builder too. Yes, those were my local ran tests. Rerunning them a couple of times by hand and making sure nothing else is running they do indeed PASS. Builder hasn't completed a new run with the new Harness yet. I cleared the previous baselines to get a fresh start (the old ones had a couple of test results with trailing ':' characters which confused the comparison). Cheers, mark
