Thanks. I do not think that we have blocker for M8. Most of the errors look not new as in previous tests, although I extended the tests to cover more VM options.
On Mon, Nov 10, 2008 at 7:49 PM, Sian January <[EMAIL PROTECTED]>wrote: > Thanks Chunrong. > > Are there any more comments before we start the vote, or any issues > that could be considered blockers? If not I'll start it off in the > next few hours. > > Also we'll be voting on r711744, and not r710036. Most of the > extended testing has been done on the earlier revision, although the > integrity testing has caught up to the new one. The changes were > extremely minor so I don't personally think this is a problem, but I > just wanted to clarify the situation before voting in case anyone else > is concerned. > > > > 2008/11/10 chunrong lai <[EMAIL PROTECTED]>: > > hi, colleagues: > > > > I uploaded the testing results of the reliabilities testing suite also: > > (12) Reliability testing > > In our batch-mode running of the 73 reliability test cases, 2 of > them > > failed in Linux X86 and 5 of them failed in Windows X86_64. > > Linux_x86: > > api.kernel.thread.ThreadSuspendResume.ThreadSuspendResume > > (ireproducible) > > api.kernel.threadgroup.EnumerateTest(irreproducible) > > > > Windows x86_64: > > api.kernel.hooks.ShtdwnHooksCornerCaseTest (irreproducible) > > api.kernel.string.InternThreadingTest(irreproducible) > > api.net.DatagramTest(irreproducible, HARMONY-5531) > > api.text.DecimalFormat_Locales(ireproducible, HARMONY-5810) > > api.zip.ZipEntryIterateThreadingTest(irreproducible) > > > > As marked, I can not reproduce any of the failure in standalone > > running. > > I talked with Yakushev and got guessed-cause as instable/stress OS > > state that we can often eliminate the errors by rebooting machine. > > On Fri, Nov 7, 2008 at 11:05 PM, chunrong lai <[EMAIL PROTECTED]> > wrote: > > > >> > >> Here is the M8 candidate (r710036) testing status ( > >> http://people.apache.org/~chunrong/snapshots/r710036/index.html): > >> > >> The passed test suites are: Ant Scenario (self-hosting), Axis, DRLVM > >> regression, DRLVM tests, Eclipse TPTP, scimark, Tomcat Scenario, VTS VM > test > >> suites. > >> > >> (1) ClasslibTest: > >> (1.1) All passed in windows x86_64. > >> (1.2) org.apache.harmony.xnet.provider.jsse.SSLSocketImplTest > fails > >> in Linux_x86, since r691267 (removed the hy.no.sig option) > >> (1.3) More concurrent test errors in Linux_x86, these failures only > >> happens with release binary so not observed in integrity testing (debug > >> build), > >> on the other hand RI passes those test so far, > >> AtomicLongArrayTest > >> testCompareAndSet > >> testCompareAndSetInMultipleThreads > >> testCountingInMultipleThreads > >> AtomicLongFieldUpdaterTest > >> testCompareAndSet > >> testCompareAndSetInMultipleThreads > >> AtomicLongTest > >> testCompareAndSet > >> testCompareAndSetInMultipleThreads > >> (2) Dacapo: > >> (2.1) It is reported PASSED in the snapshot testing, while running > >> with default VM options. > >> (2.2) Buqi reported that antlr will get failed with option -Xem:opt > or > >> -Xem:server, in HARMONY-5993. > >> I have not checked previous Dacapo running with such > options > >> so I do not know when the error started from. > >> (2.3) Running more VM options seperatedly, I also see that xalan > will > >> failed with -Xem:server, in 32bits platforms (OK in 64bits platforms). > >> > >> (3) EUTs: > >> In Linux x86 platform, the pass rate is 99.38%, slightly higher > than > >> the 99.36% in M7. > >> > >> (4) Eclipse HelloWorld: > >> A freshed running reports error since r641928, as filed in > >> HARMONY-5954. > >> The test will pass, if it is setup/configured successfully before, > as > >> in integrity testing, or the introduced workaround for an old SUN > >> JDK/Eclipse bundle ( > https://bugs.eclipse.org/bugs/show_bug.cgi?id=103263). > >> > >> (5) Functional tests: > >> The pass rate is 99.2%, the status is almost same as in M7 and we > >> have 1 less total failures in the two platforms. > >> There is only 1 new regression in Window x86_64 platform. > >> (5.1) Old regressions in two platforms: > >> api/java/text/MessageFormat/MessageFormatTest (HARMONY-5430) > >> api/java/util/jar/Manifest/ManifestTest (HARMONY-5473) > >> java/beans/beancontext/BeanContextTest > >> api/java/beans/persistence/EncoderDecoderTest > >> api/java/beans/persistence/EncoderTest > >> reg/vm/btest5625/Btest5625 > >> (5.2) Old regression in 1 platform > >> api/java/rmi/basicexception/BasicException (HARMONY-5823) > >> api/java/rmi/basicregistry/RemoteServerTest(HARMONY-5823) > >> > >> > api/java/math/F_BigIntegerMatrixMultiplyTest_01/F_BigIntegerMatrixMultiplyTest_01 > >> (Timeout) > >> org/apache/harmony/test/func/reg/jit/btest5710/Btest5710 > >> org/apache/harmony/test/func/reg/jit/btest8029/Btest8029 > >> org/apache/harmony/test/func/jpda/jdwp/scenario/ST07/ST07Test > >> org/apache/harmony/test/func/reg/vm/btest5717/Btest5717 > >> (Timeout, test too heavy) > >> jit/HLO/devirt/Runtime/RuntimeExtend1/RuntimeExtend1 (not a > >> regression?) > >> jit/HLO/inline/ControlFlow/IfElse/IfElse1/IfElseTest1 (looks > >> like issue in test) > >> org/apache/harmony/test/func/reg/vm/btest6353/Btest6353 > (might > >> be issue with the test) > >> (5.3) New regression in 1 platform > >> api/java/io/DataInputStream/DataInputStreamTest > >> > >> 6: Geronimo Unit Tests: > >> The pass rate is 99.6%. There are 3 error tests with similar > >> java.lang.NoClassDefFoundError for CORBA some related classes, > >> after we updated the YOKO dependencies, as filed in > HARMONY-5983. > >> > >> 7: JDK tools Test. > >> We have same timeout issues as M7. > >> > >> 8: Jetty Scanerio. > >> We have same Linux failure due to the unresolved HARMONY-5219. > >> > >> 9: SpecJVM 2008. > >> The test suite pass in Windows X86_64. > >> It also pass in Linux32 system with default options. > >> However one of the benchmark: compress, will hang in Linux 32 > bits > >> platform if with -Xem:server option. > >> > >> 10: Stress Test: > >> Besides similar failures as M7 I observed two looks-new > regressions > >> from jpda tests: > >> jpda/jdwp/scenario/MIXED002/MixedTest002 > >> jpda/jdwp/scenario/EVENT001/EventTest001 > >> The pass rate is 97.2% in Linux x86 and 98.3% in Windows X86_64 > >> platform, 0.5% lower than M7. > >> > >> 11: Struts. > >> Same status as M7. > >> > >> > >> 11: > >> > >> > >> > >> > >> > >> > >> > >> > >> > >> > >> > >> > >> > >> > >> > >> On Fri, Nov 7, 2008 at 9:20 PM, Sian January < > [EMAIL PROTECTED]>wrote: > >> > >>> Great - thanks Chunrong. In that case I think we should leave the > >>> vote until next week as there is testing still ongoing. > >>> > >>> 2008/11/7 chunrong lai <[EMAIL PROTECTED]>: > >>> > I will upload the snapshot testing result page soon. > >>> > The reliability testing has not been finished. > >>> > > >>> > > >>> > On Fri, Nov 7, 2008 at 7:12 PM, Sian January < > >>> [EMAIL PROTECTED]>wrote: > >>> > > >>> >> Are there any objections to starting a vote for M8 later today? > >>> >> > >>> >> -- > >>> >> Unless stated otherwise above: > >>> >> IBM United Kingdom Limited - Registered in England and Wales with > >>> number > >>> >> 741598. > >>> >> Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire > PO6 > >>> 3AU > >>> >> > >>> > > >>> > >>> > >>> > >>> -- > >>> Unless stated otherwise above: > >>> IBM United Kingdom Limited - Registered in England and Wales with > number > >>> 741598. > >>> Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 > 3AU > >>> > >> > >> > > > > > > -- > Unless stated otherwise above: > IBM United Kingdom Limited - Registered in England and Wales with number > 741598. > Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU >
