Swapnil and I looked at the Jenkins failures of Geode release branch [1] and all of them were running on the same box as Geode-nightly [2] build from yesterday...
"Building remotely on H0 <https://builds.apache.org/computer/H0> (*Hadoop Tez yahoo-not-h2*)" We're still not sure what configuration on that machine could cause the problem only for this test, but it's very suspicious... We're kicking another build on a different machine for the release branch to validate this theory. [1] Geode-release Jenkins: - https://builds.apache.org/job/Geode-release/10/console - https://builds.apache.org/job/Geode-release/11/console - https://builds.apache.org/job/Geode-release/12/console - https://builds.apache.org/job/Geode-release/13/console - https://builds.apache.org/job/Geode-release/14/console [1] Geode-nightly Jenkins: - https://builds.apache.org/job/Geode-nightly/537/console On Fri, Jul 22, 2016 at 10:59 AM, Bruce Schuchardt <bschucha...@pivotal.io> wrote: > If we disable the other tests in that class it's possible that Jenkins > would capture enough output for us to figure out what's happening. On the > other hand maybe we should just delete this whole test class. > > Le 7/22/2016 à 9:39 AM, Kirk Lund a écrit : > >> ConsoleDistributionManagerDUnitTest seems to be failing a bit too >> consistently to be a random coincidence. There must be something about that >> nightly build that keeps causing it to fail. Any ideas what sort of info we >> would need to capture to figure out what's happening? >> >> -Kirk >> >> >> On Fri, Jul 22, 2016 at 7:57 AM, Apache Jenkins Server < >> jenk...@builds.apache.org <mailto:jenk...@builds.apache.org>> wrote: >> >> See <https://builds.apache.org/job/Geode-nightly/537/changes> >> >> Changes: >> >> [jiliao] GEODE-1680: Change "list regions" to DATA:READ permissions >> >> [bschuchardt] GEODE-1685 Upgrade to JGroups 3.6.10.Final >> >> [dschneider] GEODE-1420: fix 100ms delay in stopping tombstone sweeper >> >> [boglesby] GEODE-1677: Events are now added to tmpQueuedEvents >> while shadow pr is >> >> [agingade] GEODE-1669: Made changes to add/remove list of >> interested keys using >> >> ------------------------------------------ >> [...truncated 838 lines...] >> :geode-common:check >> :geode-common:build >> :geode-common:distributedTest >> :geode-common:flakyTest >> :geode-common:integrationTest >> :geode-core:assemble >> :geode-core:checkMissedTests >> Download >> >> https://repo1.maven.org/maven2/org/apache/derby/derby/10.2.2.0/derby-10.2.2.0.pom >> Download >> >> https://repo1.maven.org/maven2/org/apache/derby/derby/10.2.2.0/derby-10.2.2.0.jar >> :geode-core:test >> < >> https://repo1.maven.org/maven2/org/apache/derby/derby/10.2.2.0/derby-10.2.2.0.jar%0A:geode-core:test >> > >> >> :geode-core:check >> :geode-core:build >> :geode-core:distributedTest >> >> >> com.gemstone.gemfire.distributed.internal.ConsoleDistributionManagerDUnitTest >> > testApplications FAILED >> com.gemstone.gemfire.cache.CacheClosedException: Could not PDX >> serialize because the cache was closed >> at >> >> com.gemstone.gemfire.pdx.internal.TypeRegistry.getPdxSerializer(TypeRegistry.java:325) >> at >> >> com.gemstone.gemfire.internal.InternalDataSerializer.writeUserObject(InternalDataSerializer.java:1482) >> at >> >> com.gemstone.gemfire.internal.InternalDataSerializer.writeWellKnownObject(InternalDataSerializer.java:1380) >> at >> >> com.gemstone.gemfire.internal.InternalDataSerializer.basicWriteObject(InternalDataSerializer.java:2136) >> at >> >> com.gemstone.gemfire.DataSerializer.writeObject(DataSerializer.java:3240) >> at >> >> com.gemstone.gemfire.internal.admin.remote.DestroyRegionMessage.toData(DestroyRegionMessage.java:82) >> at >> >> com.gemstone.gemfire.internal.InternalDataSerializer.invokeToData(InternalDataSerializer.java:2349) >> at >> >> com.gemstone.gemfire.internal.InternalDataSerializer.writeDSFID(InternalDataSerializer.java:1342) >> at >> >> com.gemstone.gemfire.internal.tcp.MsgStreamer.writeMessage(MsgStreamer.java:243) >> at >> >> com.gemstone.gemfire.distributed.internal.direct.DirectChannel.sendToMany(DirectChannel.java:389) >> at >> >> com.gemstone.gemfire.distributed.internal.direct.DirectChannel.sendToOne(DirectChannel.java:241) >> at >> >> com.gemstone.gemfire.distributed.internal.direct.DirectChannel.send(DirectChannel.java:618) >> at >> >> com.gemstone.gemfire.distributed.internal.membership.gms.mgr.GMSMembershipManager.directChannelSend(GMSMembershipManager.java:1705) >> at >> >> com.gemstone.gemfire.distributed.internal.membership.gms.mgr.GMSMembershipManager.send(GMSMembershipManager.java:1899) >> at >> >> com.gemstone.gemfire.distributed.internal.DistributionChannel.send(DistributionChannel.java:88) >> at >> >> com.gemstone.gemfire.distributed.internal.DistributionManager.sendOutgoing(DistributionManager.java:3427) >> at >> >> com.gemstone.gemfire.distributed.internal.DistributionManager.sendMessage(DistributionManager.java:3468) >> at >> >> com.gemstone.gemfire.distributed.internal.DistributionManager.putOutgoing(DistributionManager.java:1828) >> at >> >> com.gemstone.gemfire.internal.admin.remote.RemoteGfManagerAgent.sendAsync(RemoteGfManagerAgent.java:551) >> at >> >> com.gemstone.gemfire.internal.admin.remote.RemoteGemFireVM.sendAsync(RemoteGemFireVM.java:950) >> at >> >> com.gemstone.gemfire.internal.admin.remote.AdminRegion.sendAsync(AdminRegion.java:451) >> at >> >> com.gemstone.gemfire.internal.admin.remote.AdminRegion.destroyRegion(AdminRegion.java:128) >> at >> >> com.gemstone.gemfire.distributed.internal.ConsoleDistributionManagerDUnitTest.testApplications(ConsoleDistributionManagerDUnitTest.java:308) >> >> 7431 tests completed, 1 failed, 587 skipped >> :geode-core:distributedTest FAILED >> :geode-core:flakyTest >> :geode-core:integrationTest >> :geode-cq:assemble >> :geode-cq:compileTestJavaNote: Some input files use or override a >> deprecated API. >> Note: Recompile with -Xlint:deprecation for details. >> Note: Some input files use unchecked or unsafe operations. >> Note: Recompile with -Xlint:unchecked for details. >> >> :geode-cq:processTestResources >> :geode-cq:testClasses >> :geode-cq:checkMissedTests >> :geode-cq:test >> :geode-cq:check >> :geode-cq:build >> :geode-cq:distributedTest >> :geode-cq:flakyTest >> :geode-cq:integrationTest >> :geode-json:assemble >> :geode-json:compileTestJava UP-TO-DATE >> :geode-json:processTestResources UP-TO-DATE >> :geode-json:testClasses UP-TO-DATE >> :geode-json:checkMissedTests UP-TO-DATE >> :geode-json:test UP-TO-DATE >> :geode-json:check >> :geode-json:build >> :geode-json:distributedTest UP-TO-DATE >> :geode-json:flakyTest UP-TO-DATE >> :geode-json:integrationTest UP-TO-DATE >> :geode-junit:javadoc >> :geode-junit:javadocJar >> :geode-junit:sourcesJar >> :geode-junit:signArchives SKIPPED >> :geode-junit:assemble >> :geode-junit:compileTestJava >> :geode-junit:processTestResources UP-TO-DATE >> :geode-junit:testClasses >> :geode-junit:checkMissedTests >> :geode-junit:test >> :geode-junit:check >> :geode-junit:build >> :geode-junit:distributedTest >> :geode-junit:flakyTest >> :geode-junit:integrationTest >> :geode-lucene:assemble >> :geode-lucene:compileTestJava >> Download >> >> https://repo1.maven.org/maven2/org/apache/lucene/lucene-test-framework/6.0.0/lucene-test-framework-6.0.0.pom >> Download >> >> https://repo1.maven.org/maven2/org/apache/lucene/lucene-codecs/6.0.0/lucene-codecs-6.0.0.pom >> Download >> >> https://repo1.maven.org/maven2/com/carrotsearch/randomizedtesting/randomizedtesting-runner/2.3.2/randomizedtesting-runner-2.3.2.pom >> Download >> >> https://repo1.maven.org/maven2/com/carrotsearch/randomizedtesting/randomizedtesting-parent/2.3.2/randomizedtesting-parent-2.3.2.pom >> Download >> >> https://repo1.maven.org/maven2/org/apache/lucene/lucene-test-framework/6.0.0/lucene-test-framework-6.0.0.jar >> Download >> >> https://repo1.maven.org/maven2/org/apache/lucene/lucene-codecs/6.0.0/lucene-codecs-6.0.0.jar >> Download >> >> https://repo1.maven.org/maven2/com/carrotsearch/randomizedtesting/randomizedtesting-runner/2.3.2/randomizedtesting-runner-2.3.2.jar >> Note: Some input files use or override a deprecated API. >> Note: Recompile with -Xlint:deprecation for details. >> Note: Some input files use unchecked or unsafe operations. >> Note: Recompile with -Xlint:unchecked for details. >> :geode-lucene:processTestResources >> :geode-lucene:testClasses >> :geode-lucene:checkMissedTests >> :geode-lucene:test >> :geode-lucene:check >> :geode-lucene:build >> :geode-lucene:distributedTest >> :geode-lucene:flakyTest >> :geode-lucene:integrationTest >> :geode-pulse:assemble >> :geode-pulse:compileTestJava >> Download >> >> https://repo1.maven.org/maven2/org/seleniumhq/selenium/selenium-firefox-driver/2.53.0/selenium-firefox-driver-2.53.0.pom >> Download >> >> https://repo1.maven.org/maven2/org/seleniumhq/selenium/selenium-parent/2.53.0/selenium-parent-2.53.0.pom >> Download >> >> https://repo1.maven.org/maven2/org/seleniumhq/selenium/selenium-api/2.53.0/selenium-api-2.53.0.pom >> Download >> >> https://repo1.maven.org/maven2/org/seleniumhq/selenium/selenium-remote-driver/2.53.0/selenium-remote-driver-2.53.0.pom >> Download >> >> https://repo1.maven.org/maven2/org/seleniumhq/selenium/selenium-support/2.53.0/selenium-support-2.53.0.pom >> Download >> >> https://repo1.maven.org/maven2/org/springframework/spring-test/4.2.4.RELEASE/spring-test-4.2.4.RELEASE.pom >> Download >> >> https://repo1.maven.org/maven2/org/seleniumhq/selenium/selenium-firefox-driver/2.53.0/selenium-firefox-driver-2.53.0.jar >> Download >> >> https://repo1.maven.org/maven2/org/seleniumhq/selenium/selenium-api/2.53.0/selenium-api-2.53.0.jar >> Download >> >> https://repo1.maven.org/maven2/org/seleniumhq/selenium/selenium-remote-driver/2.53.0/selenium-remote-driver-2.53.0.jar >> Download >> >> https://repo1.maven.org/maven2/org/seleniumhq/selenium/selenium-support/2.53.0/selenium-support-2.53.0.jar >> Download >> >> https://repo1.maven.org/maven2/org/springframework/spring-test/4.2.4.RELEASE/spring-test-4.2.4.RELEASE.jar >> Note: >> < >> https://builds.apache.org/job/Geode-nightly/ws/geode-pulse/src/test/java/com/vmware/gemfire/tools/pulse/tests/PulseAbstractTest.java >> > >> uses or overrides a deprecated API. >> Note: Recompile with -Xlint:deprecation for details. >> Note: Some input files use unchecked or unsafe operations. >> Note: Recompile with -Xlint:unchecked for details. >> :geode-pulse:processTestResources >> :geode-pulse:testClasses >> :geode-pulse:checkMissedTests >> Download >> >> https://repo1.maven.org/maven2/com/jayway/jsonpath/json-path/1.2.0/json-path-1.2.0.pom >> Download >> >> https://repo1.maven.org/maven2/net/minidev/json-smart/2.1.0/json-smart-2.1.0.pom >> Download >> >> https://repo1.maven.org/maven2/com/jayway/jsonpath/json-path/1.2.0/json-path-1.2.0.jar >> Download >> >> https://repo1.maven.org/maven2/net/minidev/json-smart/2.1.0/json-smart-2.1.0.jar >> :geode-pulse:test >> < >> https://repo1.maven.org/maven2/net/minidev/json-smart/2.1.0/json-smart-2.1.0.jar%0A:geode-pulse:test >> > >> >> :geode-pulse:check >> :geode-pulse:build >> :geode-pulse:distributedTest >> :geode-pulse:flakyTest >> :geode-pulse:integrationTest >> :geode-rebalancer:jar >> :geode-rebalancer:javadoc >> :geode-rebalancer:javadocJar >> :geode-rebalancer:sourcesJar >> :geode-rebalancer:signArchives SKIPPED >> :geode-rebalancer:assemble >> :geode-rebalancer:compileTestJava >> :geode-rebalancer:processTestResources UP-TO-DATE >> :geode-rebalancer:testClasses >> :geode-rebalancer:checkMissedTests >> :geode-rebalancer:test >> :geode-rebalancer:check >> :geode-rebalancer:build >> :geode-rebalancer:distributedTest >> :geode-rebalancer:flakyTest >> :geode-rebalancer:integrationTest >> :geode-wan:assemble >> :geode-wan:compileTestJavaNote: Some input files use or override a >> deprecated API. >> Note: Recompile with -Xlint:deprecation for details. >> Note: Some input files use unchecked or unsafe operations. >> Note: Recompile with -Xlint:unchecked for details. >> >> :geode-wan:processTestResources >> :geode-wan:testClasses >> :geode-wan:checkMissedTests >> :geode-wan:test >> :geode-wan:check >> :geode-wan:build >> :geode-wan:distributedTest >> :geode-wan:flakyTest >> :geode-wan:integrationTest >> :geode-web:assemble >> :geode-web:compileTestJavaNote: >> < >> https://builds.apache.org/job/Geode-nightly/ws/geode-web/src/test/java/com/gemstone/gemfire/management/internal/cli/commands/DataCommandsOverHttpDistributedTest.java >> > >> uses or overrides a deprecated API. >> Note: Recompile with -Xlint:deprecation for details. >> Note: Some input files use unchecked or unsafe operations. >> Note: Recompile with -Xlint:unchecked for details. >> >> :geode-web:processTestResources UP-TO-DATE >> :geode-web:testClasses >> :geode-web:checkMissedTests >> :geode-web:test >> :geode-web:check >> :geode-web:build >> :geode-web:distributedTest >> :geode-web:flakyTest >> :geode-web:integrationTest >> :geode-web-api:assemble >> :geode-web-api:compileTestJava UP-TO-DATE >> :geode-web-api:processTestResources UP-TO-DATE >> :geode-web-api:testClasses UP-TO-DATE >> :geode-web-api:checkMissedTests UP-TO-DATE >> :geode-web-api:test UP-TO-DATE >> :geode-web-api:check >> :geode-web-api:build >> :geode-web-api:distributedTest UP-TO-DATE >> :geode-web-api:flakyTest UP-TO-DATE >> :geode-web-api:integrationTest UP-TO-DATE >> :combineReports >> All test reports at >> < >> https://builds.apache.org/job/Geode-nightly/ws/build/reports/combined> >> :extensions/geode-modules:precheckin >> :extensions/geode-modules-assembly:precheckin >> :extensions/geode-modules-hibernate:precheckin >> :extensions/geode-modules-session:precheckin >> :extensions/geode-modules-session-internal:precheckin >> :extensions/geode-modules-tomcat7:precheckin >> :geode-assembly:precheckin >> :geode-common:precheckin >> :geode-cq:precheckin >> :geode-json:precheckin >> :geode-junit:precheckin >> :geode-lucene:precheckin >> :geode-pulse:precheckin >> :geode-rebalancer:precheckin >> :geode-wan:precheckin >> :geode-web:precheckin >> :geode-web-api:precheckin >> :extensions/geode-modules:uploadArchives >> :extensions/geode-modules-assembly:uploadArchives SKIPPED >> :extensions/geode-modules-hibernate:uploadArchives >> :extensions/geode-modules-session:uploadArchives >> :extensions/geode-modules-session-internal:uploadArchives >> :extensions/geode-modules-tomcat7:uploadArchives >> :geode-assembly:uploadArchives SKIPPED >> :geode-common:uploadArchives >> :geode-core:uploadArchives >> :geode-cq:uploadArchives >> :geode-json:uploadArchives >> :geode-junit:uploadArchives >> :geode-lucene:uploadArchives >> :geode-pulse:uploadArchives >> :geode-rebalancer:uploadArchives >> :geode-wan:uploadArchives >> :geode-web:uploadArchives >> :geode-web-api:uploadArchives >> >> FAILURE: Build failed with an exception. >> >> * What went wrong: >> Execution failed for task ':geode-core:distributedTest'. >> > There were failing tests. See the report at: >> file://< >> https://builds.apache.org/job/Geode-nightly/ws/geode-core/build/reports/distributedTest/index.html >> > >> >> * Try: >> Run with --stacktrace option to get the stack trace. Run with >> --info or --debug option to get more log output. >> >> BUILD FAILED >> >> Total time: 11 hrs 12 mins 55.628 secs >> Build step 'Invoke Gradle script' changed build result to FAILURE >> Build step 'Invoke Gradle script' marked build as failure >> Archiving artifacts >> Compressed 251.02 MB of artifacts by 12.6% relative to #536 >> Recording test results >> >> >> > -- ~/William