[
https://issues.apache.org/jira/browse/GEODE-469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14977485#comment-14977485
]
Dan Smith commented on GEODE-469:
---------------------------------
I dug up the full suspect string, see below. It looks like the issue is that
the region is destroyed while we are doing redundancy recovery. This could
happen when the test calls shutdown all, or also during tear down, because
closing the cache on one member will trigger redundancy recovery immediately on
the other members with the settings used in this test.
{noformat}
[vm_1][warn 2015/10/22 04:08:34.735 PDT <Pooled Waiting Message Processor 2>
tid=0xf26] Initialization failed for Region /__PR
[vm_1]com.gemstone.gemfire.cache.RegionDestroyedException: The DiskRegion has
been closed or destroyed
[vm_1] at
com.gemstone.gemfire.internal.cache.DiskStoreImpl.acquireReadLock(DiskStoreImpl.java:1187)
[vm_1] at
com.gemstone.gemfire.internal.cache.DiskStoreImpl.writeRVV(DiskStoreImpl.java:4805)
[vm_1] at
com.gemstone.gemfire.internal.cache.DiskRegion.writeRVV(DiskRegion.java:850)
[vm_1] at
com.gemstone.gemfire.internal.cache.InitialImageOperation.saveReceivedRVV(InitialImageOperation.java:1139)
[vm_1] at
com.gemstone.gemfire.internal.cache.InitialImageOperation.getFromOne(InitialImageOperation.java:465)
[vm_1] at
com.gemstone.gemfire.internal.cache.DistributedRegion.getInitialImageAndRecovery(DistributedRegion.java:1415)
[vm_1] at
com.gemstone.gemfire.internal.cache.DistributedRegion.initialize(DistributedRegion.java:1215)
[vm_1] at
com.gemstone.gemfire.internal.cache.BucketRegion.initialize(BucketRegion.java:288)
[vm_1] at
com.gemstone.gemfire.internal.cache.LocalRegion.createSubregion(LocalRegion.java:1055)
[vm_1] at
com.gemstone.gemfire.internal.cache.PartitionedRegionDataStore.createBucketRegion(PartitionedRegionDataStore.java:800)
[vm_1] at
com.gemstone.gemfire.internal.cache.PartitionedRegionDataStore.grabFreeBucket(PartitionedRegionDataStore.java:477)
[vm_1] at
com.gemstone.gemfire.internal.cache.PartitionedRegionDataStore.grabFreeBucketRecursively(PartitionedRegionDataStore.java:320)
[vm_1] at
com.gemstone.gemfire.internal.cache.PartitionedRegionDataStore.grabBucket(PartitionedRegionDataStore.java:3034)
[vm_1] at
com.gemstone.gemfire.internal.cache.PRHARedundancyProvider.createBackupBucketOnMember(PRHARedundancyProvider.java:1141)
[vm_1] at
com.gemstone.gemfire.internal.cache.partitioned.PartitionedRegionRebalanceOp.createRedundantBucketForRegion(PartitionedRegionRebalanceOp.java:513)
[vm_1] at
com.gemstone.gemfire.internal.cache.partitioned.PartitionedRegionRebalanceOp$BucketOperatorImpl.createRedundantBucket(PartitionedRegionRebalanceOp.java:673)
[vm_1] at
com.gemstone.gemfire.internal.cache.partitioned.PartitionedRegionRebalanceOp$BucketOperatorWrapper.createRedundantBucket(PartitionedRegionRebalanceOp.java:771)
[vm_1] at
com.gemstone.gemfire.internal.cache.partitioned.rebalance.ParallelBucketOperator$1.run(ParallelBucketOperator.java:72)
[vm_1] at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
[vm_1] at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[vm_1] at
com.gemstone.gemfire.distributed.internal.DistributionManager.runUntilShutdown(DistributionManager.java:692)
[vm_1] at
com.gemstone.gemfire.distributed.internal.DistributionManager$6$1.run(DistributionManager.java:1029)
[vm_1] at java.lang.Thread.run(Thread.java:745)
{noformat}
> CI failure:
> PersistentColocatedPartitionedRegionDUnitTest.testReplaceOfflineMemberAndRestartTwoDiskStores
> ---------------------------------------------------------------------------------------------------------
>
> Key: GEODE-469
> URL: https://issues.apache.org/jira/browse/GEODE-469
> Project: Geode
> Issue Type: Bug
> Reporter: Kirk Lund
> Assignee: Dan Smith
> Labels: CI
>
> {noformat}
> java.lang.AssertionError: Suspicious strings were written to the log during
> this run.
> Fix the strings or use DistributedTestCase.addExpectedException to ignore.
> -----------------------------------------------------------------------
> Found suspect string in log4j at line 3982
> com.gemstone.gemfire.cache.RegionDestroyedException: The DiskRegion has been
> closed or destroyed
> at org.junit.Assert.fail(Assert.java:88)
> at
> dunit.standalone.DUnitLauncher.closeAndCheckForSuspects(DUnitLauncher.java:307)
> at dunit.DistributedTestCase.cleanupAllVms(DistributedTestCase.java:784)
> at dunit.DistributedTestCase.realTearDown(DistributedTestCase.java:759)
> at dunit.DistributedTestCase.tearDown(DistributedTestCase.java:737)
> at junit.framework.TestCase.runBare(TestCase.java:146)
> at junit.framework.TestResult$1.protect(TestResult.java:122)
> at junit.framework.TestResult.runProtected(TestResult.java:142)
> at junit.framework.TestResult.run(TestResult.java:125)
> at junit.framework.TestCase.run(TestCase.java:129)
> at junit.framework.TestSuite.runTest(TestSuite.java:252)
> at junit.framework.TestSuite.run(TestSuite.java:247)
> at
> org.junit.internal.runners.JUnit38ClassRunner.run(JUnit38ClassRunner.java:86)
> at
> org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.runTestClass(JUnitTestClassExecuter.java:86)
> at
> org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.execute(JUnitTestClassExecuter.java:49)
> at
> org.gradle.api.internal.tasks.testing.junit.JUnitTestClassProcessor.processTestClass(JUnitTestClassProcessor.java:64)
> at
> org.gradle.api.internal.tasks.testing.SuiteTestClassProcessor.processTestClass(SuiteTestClassProcessor.java:50)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:497)
> at
> org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35)
> at
> org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
> at
> org.gradle.messaging.dispatch.ContextClassLoaderDispatch.dispatch(ContextClassLoaderDispatch.java:32)
> at
> org.gradle.messaging.dispatch.ProxyDispatchAdapter$DispatchingInvocationHandler.invoke(ProxyDispatchAdapter.java:93)
> at com.sun.proxy.$Proxy2.processTestClass(Unknown Source)
> at
> org.gradle.api.internal.tasks.testing.worker.TestWorker.processTestClass(TestWorker.java:106)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:497)
> at
> org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35)
> at
> org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
> at
> org.gradle.messaging.remote.internal.hub.MessageHub$Handler.run(MessageHub.java:360)
> at
> org.gradle.internal.concurrent.DefaultExecutorFactory$StoppableExecutorImpl$1.run(DefaultExecutorFactory.java:64)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> {noformat}
> Previously run tests: [RemoveAllDAckDUnitTest, RemoveDAckDUnitTest,
> RemoveGlobalDUnitTest, SizingFlagDUnitTest, SystemFailureDUnitTest,
> PersistentPartitionedRegionWithTransactionDUnitTest, Bug39356DUnitTest,
> Bug43684DUnitTest, Bug47388DUnitTest, Bug51400DUnitTest,
> ElidedPutAllDUnitTest, PartitionResolverDUnitTest,
> PartitionedRegionLoaderWriterDUnitTest,
> PartitionedRegionMetaDataCleanupDUnitTest, PersistPRKRFDUnitTest,
> PersistentColocatedPartitionedRegionDUnitTest]
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
