[ https://issues.apache.org/jira/browse/GEODE-691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15069948#comment-15069948 ]
ASF subversion and git services commented on GEODE-691: ------------------------------------------------------- Commit 2a21b70477123e679cbb76c8ffa07e44b6e45e6c in incubator-geode's branch refs/heads/develop from [~bschuchardt] [ https://git-wip-us.apache.org/repos/asf?p=incubator-geode.git;h=2a21b70 ] Fix for suspect string causing a number of CI failures During shutdown it's possible for the DirectChannel communication service to throw a ConnectExceptions containing a ShunnedMemberException for one or more members. These indicate that the message couldn't be sent, but this is expected behavior and the ShunnedMemberExceptions can be ignored. This fixes GEODE-355, GEODE-682, GEODE-683, GEODE-684, GEODE-685, GEODE-687, GEODE-689, GEODE-691, GEODE-702 and GEODE-703. > CI failure: > PRClientServerRegionFunctionExecutionSelectorNoSingleHopDUnitTest.testServerSingleKeyExecution_SocketTimeOut > ------------------------------------------------------------------------------------------------------------------------ > > Key: GEODE-691 > URL: https://issues.apache.org/jira/browse/GEODE-691 > Project: Geode > Issue Type: Bug > Affects Versions: 1.0.0-incubating > Reporter: Jens Deppe > Assignee: Bruce Schuchardt > Labels: CI > > git rev fdec70bcd46c568637f0dad976f3778625858608 build #918 > {noformat} > Error Message > java.lang.AssertionError: Suspicious strings were written to the log during > this run. > Fix the strings or use DistributedTestCase.addExpectedException to ignore. > ----------------------------------------------------------------------- > Found suspect string in log4j at line 3228 > [fatal 2015/12/16 02:15:15.617 PST <Cache Server Selector > /0:0:0:0:0:0:0:0:22162 local port: 22162> tid=0x75c5] Failed to send message > <DestroyRegionOperation$DestroyRegionMessage(region > path='/_gfe_non_durable_client_with_id_cc1-co(15259:loner)<ec>:40467:3cef48aa_1_queue'; > sender=cc1-co(15236)<ec><v2774>:1026; callbackArg=null; processorId=114828; > op=REGION_LOCAL_DESTROY; applied=false; directAck=false; posdup=false; > hasDelta=false; hasOldValue=false; eventID=null; serialNum=38297; > subregionSerialNumbers={}; notifyOfRegionDeparture=false)> to member > <cc1-co(15240)<ec><v2777>:1027> view = > View[cc1-co(15231:locator)<ec><v0>:1025|2780] members: > [cc1-co(15231:locator)<ec><v0>:1025, cc1-co(15236)<ec><v2774>:1026{lead}, > cc1-co(15240)<ec><v2777>:1027, cc1-co(15250)<ec><v2780>:1028] > com.gemstone.gemfire.distributed.internal.direct.ShunnedMemberException: > Member is being shunned: {0} > at > com.gemstone.gemfire.distributed.internal.direct.DirectChannel.getConnections(DirectChannel.java:599) > at > com.gemstone.gemfire.distributed.internal.direct.DirectChannel.sendToMany(DirectChannel.java:374) > at > com.gemstone.gemfire.distributed.internal.direct.DirectChannel.send(DirectChannel.java:667) > at > com.gemstone.gemfire.distributed.internal.membership.gms.mgr.GMSMembershipManager.directChannelSend(GMSMembershipManager.java:1730) > at > com.gemstone.gemfire.distributed.internal.membership.gms.mgr.GMSMembershipManager.send(GMSMembershipManager.java:1924) > at > com.gemstone.gemfire.distributed.internal.DistributionChannel.send(DistributionChannel.java:88) > at > com.gemstone.gemfire.distributed.internal.DistributionManager.sendOutgoing(DistributionManager.java:3474) > at > com.gemstone.gemfire.distributed.internal.DistributionManager.sendMessage(DistributionManager.java:3515) > at > com.gemstone.gemfire.distributed.internal.DistributionManager.putOutgoing(DistributionManager.java:1874) > at > com.gemstone.gemfire.internal.cache.DistributedCacheOperation.distribute(DistributedCacheOperation.java:529) > at > com.gemstone.gemfire.internal.cache.DistributedRegion.distributeDestroyRegion(DistributedRegion.java:1957) > at > com.gemstone.gemfire.internal.cache.DistributedRegion.basicDestroyRegion(DistributedRegion.java:1932) > at > com.gemstone.gemfire.internal.cache.LocalRegion.basicDestroyRegion(LocalRegion.java:6825) > at > com.gemstone.gemfire.internal.cache.HARegion.destroyRegion(HARegion.java:347) > at > com.gemstone.gemfire.internal.cache.AbstractRegion.destroyRegion(AbstractRegion.java:376) > at > com.gemstone.gemfire.internal.cache.ha.HARegionQueue.destroy(HARegionQueue.java:3733) > at > com.gemstone.gemfire.internal.cache.ha.HARegionQueue$BlockingHARegionQueue.destroy(HARegionQueue.java:2392) > at > com.gemstone.gemfire.internal.cache.tier.sockets.CacheClientProxy.destroyRQ(CacheClientProxy.java:1065) > at > com.gemstone.gemfire.internal.cache.tier.sockets.CacheClientProxy.terminateDispatching(CacheClientProxy.java:973) > at > com.gemstone.gemfire.internal.cache.tier.sockets.CacheClientProxy.close(CacheClientProxy.java:850) > at > com.gemstone.gemfire.internal.cache.tier.sockets.CacheClientNotifier.closeDeadProxies(CacheClientNotifier.java:1977) > at > com.gemstone.gemfire.internal.cache.tier.sockets.CacheClientNotifier.unregisterClient(CacheClientNotifier.java:785) > at > com.gemstone.gemfire.internal.cache.tier.sockets.ClientHealthMonitor.unregisterClient(ClientHealthMonitor.java:275) > at > com.gemstone.gemfire.internal.cache.tier.sockets.ServerConnection.handleTermination(ServerConnection.java:906) > at > com.gemstone.gemfire.internal.cache.tier.sockets.ServerConnection.handleTermination(ServerConnection.java:827) > at > com.gemstone.gemfire.internal.cache.tier.sockets.AcceptorImpl.finishCon(AcceptorImpl.java:786) > at > com.gemstone.gemfire.internal.cache.tier.sockets.AcceptorImpl.drainSelectorQueue(AcceptorImpl.java:807) > at > com.gemstone.gemfire.internal.cache.tier.sockets.AcceptorImpl.runSelectorLoop(AcceptorImpl.java:1179) > at > com.gemstone.gemfire.internal.cache.tier.sockets.AcceptorImpl$4.run(AcceptorImpl.java:709) > at java.lang.Thread.run(Thread.java:745) > Stacktrace > java.lang.AssertionError: Suspicious strings were written to the log during > this run. > Fix the strings or use DistributedTestCase.addExpectedException to ignore. > ----------------------------------------------------------------------- > Found suspect string in log4j at line 3228 > [fatal 2015/12/16 02:15:15.617 PST <Cache Server Selector > /0:0:0:0:0:0:0:0:22162 local port: 22162> tid=0x75c5] Failed to send message > <DestroyRegionOperation$DestroyRegionMessage(region > path='/_gfe_non_durable_client_with_id_cc1-co(15259:loner)<ec>:40467:3cef48aa_1_queue'; > sender=cc1-co(15236)<ec><v2774>:1026; callbackArg=null; processorId=114828; > op=REGION_LOCAL_DESTROY; applied=false; directAck=false; posdup=false; > hasDelta=false; hasOldValue=false; eventID=null; serialNum=38297; > subregionSerialNumbers={}; notifyOfRegionDeparture=false)> to member > <cc1-co(15240)<ec><v2777>:1027> view = > View[cc1-co(15231:locator)<ec><v0>:1025|2780] members: > [cc1-co(15231:locator)<ec><v0>:1025, cc1-co(15236)<ec><v2774>:1026{lead}, > cc1-co(15240)<ec><v2777>:1027, cc1-co(15250)<ec><v2780>:1028] > com.gemstone.gemfire.distributed.internal.direct.ShunnedMemberException: > Member is being shunned: {0} > at > com.gemstone.gemfire.distributed.internal.direct.DirectChannel.getConnections(DirectChannel.java:599) > at > com.gemstone.gemfire.distributed.internal.direct.DirectChannel.sendToMany(DirectChannel.java:374) > at > com.gemstone.gemfire.distributed.internal.direct.DirectChannel.send(DirectChannel.java:667) > at > com.gemstone.gemfire.distributed.internal.membership.gms.mgr.GMSMembershipManager.directChannelSend(GMSMembershipManager.java:1730) > at > com.gemstone.gemfire.distributed.internal.membership.gms.mgr.GMSMembershipManager.send(GMSMembershipManager.java:1924) > at > com.gemstone.gemfire.distributed.internal.DistributionChannel.send(DistributionChannel.java:88) > at > com.gemstone.gemfire.distributed.internal.DistributionManager.sendOutgoing(DistributionManager.java:3474) > at > com.gemstone.gemfire.distributed.internal.DistributionManager.sendMessage(DistributionManager.java:3515) > at > com.gemstone.gemfire.distributed.internal.DistributionManager.putOutgoing(DistributionManager.java:1874) > at > com.gemstone.gemfire.internal.cache.DistributedCacheOperation.distribute(DistributedCacheOperation.java:529) > at > com.gemstone.gemfire.internal.cache.DistributedRegion.distributeDestroyRegion(DistributedRegion.java:1957) > at > com.gemstone.gemfire.internal.cache.DistributedRegion.basicDestroyRegion(DistributedRegion.java:1932) > at > com.gemstone.gemfire.internal.cache.LocalRegion.basicDestroyRegion(LocalRegion.java:6825) > at > com.gemstone.gemfire.internal.cache.HARegion.destroyRegion(HARegion.java:347) > at > com.gemstone.gemfire.internal.cache.AbstractRegion.destroyRegion(AbstractRegion.java:376) > at > com.gemstone.gemfire.internal.cache.ha.HARegionQueue.destroy(HARegionQueue.java:3733) > at > com.gemstone.gemfire.internal.cache.ha.HARegionQueue$BlockingHARegionQueue.destroy(HARegionQueue.java:2392) > at > com.gemstone.gemfire.internal.cache.tier.sockets.CacheClientProxy.destroyRQ(CacheClientProxy.java:1065) > at > com.gemstone.gemfire.internal.cache.tier.sockets.CacheClientProxy.terminateDispatching(CacheClientProxy.java:973) > at > com.gemstone.gemfire.internal.cache.tier.sockets.CacheClientProxy.close(CacheClientProxy.java:850) > at > com.gemstone.gemfire.internal.cache.tier.sockets.CacheClientNotifier.closeDeadProxies(CacheClientNotifier.java:1977) > at > com.gemstone.gemfire.internal.cache.tier.sockets.CacheClientNotifier.unregisterClient(CacheClientNotifier.java:785) > at > com.gemstone.gemfire.internal.cache.tier.sockets.ClientHealthMonitor.unregisterClient(ClientHealthMonitor.java:275) > at > com.gemstone.gemfire.internal.cache.tier.sockets.ServerConnection.handleTermination(ServerConnection.java:906) > at > com.gemstone.gemfire.internal.cache.tier.sockets.ServerConnection.handleTermination(ServerConnection.java:827) > at > com.gemstone.gemfire.internal.cache.tier.sockets.AcceptorImpl.finishCon(AcceptorImpl.java:786) > at > com.gemstone.gemfire.internal.cache.tier.sockets.AcceptorImpl.drainSelectorQueue(AcceptorImpl.java:807) > at > com.gemstone.gemfire.internal.cache.tier.sockets.AcceptorImpl.runSelectorLoop(AcceptorImpl.java:1179) > at > com.gemstone.gemfire.internal.cache.tier.sockets.AcceptorImpl$4.run(AcceptorImpl.java:709) > at java.lang.Thread.run(Thread.java:745) > at org.junit.Assert.fail(Assert.java:88) > at > dunit.standalone.DUnitLauncher.closeAndCheckForSuspects(DUnitLauncher.java:354) > at dunit.DistributedTestCase.cleanupAllVms(DistributedTestCase.java:753) > at dunit.DistributedTestCase.realTearDown(DistributedTestCase.java:728) > at dunit.DistributedTestCase.tearDown(DistributedTestCase.java:706) > at junit.framework.TestCase.runBare(TestCase.java:146) > at junit.framework.TestResult$1.protect(TestResult.java:122) > at junit.framework.TestResult.runProtected(TestResult.java:142) > at junit.framework.TestResult.run(TestResult.java:125) > at junit.framework.TestCase.run(TestCase.java:129) > at junit.framework.TestSuite.runTest(TestSuite.java:252) > at junit.framework.TestSuite.run(TestSuite.java:247) > at > org.junit.internal.runners.JUnit38ClassRunner.run(JUnit38ClassRunner.java:86) > at > org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.runTestClass(JUnitTestClassExecuter.java:105) > at > org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.execute(JUnitTestClassExecuter.java:56) > at > org.gradle.api.internal.tasks.testing.junit.JUnitTestClassProcessor.processTestClass(JUnitTestClassProcessor.java:64) > at > org.gradle.api.internal.tasks.testing.SuiteTestClassProcessor.processTestClass(SuiteTestClassProcessor.java:50) > at sun.reflect.GeneratedMethodAccessor175.invoke(Unknown Source) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:497) > at > org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35) > at > org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24) > at > org.gradle.messaging.dispatch.ContextClassLoaderDispatch.dispatch(ContextClassLoaderDispatch.java:32) > at > org.gradle.messaging.dispatch.ProxyDispatchAdapter$DispatchingInvocationHandler.invoke(ProxyDispatchAdapter.java:93) > at com.sun.proxy.$Proxy2.processTestClass(Unknown Source) > at > org.gradle.api.internal.tasks.testing.worker.TestWorker.processTestClass(TestWorker.java:106) > at sun.reflect.GeneratedMethodAccessor174.invoke(Unknown Source) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:497) > at > org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35) > at > org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24) > at > org.gradle.messaging.remote.internal.hub.MessageHub$Handler.run(MessageHub.java:360) > at > org.gradle.internal.concurrent.ExecutorPolicy$CatchAndRecordFailures.onExecute(ExecutorPolicy.java:54) > at > org.gradle.internal.concurrent.StoppableExecutorImpl$1.run(StoppableExecutorImpl.java:40) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > Standard Output > Previously run tests: [RemoveAllDAckDUnitTest, RemoveDAckDUnitTest, > RemoveGlobalDUnitTest, SizingFlagDUnitTest, SystemFailureDUnitTest, > PersistentPartitionedRegionWithTransactionDUnitTest, Bug39356DUnitTest, > Bug47388DUnitTest, ElidedPutAllDUnitTest, PartitionResolverDUnitTest, > PartitionedRegionLoaderWriterDUnitTest, > PartitionedRegionMetaDataCleanupDUnitTest, PersistPRKRFDUnitTest, > PersistentColocatedPartitionedRegionDUnitTest, > PersistentPartitionedRegionOldConfigDUnitTest, > PersistentPartitionedRegionDUnitTest, > StreamingPartitionOperationManyDUnitTest, > StreamingPartitionOperationOneDUnitTest, Bug43684DUnitTest, > Bug51400DUnitTest, ShutdownAllDUnitTest, FixedPartitioningDUnitTest, > FixedPartitioningWithColocationAndPersistenceDUnitTest, > PRTransactionDUnitTest, PRColocationDUnitTest, > PRTransactionWithVersionsDUnitTest, > PRClientServerRegionFunctionExecutionDUnitTest, > PRClientServerRegionFunctionExecutionFailoverDUnitTest, > PRClientServerRegionFunctionExecutionNoSingleHopDUnitTest, > PRClientServerRegionFunctionExecutionSelectorNoSingleHopDUnitTest] > {noformat} -- This message was sent by Atlassian JIRA (v6.3.4#6332)