[ 
https://issues.apache.org/jira/browse/CASSANDRA-12260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15393301#comment-15393301
 ] 

Joel Knighton commented on CASSANDRA-12260:
-------------------------------------------

That definitely seems to be the problem. The node should eventually shut down - 
after that message is printed, it just needs to execute the StorageService 
shutdown hook (and the JVM to exit). How long we should need to wait for that 
is a good question - evidently, it can be quite slow on CI. That said, it takes 
about two tenths of a second on my machine. If we're passing the thirty seconds 
here with no other symptoms (and that's what I see so far), there is something 
going pretty poorly in either C* or the test environment, and it might be 
better to investigate rather than change the test. 

To be more helpful in debugging this, I'd need trace level logging. 
Unfortunately, due to [CASSANDRA-12011], we lose logging in the shutdown hook, 
so we'd need a hacky fix to do that. I can do some or all of 1) a hacky branch 
fixing [CASSANDRA-12011], 2) running with trace logging on CI to try to repro, 
3) analyzing those results.


> dtest failure in 
> topology_test.TestTopology.decommissioned_node_cant_rejoin_test
> --------------------------------------------------------------------------------
>
>                 Key: CASSANDRA-12260
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-12260
>             Project: Cassandra
>          Issue Type: Test
>            Reporter: Philip Thompson
>            Assignee: Philip Thompson
>              Labels: dtest
>         Attachments: node1.log, node1_debug.log, node1_gc.log, node2.log, 
> node2_debug.log, node2_gc.log, node3.log, node3_debug.log, node3_gc.log
>
>
> example failure:
> http://cassci.datastax.com/job/cassandra-3.9_novnode_dtest/14/testReport/topology_test/TestTopology/decommissioned_node_cant_rejoin_test



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to