Hi,
we have had an issue with one of our nodes today:
1. Due to a wrong setup the starting node failed to properly bootstrap.
It was shown as UN in the cluster however did not contain any data and
we shut it down to fix our configuration issue.
2. We figured we need to remove the node from the cluster before being
able to restart it cleanly and have it bootstrap automatically. We used
"nodetool removenode UUID" which caused mutliple nodes in our Datacenter
to be marked as DOWN for some reason (taken from the log) and a bunch of
operations against our cluster to fail. The nodes have come up again and
other than a slight heart attack we are fine.
However, the removenode operation is now stuck and won't continue.
Can anyone recommend on how to proceed safely from here? The node is
marked as DL in our cluster. I found
https://issues.apache.org/jira/browse/CASSANDRA-6542 however there is no
hint on how to handle this properly.
Is it save to use the force option here? We don't want to risk the
cluster going down for whatever reason again.
Thank you!
Artur
