Re: Ghost node showing up in the ring

2011-03-23 Thread Brandon Williams
On Wed, Mar 23, 2011 at 2:23 PM, Alexis Lê-Quôc wrote: > I'm going to take a stab at a hypothesis: > Sunday: I drain and decommission 2.3.4.193 *but* I forget to run node > cleanup on the rest of the nodes. The ring looks clean but I did not see > "Annoucing that ..." in the logs. > > Tuesday: t

Re: Ghost node showing up in the ring

2011-03-23 Thread Alexis Lê-Quôc
I'm going to take a stab at a hypothesis: Sunday: I drain and decommission 2.3.4.193 *but* I forget to run node cleanup on the rest of the nodes. The ring looks clean but I did not see "Annoucing that ..." in the logs. Tuesday: the ghost node reappears on the ring for all nodes. Could this be c

Re: Ghost node showing up in the ring

2011-03-23 Thread aaron morton
When the node starts it reads the stored token information from the LocationInfo CF in the System KS. It looks like the log message "is now part of the cluster" is only logged when an endpoint is added to a nodes view of the ring via gossip It is not logged when the endpoint is added during st

Ghost node showing up in the ring

2011-03-22 Thread Alexis Lê-Quôc
Hi, I've seen some strange occurrence of a deleted node reappearing all of a sudden in the ring, which leads to my question: where is the ring structure maintained (memory with local copies?) and what prompts it to change? I appreciate any thoughts on the events below. I'm running 0.7.4 on 4 EC2