RE: Completely removing a node from the cluster

2011-08-23 Thread Bryce Godfrey
: Brandon Williams [mailto:dri...@gmail.com] Sent: Tuesday, August 23, 2011 10:42 AM To: user@cassandra.apache.org Subject: Re: Completely removing a node from the cluster On Tue, Aug 23, 2011 at 2:26 AM, aaron morton wrote: > I'm running low on ideas for this one. Anyone else ? > >

Re: Completely removing a node from the cluster

2011-08-23 Thread Brandon Williams
On Tue, Aug 23, 2011 at 2:26 AM, aaron morton wrote: > I'm running low on ideas for this one. Anyone else ? > > If the phantom node is not listed in the ring, other nodes should not be > storing hints for it. You can see what nodes they are storing hints for via > JConsole. I think I found it i

Re: Completely removing a node from the cluster

2011-08-23 Thread aaron morton
disabled >>> Compacted row minimum size: 2816160 >>> Compacted row maximum size: 386857368 >>> Compacted row mean size: 120432714 >>> >>> Is there a way for me to manually remove this dead node? &g

Re: Completely removing a node from the cluster

2011-08-23 Thread Jonathan Colby
4 >> Row cache: disabled >> Compacted row minimum size: 2816160 >> Compacted row maximum size: 386857368 >> Compacted row mean size: 120432714 >> >> Is there a way for me to manually remove this de

Re: Completely removing a node from the cluster

2011-08-23 Thread aaron morton
or me to manually remove this dead node? > > -Original Message- > From: Bryce Godfrey [mailto:bryce.godf...@azaleos.com] > Sent: Sunday, August 21, 2011 9:09 PM > To: user@cassandra.apache.org > Subject: RE: Completely removing a node from the cluster > > It&#x

RE: Completely removing a node from the cluster

2011-08-22 Thread Bryce Godfrey
[mailto:bryce.godf...@azaleos.com] Sent: Sunday, August 21, 2011 9:09 PM To: user@cassandra.apache.org Subject: RE: Completely removing a node from the cluster It's been at least 4 days now. -Original Message- From: aaron morton [mailto:aa...@thelastpickle.com] Sent: Sunday, August 21, 2011

RE: Completely removing a node from the cluster

2011-08-21 Thread Bryce Godfrey
It's been at least 4 days now. -Original Message- From: aaron morton [mailto:aa...@thelastpickle.com] Sent: Sunday, August 21, 2011 3:16 PM To: user@cassandra.apache.org Subject: Re: Completely removing a node from the cluster I see the mistake I made about ring, gets the endpoint

Re: Completely removing a node from the cluster

2011-08-21 Thread aaron morton
n morton [mailto:aa...@thelastpickle.com] > Sent: Sunday, August 21, 2011 4:23 AM > To: user@cassandra.apache.org > Subject: Re: Completely removing a node from the cluster > > Unreachable nodes in either did not respond to the message or were known to > be down and were not sent a message.

RE: Completely removing a node from the cluster

2011-08-21 Thread Bryce Godfrey
[mailto:aa...@thelastpickle.com] Sent: Sunday, August 21, 2011 4:23 AM To: user@cassandra.apache.org Subject: Re: Completely removing a node from the cluster Unreachable nodes in either did not respond to the message or were known to be down and were not sent a message. The way the node lists are

Re: Completely removing a node from the cluster

2011-08-21 Thread aaron morton
Unreachable nodes in either did not respond to the message or were known to be down and were not sent a message. The way the node lists are obtained for the ring command and describe cluster are the same. So it's a bit odd. Can you connect to JMX and have a look at the o.a.c.db.StorageService

Completely removing a node from the cluster

2011-08-19 Thread Bryce Godfrey
I'm on 0.8.4 I have removed a dead node from the cluster using nodetool removetoken command, and moved one of the remaining nodes to rebalance the tokens. Everything looks fine when I run nodetool ring now, as it only lists the remaining 2 nodes and they both look fine, owning 50% of the token