Re: Adjusting Token Spaces and Rebalancing Data

2010-03-02 Thread Jonathan Ellis
On Tue, Mar 2, 2010 at 2:51 PM, Jon Graham wrote: > Thanks! > > Switching to java 1.6.0_18 seems to have gotten past the 2GB file boundary. > I now have a new ring token for the first node in my cluster. > > Can I run a "loadbalance" on nodes 2-6 to achive more data and token > balancing? You sho

Re: Adjusting Token Spaces and Rebalancing Data

2010-03-02 Thread Jon Graham
Thanks! Switching to java 1.6.0_18 seems to have gotten past the 2GB file boundary. I now have a new ring token for the first node in my cluster. Can I run a "loadbalance" on nodes 2-6 to achive more data and token balancing? Should I perform a cleanup operation on node 1? During the loadbalanc

Re: Adjusting Token Spaces and Rebalancing Data

2010-03-02 Thread Jon Graham
Thanks Jonathan, My 32-bit java version is at: 1.6.0_13-b03. I'll try a java upgrade. This tracks well with the exact MaxInt -tmp- Data file size Jon On Tue, Mar 2, 2010 at 9:15 AM, Jonathan Ellis wrote: > Doing some googling, this is a different JRE bug than the on addressed > by 795: http://

Re: Adjusting Token Spaces and Rebalancing Data

2010-03-02 Thread Jonathan Ellis
Doing some googling, this is a different JRE bug than the on addressed by 795: http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=6253145. It is marked fixed in JDK 6u18, so try upgrading to that. -Jonathan On Tue, Mar 2, 2010 at 10:46 AM, Jon Graham wrote: > Hello, > > I am running a 32-bit lin

Re: Adjusting Token Spaces and Rebalancing Data

2010-03-02 Thread Jon Graham
Hello, I am running a 32-bit linux version 2.6.27.24. My original data set was copied from a 64-bit cassandra cluster to a 32-bit cassandra cluster. I am trying to load balance the data on a 32-bit cluster. Is the cassandra-795 issue applicable for 32-linux too for the 0.5.0 release? Thanks, Jon

Re: Adjusting Token Spaces and Rebalancing Data

2010-03-01 Thread Jonathan Ellis
On Mon, Mar 1, 2010 at 5:39 PM, Jon Graham wrote: > Reached an EOL or something bizzare occured. Reading from: /192.168.2.13 > BufferSizeRemaining: 16 This one is harmless > java.io.IOException: Value too large for defined data type >     at sun.nio.ch.FileChannelImpl.transferTo0(Native Method)

Re: Adjusting Token Spaces and Rebalancing Data

2010-03-01 Thread Jon Graham
Hello, I did find these exceptions. I issued the loadbalance command on node 192.168.2.10. INFO [MESSAGING-SERVICE-POOL:3] 2010-03-01 10:34:40,764 TcpConnection.java (line 315) Closing errored connection java.nio.channels.SocketChannel[connected local=/192.168.2.10:55973 remote=/ 192.168.2.13:700

Re: Adjusting Token Spaces and Rebalancing Data

2010-03-01 Thread Jonathan Ellis
On Mon, Mar 1, 2010 at 3:18 PM, Jon Graham wrote: > Thanks Jonathan. > > It seems like the load balance operation isn't moving. I haven't seen any > data file time changes in 2 hours and no location file time > changes in over an hour. > > I can see a tcp port # 7000 opened on the node where I ran

Re: Adjusting Token Spaces and Rebalancing Data

2010-03-01 Thread Jon Graham
Thanks Jonathan. It seems like the load balance operation isn't moving. I haven't seen any data file time changes in 2 hours and no location file time changes in over an hour. I can see a tcp port # 7000 opened on the node where I ran the loadbalance command. It is connected to port 39033 on the

Re: Adjusting Token Spaces and Rebalancing Data

2010-03-01 Thread Jonathan Ellis
On Mon, Mar 1, 2010 at 1:44 PM, Jon Graham wrote: > Can I tell if the load balancing operaion is still running ok or if it > has terminated? > > Is there a rough computation to determine how long the process should take? Not really, although you can guess from cpu/io usage. This is much improved

Re: Adjusting Token Spaces and Rebalancing Data

2010-03-01 Thread Jon Graham
Jonathan, Thanks for the quick reply. After starting a loadbalance operation for about 30 minutes, I can see 3 ColumnFamily-tmp-Data, Filter and Index files on a lightly loaded node. The Data file has a size of 2,147,483,647 (max signed int) on the node being loaded. I hope I didn't run out of In

Re: Adjusting Token Spaces and Rebalancing Data

2010-03-01 Thread Jonathan Ellis
nodetool is the 0.6 replacement for nodeprobe. the stream info is new in that version. (0.6 beta release is linked from http://wiki.apache.org/cassandra/GettingStarted) -Jonathan On Mon, Mar 1, 2010 at 12:40 PM, Jon Graham wrote: > Hello Everyone, > > Jonathan,  Thanks for your advice :-) > >

Re: Adjusting Token Spaces and Rebalancing Data

2010-03-01 Thread Jon Graham
Hello Everyone, Jonathan, Thanks for your advice :-) I have started a loadbalance operation on a busy cassandra node. The http://wiki.apache.org/cassandra/Operations web page indicates that nodetool streams can be used to monitor the status of the load balancing operation. I can't seem to find

Re: Adjusting Token Spaces and Rebalancing Data

2010-02-24 Thread Jonathan Ellis
nodeprobe loadbalance and/or nodeprobe move http://wiki.apache.org/cassandra/Operations On Wed, Feb 24, 2010 at 6:17 PM, Jon Graham wrote: > Hello, > > I have 6 node Cassandra 0.5.0 cluster > using org.apache.cassandra.dht.OrderPreservingPartitioner with replication > factor 3. > > I mistakenly

Adjusting Token Spaces and Rebalancing Data

2010-02-24 Thread Jon Graham
Hello, I have 6 node Cassandra 0.5.0 cluster using org.apache.cassandra.dht.OrderPreservingPartitioner with replication factor 3. I mistakenly set my tokens to the wrong values, and have all the data being stored on the first node (with replicas on the seconds and third nodes) Does Cassandra hav