Load balancing using 'nodetool move'

Hello, I initially had two node cluster and now I joined another node by keeping intial_token property blank and auto_bootstrap: True. So it took one of the node and shared its half of the load. Now when I run Nodetool ring I get ownership as 25%,25% and 50% which is correct but I wish to make

Re: cleanup crashing with "java.util.concurrent.ExecutionException: java.lang.ArrayIndexOutOfBoundsException: 8"

If you don't need LCS, it will be safer to move back to STCS. If you need LCS, you can manually demote the sstables by editing the manifest file. I'm not a man in datastax, and it is a workaround I've just found. Please test it well before applying it on your production service. Background: You h

Re: Question on ByteOrdered rebalancing

On Wed, Mar 14, 2012 at 4:17 PM, work late wrote: > The bytes being the key I use or what ? Yes. Partitioners split up the space of possible keys based on the tokens of the nodes. For BOP, a node's primary range will include all rows with keys that are less than it's token and greater than th

Re: Does the 'batch' order matter ?

Ah, my mistake, you are correct. Not sure why I had forgotten that. The pycassa docs are slightly wrong there, though. It's technically atomic for the same key across multiple column families. I'll get that fixed. On Wed, Mar 14, 2012 at 5:22 PM, A J wrote: > > No, batch_mutate() is an atomic

Re: snapshot files locked

Typo > 2. MKLINK /D LINK.TXT ORIG.TXT MKLINK /H On 2012/03/15, at 9:04, Watanabe Maki wrote: > It's true on unix, but you can't delete hard links of opened files on windows. > Try following: > 1 Create a text file ORIG.TXT > 2. MKLINK /D LINK.TXT ORIG.TXT > Now you have hard link LINK.TXT .

Re: snapshot files locked

It's true on unix, but you can't delete hard links of opened files on windows. Try following: 1 Create a text file ORIG.TXT 2. MKLINK /D LINK.TXT ORIG.TXT Now you have hard link LINK.TXT . 3 Open ORIG.TXT with MS Word. 4. DEL LINK.TXT It returns error. Interesting thing is that you can del

Re: Does the 'batch' order matter ?

> No, batch_mutate() is an atomic operation. When a node locally applies a > batch mutation, either all of the changes are applied or none of them are.< The steps in my batch are not confined to a single CF, nor to a single key. The documentation says: datastax: Column updates are only considere

Re: Composite keys and range queries

Ahhh, ok, I thought that CQL was just being brought up to date with the functionality already built into composite keys, but I guess I was mistaken there. But I guess it's just providing a convenient abstraction, using composite column names under the hood. That's where I was confused, thanks. S

Re: Question on ByteOrdered rebalancing

The bytes being the key I use or what ? Maybe you answered the 2nd question and I don't get it, but what would I pass the move command when I want to rebalance the cluster? Thanks On Tue, Mar 13, 2012 at 11:34 AM, Tyler Hobbs wrote: > The tokens are hex encoded arrays of bytes. > > > On Tue, Ma

Re: [Windows] How to configure simple authentication and authorization ?

I want passwords. On Wed, Mar 14, 2012 at 8:58 PM, Tyler Hobbs wrote: > If you haven't enabled encryption, it shouldn't be trying to open that > file in the first place. Did you set the location of passwd.properties or > access.properties to be that file? > > If not, there might be a bug here

Re: Row iteration over indexed clause

Are you writing a new client for a language that doesn't have good drivers? If not, most of the existing clients already break up the query into chunks, I think. The pycassa implementation of this might be a useful reference: https://github.com/pycassa/pycassa/blob/master/pycassa/columnfamily.py#

Re: snapshot files locked

Sure: https://issues.apache.org/jira/browse/CASSANDRA-4050. Thanks, Jim On 3/14/2012 10:17 AM, Tyler Hobbs wrote: Can you open a ticket on https://issues.apache.org/jira/browse/CASSANDRA for this? On Wed, Mar 14, 2012 at 3:04 PM, Jim Newsham > wrote: H

Re: snapshot files locked

Can you open a ticket on https://issues.apache.org/jira/browse/CASSANDRAfor this? On Wed, Mar 14, 2012 at 3:04 PM, Jim Newsham wrote: > > Hi Maki, > > Thanks for the reply. Yes, I understand that snapshots are hard links. > However, my understanding is that removing any hard-linked files just >

Re: Does the 'batch' order matter ?

On Wed, Mar 14, 2012 at 11:50 AM, A J wrote: > > Are you saying the way 'batch mutate' is coded, the order of writes in > the batch does not mean anything ? You can ask the batch to do A,B,C > and then D in sequence; but sometimes Cassandra can end up applying > just C and A,B (and D) may still n

Re: Datastax Enterprise mixed workload cluster configuration

Yes, you can do this. You will want to have three DCs: DC1 with [1, 2, 3], DC2 with [4, 5, 6], and DC3 with [7, 8, 9]. For your normal data keyspace, the replication strategy should be NTS, and the strategy_options should have some replicas in each of the three DCs. For example: {DC1: 3, DC2: 3,

Re: snapshot files locked

Hi Maki, Thanks for the reply. Yes, I understand that snapshots are hard links. However, my understanding is that removing any hard-linked files just removes the link (decrementing the link counter of the file on disk) -- it does not delete the file itself nor remove any other links which m

Re: [Windows] How to configure simple authentication and authorization ?

If you haven't enabled encryption, it shouldn't be trying to open that file in the first place. Did you set the location of passwd.properties or access.properties to be that file? If not, there might be a bug here. On Wed, Mar 14, 2012 at 10:49 AM, Sabbiolina wrote: > > > encryption_options: >

RE: Composite keys and range queries

Right, so until the new CQL stuff exists to actually query with something smart enough to know about "composite keys" , You have to define and query on your own. Row Key = UUID Column = CompositeColumn(string, string) You want to then use COLUMN slicing, not row ranges to query the data. Where

RE: Large hints column family

Forgot to mention that this is on 1.0.8 From: Bryce Godfrey [mailto:bryce.godf...@azaleos.com] Sent: Wednesday, March 14, 2012 12:34 PM To: user@cassandra.apache.org Subject: Large hints column family The system HintsColumnFamily seems large in my cluster, and I want to track down why that is.

Large hints column family

The system HintsColumnFamily seems large in my cluster, and I want to track down why that is. I try invoking "listEndpointsPendingHints()" for o.a.c.db.HintedHandoffManager and it never returns, and also freezes the node that its invoked against. It's a 3 node cluster, and all nodes have been

Re: Composite keys and range queries

Hmm, now I'm really confused. > This may be of use to you http://www.datastax.com/dev/blog/schema-in-cassandra-1-1 This article is what I actually used to come up with my schema here. In the "Clustering, composite keys, and more" section they're using a schema very similarly to how I'm trying to

Datastax Enterprise mixed workload cluster configuration

Hi everyone, I want to test out the Datastax Enterprise software to have a mixed workload setup with an analytics and a real time part. However I am not sure how to configure it to achieve what I want: I will have 3 real machines on one side of a gateway (1,2,3) and 6 VMs on another(4,5,6). 1,2

Re: cleanup crashing with "java.util.concurrent.ExecutionException: java.lang.ArrayIndexOutOfBoundsException: 8"

Thanks, good to know there's a fix on the way. In the mean time is there any way to work around this? Or perhaps should I move back to SizeTiered until 1.0.9 is released? On Wed, Mar 14, 2012 at 3:00 PM, Maki Watanabe wrote: > Fixed in 1.0.9, 1.1.0 > https://issues.apache.org/jira/browse/CASSANDR

Re: Does the 'batch' order matter ?

hmmnot sure I understand. Are you saying the way 'batch mutate' is coded, the order of writes in the batch does not mean anything ? You can ask the batch to do A,B,C and then D in sequence; but sometimes Cassandra can end up applying just C and A,B (and D) may still not be applied ? Thanks.

Re: [Windows] How to configure simple authentication and authorization ?

encryption_options: internode_encryption: none keystore: conf/.keystore keystore_password: cassandra truststore: conf/.truststore truststore_password: cassandra from log: INFO [FlushWriter:1] 2012-03-14 14:32:58,948 Memtable.java (line 283) Completed flushing C:\DataStax\data\

Re: counter columns question

Thanks! *Tamar Fraenkel * Senior Software Engineer, TOK Media [image: Inline image 1] ta...@tok-media.com Tel: +972 2 6409736 Mob: +972 54 8356490 Fax: +972 2 5612956 On Wed, Mar 14, 2012 at 1:52 PM, Alain RODRIGUEZ wrote: > Here you got a good explaination of how the counters work. >

Re: Adding nodes to cluster (Cassandra 1.0.8)

Try: % telnet seed_node 7000 on the 3rd node and see what it says. maki 2012/3/14 Rishabh Agrawal : > I am using storage port 7000 (deafult) across all nodes. > > -Original Message- > From: Maki Watanabe [mailto:watanabe.m...@gmail.com] > Sent: Wednesday, March 14, 2012 3:42 PM > To: u

Re: cleanup crashing with "java.util.concurrent.ExecutionException: java.lang.ArrayIndexOutOfBoundsException: 8"

Fixed in 1.0.9, 1.1.0 https://issues.apache.org/jira/browse/CASSANDRA-3989 You should better to avoid to use cleanup/scrub/upgradesstable if you can on 1.0.7 though it will not corrupt sstables. 2012/3/14 Thomas van Neerijnen : > Hi all > > I am trying to run a cleanup on a column family and am g

Re: Adding nodes to cluster (Cassandra 1.0.8)

It looks like Cassandra is not able to find your existing cluster. Do you use the same name of cluster in the 2 nodes ? Are you able to contact the existing node on port 7000 from the new node ? Is the first node defined as a seed in the cassandra.yaml of your 2 nodes ? If you can't make a conn

Re: LeveledCompaction and/or SnappyCompressor causing memory pressure during repair

Thanks for the suggestions but I'd already removed the compression when your message came thru. That alleviated the problem but didn't solve it. I'm still looking at a few other possible causes, I'll post back if I work out what's going on, for now I am running rolling repairs to avoid another outa

cleanup crashing with "java.util.concurrent.ExecutionException: java.lang.ArrayIndexOutOfBoundsException: 8"

Hi all I am trying to run a cleanup on a column family and am getting the following error returned after about 15 seconds. A cleanup on a slightly smaller column family completes in about 21 minutes. This is on the Apache packaged version of Cassandra on Ubuntu 11.10, version 1.0.7. ~# nodetool -

Spotify at Cassandra Europe. Last tickets remaining.

Hi All, The first ever edition of Cassandra Europe is now only two weeks away. Only a few tickets remain so if you intend to attend, make sure to book now to avoid disappointment. We are happy to announce that Spotify have become sponsors of Cassandra Europe. In addition to Spotify, we are pleased

Re: counter columns question

Here you got a good explaination of how the counters work. Video : http://blip.tv/datastax/counters-in-cassandra-5497678 Sildes : http://www.datastax.com/wp-content/uploads/2011/07/cassandra_sf_counters.pdf I think it will answer your question and help you understanding interesting things about c

counter columns question

Hi! My apologies for the naive question, but I am new to Cassandra and even more to counter columns. If I have a counter column, what happens if two threads are trying to increment it's value at the same time for the same key? Thanks, *Tamar Fraenkel * Senior Software Engineer, TOK Media [imag

Re: upgrade from 1.0.7 to 1.0.8

Haven't got to it yet, will update you when I do, *Tamar Fraenkel * Senior Software Engineer, TOK Media [image: Inline image 1] ta...@tok-media.com Tel: +972 2 6409736 Mob: +972 54 8356490 Fax: +972 2 5612956 On Wed, Mar 14, 2012 at 11:40 AM, Alain RODRIGUEZ wrote: > Did everything go

RE: Adding nodes to cluster (Cassandra 1.0.8)

I am using storage port 7000 (deafult) across all nodes. -Original Message- From: Maki Watanabe [mailto:watanabe.m...@gmail.com] Sent: Wednesday, March 14, 2012 3:42 PM To: user@cassandra.apache.org Subject: Re: Adding nodes to cluster (Cassandra 1.0.8) Do you use same storage_port across

Re: CAn't bootstrap a new node to my cluster

I have to add that I didn't set the token too to let the cluster choose one On 3/14/12 10:11 AM, Cyril Scetbon wrote: To bootstap the node I : - start a new node with auto_bootstrap=true and join-ring=false - use the join command and yes, when I use the join command the first time, it says it

Re: Adding nodes to cluster (Cassandra 1.0.8)

Do you use same storage_port across 3 nodes? Can you access to the storage_port of the seed node from the last (failed) node? 2012/3/14 Rishabh Agrawal : > I was able to successfully join a node to already existing one-node cluster > (without giving any intital_token), but when I add another machi

Re: upgrade from 1.0.7 to 1.0.8

Did everything go well with your update ? Do the version 1.0.8 worth the risk of an update? Alain 2012/3/11 Tamar Fraenkel > Thanks! will check it in the following days :) > *Tamar Fraenkel * > Senior Software Engineer, TOK Media > > [image: Inline image 1] > > > ta...@tok-media.com > Tel: +

Adding nodes to cluster (Cassandra 1.0.8)

I was able to successfully join a node to already existing one-node cluster (without giving any intital_token), but when I add another machine with identical settings (with changes in listen broadcast and rpc address). I am unable to join it to the cluster and it gives me following error: INFO

Re: CAn't bootstrap a new node to my cluster

To bootstap the node I : - start a new node with auto_bootstrap=true and join-ring=false - use the join command and yes, when I use the join command the first time, it says it can't find seed nodes, as I wrote in my first email The logfiles I sent you have all this except that the join error

Re: Why is row lookup much faster than column lookup

Here is a look at query plans http://thelastpickle.com/2011/07/04/Cassandra-Query-Plans/ tl;dr - wide rows require in index to be read from disk; the fastest query uses no start and no finish. Cheers - Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.co

Re: high level of MemtablePostFlusher pending events

Fixed in 1.0.3 https://issues.apache.org/jira/browse/CASSANDRA-3482 Cheers - Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 14/03/2012, at 3:45 PM, David Hawthorne wrote: > 5 node cluster running 1.0.2, doing about 1300 reads and 1300 writes/sec

Re: Composite keys and range queries

You are seeing this http://wiki.apache.org/cassandra/FAQ#range_rp The hash for (uuid-1 , p1) may be 100 and the hash for (uuid-1, p2) may be 1 . You cannot do what you want to. Even if you passed a start of (uuid1,) and no finish, you would not only get rows where the key starts with uuid1. Th

Re: [Windows] How to configure simple authentication and authorization ?

Have you build and installed SimpleAuthenticator from the source repository? It is not included in the binary kit. maki 2012/3/14 Sabbiolina : > HI. I followed this: > > > > To set up simple authentication and authorization > 1. Edit cassandra.yaml, setting > org.apache.cassandra.auth.SimpleAuthe

Re: Does the 'batch' order matter ?

It may, but it would not be guaranteed. Cheers - Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 14/03/2012, at 8:11 AM, A J wrote: > I know batch operations are not atomic but does the success of a write > imply all writes preceeding it in the ba

Re: Row iteration over indexed clause

If you want 100 results per call, ask for 101. Use the first 100, when you get to the 101'st do not examine it's data. Instead use it's key as the start to get the next 101. Cheers - Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 14/03/2012, at 2:

Re: snapshot files locked

snapshot files are "hardlink"s of the original sstables. As you know, on windows, you can't delete files opened by other process. If you try to delete the "hardlink", windows thinks you try to delete the sstables in production. maki 2012/3/14 Jim Newsham : > > Hi, > > I'm using Cassandra 1.0.8, o