get_indexed_slices ~ simple map-reduce

2011-06-11 Thread Michal Augustýn
Hi all, I'm thinking of get_indexed_slices function as a simple map-reduce job (that just maps) - am I right? Well, I would like to be able to run simple queries on values but I don't want to install Hadoop, write map-reduce jobs in Java (the whole application is in C# and I don't want to introdu

Re: Cassandra not starting right

2011-06-11 Thread Sasha Dolgy
Dont post to the list in html...that should work. -f puts it to foreground. Without -f puts it to the bafkground On Jun 11, 2011 7:29 AM, "Jean-Nicolas Boulay Desjardins" < jnbdzjn...@gmail.com> wrote: > Thanks for your help! > > It seems when I use this command: > > ./bin/cassandra -f & > > I

minor vs major compaction and purging data

2011-06-11 Thread Jonathan Colby
I've been reading inconsistent descriptions of what major and minor compactions do. So my question for clarification: Are tombstones purges (ie, space reclaimed) for minor AND major compactions? Thanks.

Re: insert slowdown with secondary indexes

2011-06-11 Thread Donal Zang
On 11/06/2011 02:27, jodylandren...@comcast.net wrote: I'm trying to understand why doing the inserts into a column family with indexes seems to jam things up and am wondering if there are any settings that I could tweak to help. It seems that the 4 node cluster should be able to handle 2 thre

Compacting Large Row

2011-06-11 Thread Jonathan Colby
I'm seeing this in my logs. We are storing emails in cassandra and some of them might be rather large. Is this bad? What exactly is happening when this appears? INFO [CompactionExecutor:1] 2011-06-11 13:39:19,217 CompactionIterator.java (line 150) Compacting large row 39653235326331302d626

Re: minor vs major compaction and purging data

2011-06-11 Thread Jonathan Ellis
Yes. On Sat, Jun 11, 2011 at 6:08 AM, Jonathan Colby wrote: > I've been reading inconsistent descriptions of what major and minor > compactions do. So my question for clarification: > > Are tombstones purges (ie, space reclaimed) for minor AND major compactions? > > Thanks. -- Jonathan Ellis

Re: Compacting Large Row

2011-06-11 Thread Jonathan Ellis
look for in_memory_compaction_limit_in_mb in cassandra.yaml On Sat, Jun 11, 2011 at 7:02 AM, Jonathan Colby wrote: > I'm seeing this in my logs.   We are storing emails in cassandra and some of > them might be rather large. > > Is this bad?  What exactly is happening when this appears? > >  INFO

Re: Troubleshooting IO performance ?

2011-06-11 Thread Philippe
More info below > I just loaded 4.8GB of similar data in another keyspace and ran the same > process as in my previous tests but on that data. > I started with three threads hitting cassandra. No I/O, hardly any CPU (15% > on a 4 core server) > After an hour or so, I raised it to 6 threads in par

Re: Python Client

2011-06-11 Thread Carlos Sanchez
Thx a lot Sent from my iPad On Jun 11, 2011, at 12:42 AM, Jeremy Hanna wrote: > I would take a look at pycassa - https://github.com/pycassa/pycassa though > there is also a twisted client named Telephus - > http://github.com/driftx/Telephus. > > The complete list of current client language

Re: Secondary indices with multiple conditions?

2011-06-11 Thread aaron morton
The query is resolved server side. From the blog post " We can perform the range query now that the state column is also indexed, so Cassandra can use the state predicate as the primary and filter on the other with a nested loop. " So if you have 10 terms, the service will use statistics to fi

Re: Are data migration tools for Cassandra exist?

2011-06-11 Thread aaron morton
Depends on your scale, you can either code something yourself through the API or take advantage of the Hadoop integration and run jobs that read and write the data back. In either case you can change the code first to write to the new column as well as the old, then update all existing data, the