Live updates in Cassandra

2010-06-29 Thread David Boxenhorn
Does anyone have any advice for me about how to do live updates (i.e. updates on clusters while they are in use)? My situation is like this: Some data comes from the back office - this data is imported to Cassandra from Oracle. Some data comes from users - this data is imported to Oracle from

Consitency level ONE

2010-06-29 Thread Wouter de Bie
Hi all, I'm having some issues with read consistency level ONE. The Wiki (and other sources) say the following: Will return the record returned by the first node to respond. A consistency check is always done in a background thread to fix any consistency issues when ConsistencyLevel.ONE is

Re: Consitency level ONE

2010-06-29 Thread Sylvain Lebresne
Hi all, I'm having some issues with read consistency level ONE. The Wiki (and other sources) say the following: Will return the record returned by the first node to respond. A consistency check is always done in a background thread to fix any consistency issues when ConsistencyLevel.ONE

Re: Consitency level ONE

2010-06-29 Thread Wouter de Bie
On Jun 29, 2010, at 1:03 PM, Sylvain Lebresne wrote: Hi all, I'm having some issues with read consistency level ONE. The Wiki (and other sources) say the following: Will return the record returned by the first node to respond. A consistency check is always done in a background thread

Re: Avro API on cassandra trunk with ruby

2010-06-29 Thread Eric Evans
On Tue, 2010-06-29 at 13:10 +0200, Christian van der Leeden wrote: just trying to talk to cassandra-trunk (0.7) via avro on ruby. Started the server with ./bin/cassandra -a -f. The connection code is here: http://pastie.org/1023158 Cassandra uses the HTTP transport (for now anyway),

Re: Avro API on cassandra trunk with ruby

2010-06-29 Thread Christian van der Leeden
Thanks, this works now. Christian On Jun 29, 2010, at 5:26 PM, Eric Evans wrote: On Tue, 2010-06-29 at 13:10 +0200, Christian van der Leeden wrote: just trying to talk to cassandra-trunk (0.7) via avro on ruby. Started the server with ./bin/cassandra -a -f. The connection code is

Cassandra Data Model Design Visualization

2010-06-29 Thread Utku Can Topçu
Hey Guys, I've been into designing an application which consists of more than 20 ColumnFamily's. Each ColumnFamily has some columns referencing to keys in other ColumnFamily's, some keys in ColumnFamily are combination of keys/columns in other ColumnFamily's. I guess most of the people are

Implementing Counter on Cassandra

2010-06-29 Thread Utku Can Topçu
Hey Guys, Currently in a project I'm involved in, I need to have some columns holding incremented data. The easy approach for implementing a counter with increments is right now as I figured out is read - increment - insert however this approach is not an atomic operation and can easily be

Re: Implementing Counter on Cassandra

2010-06-29 Thread Ryan King
On Tue, Jun 29, 2010 at 9:42 AM, Utku Can Topçu u...@topcu.gen.tr wrote: Hey Guys, Currently in a project I'm involved in, I need to have some columns holding incremented data. The easy approach for implementing a counter with increments is right now as I figured out is read - increment -

Cluster-wide pause

2010-06-29 Thread Oren Benjamin
Hi all - first timer here. I'm experimenting with Cassandra on Rackspace Cloud. Started with 4GB nodes and saw read latency spikes while streaming was taking place, so I increased to 8GB to see if limited memory was the issue. Now I'm seeing very strange behavior during any period that

Re: Cassandra Data Model Design Visualization

2010-06-29 Thread Peter Sankauskas
This sounds like an excellent reason to build a Cassandra Eclipse plugin - it doesn't look like anyone is doing this yet. Kind regards, Peter Sankauskas Motally, Inc Office: +1 (415) 932-6898 On Tue, Jun 29, 2010 at 8:59 AM, Utku Can Topçu u...@topcu.gen.tr wrote: Hey Guys, I've been into

[RELEASE] 0.6.3

2010-06-29 Thread Eric Evans
Another month of feedback, bug reports, discussion, and patching has yielded another stable release, 0.6.3, and it's The Best Evar. But don't take my word for it, go checkout the list of changes[1] for yourself and when satisfied, download yours[2]. As always, mailing listers are standing by to

Re: Cassandra on AWS across Regions

2010-06-29 Thread Anthony Molinaro
Maybe you need to modify the security groups to allow the ports to be accessible from one to the other? -Anthony On Mon, Jun 28, 2010 at 08:34:12PM -0700, maneela a wrote: I have provided East node's public DNS/ip address at that both end points ( ListenAddress and ThriftAddress) and West

Re: Cassandra on AWS across Regions

2010-06-29 Thread Joe Stump
On Jun 29, 2010, at 12:44 PM, Anthony Molinaro wrote: Maybe you need to modify the security groups to allow the ports to be accessible from one to the other? A likely better solution would be to look into the VPNCubed product which was built specifically for this purpose. We're in the middle

Re: Implementing Counter on Cassandra

2010-06-29 Thread Jonathan Shook
Until then, a pragmatic solution, however undesirable, would be to only have a single logical thread/task/actor that is allowed to read,modify,update. If this doesn't work for your application, then a (distributed) lock manager may be used until such time that you can take it out. Some are using

Cassandra and Avro

2010-06-29 Thread Peter Minearo
I just pulled down Cassandra 0.6.3. I saw this same issue in 0.6.2. Why is there a difference between apache-cassandra-0.6.3-bin.jar and apache-cassandra-0.6.3-src.jar when it comes to the Avro classes? The 'bin' file has 16 top level classes; while the 'src' file only has 4. Even the

Re: Cassandra and Avro

2010-06-29 Thread Roger Schildmeijer
The (16-4) classes are generated in the ant build script. (In the binary distribution these are already generated for you). // Roger Schildmeijer On 29 jun 2010, at 21.41em, Peter Minearo wrote: I just pulled down Cassandra 0.6.3. I saw this same issue in 0.6.2. Why is there a difference

Re: Cassandra on AWS across Regions

2010-06-29 Thread Lenin Gali
Thanks Joe, I was hoping to hear from you. Can you pass me the SA contact at AWS we would love to look in to it. Lenin --Original Message-- From: Joe Stump To: user@cassandra.apache.org ReplyTo: user@cassandra.apache.org Subject: Re: Cassandra on AWS across Regions Sent: Jun 29, 2010

RE: Cassandra and Avro

2010-06-29 Thread Peter Minearo
Is there any way to get a description on these generated classes. I see they are similar to the Thrift set of classes; but there seems to be some differences; especially with the Cassandra class. -Original Message- From: Roger Schildmeijer [mailto:schildmei...@gmail.com] Sent:

Re: Cassandra on AWS across Regions

2010-06-29 Thread Joe Stump
On Jun 29, 2010, at 2:56 PM, Lenin Gali wrote: Thanks Joe, I was hoping to hear from you. Can you pass me the SA contact at AWS we would love to look in to it. Just contact your account representative. They'll get you hooked up. They have multiple SAs that help out account representatives.

Re: Cassandra and Thrift on the Server Side

2010-06-29 Thread Mike Malone
Still, to Clint's point, everyone knows how to make an HTTP request. If you want a cassandra client running on, let's say, an iPhone for some reason, a REST API is going to be a lot more straight forward to implement. There's no reason an HTTP service would have to live inside the Cassandra

Upgrading 0.6.2 - 0.6.3

2010-06-29 Thread Anthony Ikeda
Kay, I've been upgrading node this morning on our servers and so far so good. Although in the startup I noticed the following message: INFO 10:22:49,413 Saved partitioner not found. Using org.apache.cassandra.dht.OrderPreservingPartitioner The storage-conf.xml file is configured to use

Re: Upgrading 0.6.2 - 0.6.3

2010-06-29 Thread Jonathan Ellis
Nothing to worry about, we just save the partitioner now so we can detect if it's changed in the config file after data has been loaded (which would break stuff). On Tue, Jun 29, 2010 at 7:25 PM, Anthony Ikeda anthony.ik...@cardlink.com.au wrote: Kay, I’ve been upgrading node this morning on

Re: Cassandra and Avro

2010-06-29 Thread Jonathan Ellis
Avro in 0.6 is not even close to being usable, nor is it meant to be. Use Thrift. On Tue, Jun 29, 2010 at 4:33 PM, Peter Minearo peter.mine...@reardencommerce.com wrote: Is there any way to get a description on these generated classes.  I see they are similar to the Thrift set of classes; but

Re: Migrate cassandra between two DCs

2010-06-29 Thread Jonathan Ellis
On Mon, Jun 28, 2010 at 10:11 PM, albert_e dongz...@gmail.com wrote: Hi, all We have several nodes in DC1 and DC2 and we want to move all nodes in DC2 to a new DC3, also IPs will be changed. The whole progress will last about 1-2 days. Can we simply stop all nodes in DC2, move to DC3, chage

Re: Cluster-wide pause

2010-06-29 Thread Jonathan Ellis
You could be seeing GC pauses. Did you increase the heap size you gave Cassandra, when you increased your VM size? On Tue, Jun 29, 2010 at 11:57 AM, Oren Benjamin o...@clearspring.com wrote: Hi all - first timer here. I'm experimenting with Cassandra on Rackspace Cloud.  Started with 4GB nodes