Ruby, CQL and client libraries

2011-12-05 Thread Matthew Stump
Howdy, I'm working on transferring an existing Ruby on Rails project from Postgres to Cassandra and I have a couple questions about the Ruby client libraries and client libraries in general. 1.) Is it the opinion of the community and the Datastax engineers that client libraries should migrate

Re: DyanmicCompositeType bug?

2011-12-05 Thread Sylvain Lebresne
On Mon, Dec 5, 2011 at 8:19 AM, Boris Yen yulin...@gmail.com wrote: Hi, I am using 0.8.7. I was trying to use DynamicComposite column. After I intentional added a column (string:string:uuid) into a record which has previous columns inserted with comparator (string:uuid:uuid). I got an

Re: Re: Cassandra DataModeling recommendations

2011-12-05 Thread pcohen
Hi Thanks for the answer, as I read the book on Cassandra, I was not aware at that time on Composite Key which I recently discovered. You mentioned a TTL and let the database remove the date for me. I never read about that. Is it possible without an external batch ? I will try to

Re: DyanmicCompositeType bug?

2011-12-05 Thread Boris Yen
It looks like using the dynamicComposite is a dangerous action. However, one mistaken insertion causes the database to corrupt seems a little bit too much. Is there anyway to just skip the wrong column. On Mon, Dec 5, 2011 at 5:31 PM, Sylvain Lebresne sylv...@datastax.comwrote: On Mon, Dec 5,

Re: Re: Cassandra DataModeling recommendations

2011-12-05 Thread Boris Yen
I think most of the book for cassandra are outdated, try to get information from http://www.datastax.com/docs/1.0/index As for ttl, you could read http://www.datastax.com/dev/blog/whats-new-cassandra-07-expiring-columns for more information. for composite type, you could read

Re: Re: Cassandra DataModeling recommendations

2011-12-05 Thread samal
On Mon, Dec 5, 2011 at 3:06 PM, pco...@cegetel.net wrote: Hi Thanks for the answer, as I read the book on Cassandra, I was not aware at that time on Composite Key which I recently discovered. *Composite Type's are useful for handling data-versions. * * * * *You mentioned a TTL and let the

Re: OutOfMemory Exception during bootstrap

2011-12-05 Thread Harald Falzberger
I don't think that this is the problem because I'm testing on a supercomputer with 16T RAM. Is it possible, that cassandra runs into this bug of the jvm? http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=6399443 On Mon, Dec 5, 2011 at 06:29, samal samalgo...@gmail.com wrote: Lower your heap

Strange problem with cassandra

2011-12-05 Thread Konstantin Chernyakov
Hi. We are faced with strange problem where Cassandra nodes lose each other only one day of week, on friday, in exactly 14:50 PM, within several months. On that time each node periodically reports that other nodes are dead. At same time nodes are working fine. This continues about one hour,

Re: Strange problem with cassandra

2011-12-05 Thread Riyad Kalla
Konstantin, Have you checked the weekly cron job list on the servers or looked at the system logs at those rough times to see what the servers are doing? I doubt Cassandra has any time-sensitive code in it to kill off connections at 14:50pm, so my guess is something on the host causing the

Re: Ruby, CQL and client libraries

2011-12-05 Thread hani elabed
Hi Matt, This is definitely not at all an authoritative opinion... I am still figuring things out with Cassandra... Others may want to correct me... Charles Maxwood(sp?) started a 'Sandra' project on github to make access to Cassandra, more or less, similar to Active Record... it is very early

Re: Ruby, CQL and client libraries

2011-12-05 Thread Robert Jackson
From: Matthew Stump mrevilgn...@gmail.com To: user@cassandra.apache.org Sent: Monday, December 5, 2011 2:59:34 AM Subject: Ruby, CQL and client libraries Howdy, I'm working on transferring an existing Ruby on Rails project from Postgres to Cassandra and I have a couple questions about

node.js library?

2011-12-05 Thread Joe Stein
Hey folks, so I have been noodling on using node.js as a new front end for the system I built for doing real time aggregate metrics within our distributed systems. Does anyone have experience or background story on this lib? http://code.google.com/a/apache-extras.org/p/cassandra-node/ it seems to

Re: node.js library?

2011-12-05 Thread Norman Maurer
As far as I know its the library that was developed by rackspace. See https://github.com/racker/node-cassandra-client As rackspace is using node.js + cassandra I would expect it works ;) Bye, Norman 2011/12/5 Joe Stein crypt...@gmail.com Hey folks, so I have been noodling on using node.js

Modeling Bi-temporal data in Cassandra

2011-12-05 Thread Vigo, Jornei A
Hello, We currently have data stored in a bi-temporal fashion using a DBRMS. I've been trying to find recommendations on how to model bi-temporal using a NoSQL database such as Cassandra but without much success. Does anybody in the list have had success in doing such thing in

Re: node.js library?

2011-12-05 Thread samal
On Mon, Dec 5, 2011 at 7:59 PM, Norman Maurer norman.mau...@googlemail.comwrote: As far as I know its the library that was developed by rackspace. See https://github.com/racker/node-cassandra-client *No longer maintained. it is moved as separate project in apache-extras * 2011/12/5 Joe

Setting Key Validation Class

2011-12-05 Thread Dinusha Dilrukshi
Hi, I am using apache-cassandra-1.0.0 and I tried to insert/retrieve data in a column family using cassandra-jdbc program. Here is how I created 'USER' column family using cassandra-cli. create column family USER with comparator=UTF8Type and column_metadata=[{column_name: user_id,

Re: Strange problem with cassandra

2011-12-05 Thread Konstantin Chernyakov
Thank you for reply. Yes, we have checked windows event logs and task scheduler, but haven't seen anything special. In addition, We have deployed one more cluster on same machines without any data and problem haven't reproduced on same time. It's very strange. On Mon, Dec 5, 2011 at 7:45 PM,

Increase replication factor

2011-12-05 Thread A J
If I update a keyspace to increase the replication factor; what happens to existing data for that keyspace ? Does the existing data get automatically increase its replication ? Or only on a RR or node repair does the existing data increase its replication factor ? Thanks.

Re: Setting Key Validation Class

2011-12-05 Thread Filipe Gonçalves
Cassandra's data model is NOT table based. The key is not a column, it is a separate value. index_type: KEYS means you are creating an index on that column, and that index can only be acessed in an equality query ( column = x ). You should probably read http://www.datastax.com/docs/1.0/ddl/index

Re: Setting Key Validation Class

2011-12-05 Thread samal
key_validation_class is different from validation_class validation are BytesType by default. key_valdation_class = key default_validation_class=column_values comparator=column_name default_validation_class is global scope of validation_class On Mon, Dec 5, 2011 at 10:10 PM, Dinusha Dilrukshi

Re: Ruby, CQL and client libraries

2011-12-05 Thread Matthew Stump
Ah yes, I should clarify. What I should have said was an ORM type library which uses cassandra-cql as it's base. What I was looking for was someone that had wrapped cassandra-cql with an active record or data mapper compatibility layer. My concern is that it i'm looking for a ruby client

Re: Increase replication factor

2011-12-05 Thread Alain RODRIGUEZ
http://www.datastax.com/docs/1.0/operations/cluster_management#changing-the-replication-factor It looks like a nodetool repair is needed after increasing your RF. I guess that a cleanup has to be performed after decreasing the RF to remove useless replica. Alain 2011/12/5 A J s5a...@gmail.com

Re: Setting Key Validation Class

2011-12-05 Thread Dinusha Dilrukshi
Hi Filipe/ Samal, Thanks for clarifications. Regards, ~Dinusha~ On Mon, Dec 5, 2011 at 10:28 PM, samal samalgo...@gmail.com wrote: key_validation_class is different from validation_class validation are BytesType by default. key_valdation_class = key

Re: [RELEASE] Apache Cassandra 1.0.5 released

2011-12-05 Thread Zhong Li
You may run stress -d node to create Standard1 CF and data. On Dec 3, 2011, at 3:44 PM, mike...@thomsonreuters.com mike...@thomsonreuters.com wrote: Hi Zhong Li, When I used stress tool to test, I got: Operation [15] retried 10 times - error inserting key 0015

CQL Install for 0.8.X?

2011-12-05 Thread Joe Stein
Hey, trying to grab cqlsh for a 0.8.6 cluster but all the online docs I am finding are pointing to http://www.apache.org/dist/cassandra/drivers/py or say it moved to the source and checked there in the 0.8 branch and nothing either... also saw something about about 2.0 not being compatible with

best practices for simulating transactions in Cassandra

2011-12-05 Thread John Laban
Hello, I'm building a system using Cassandra as a datastore and I have a few places where I am need of transactions. I'm using ZooKeeper to provide locking when I'm in need of some concurrency control or isolation, so that solves that half of the puzzle. What I need now is to sometimes be able

Re: Repair failure under 0.8.6

2011-12-05 Thread Maxim Potekhin
Basically I tweaked the phi, put in more verbose GC reporting and decided to do a compaction before I proceed. I'm getting this on the node where compaction is being run. And the system log for the other two nodes follows. It's obvious that the cluster is sick, but I can't determine why --

Re: Pig Output

2011-12-05 Thread Aaron Griffith
i think getmerge will work.

Re: Ruby, CQL and client libraries

2011-12-05 Thread Aaron Turner
On Sun, Dec 4, 2011 at 11:59 PM, Matthew Stump mrevilgn...@gmail.com wrote: 3.) Other than the fauna/twitter client what are other people using for Ruby? I'm probably the only person using JRuby + Hector. This ended up being a big win since to get high performance with Cassandra you either

Could not reach schema agreement... 0.8.6

2011-12-05 Thread Maxim Potekhin
Hello, upon startup, in my cluster of 3 machines, I see similar messages in system.log on each node (below). I start nodes one by one, after I ascertain the previous one is online. So they can't reach schema agreement, all of them. Why? No unusual load visible in Ganglia plots. ERROR

Re: CQL Install for 0.8.X?

2011-12-05 Thread Eric Evans
On Mon, Dec 5, 2011 at 1:40 PM, Joe Stein crypt...@gmail.com wrote: Hey, trying to grab cqlsh for a 0.8.6 cluster but all the online docs I am finding are pointing to http://www.apache.org/dist/cassandra/drivers/py or say it moved to the source and checked there in the 0.8 branch and nothing