Re: avro + cassandra + ruby

2010-11-17 Thread Benjamin Black
Full list of client options and defaults: https://github.com/fauna/thrift_client/blob/master/lib/thrift_client/abstract_thrift_client.rb#L28-43 On Wed, Nov 17, 2010 at 10:13 AM, Benjamin Black wrote: > Cassandra.new(keyspace, server, {:protocol => > Thrift::BinaryProtocolAccelerated}) > > On Tue,

Re: avro + cassandra + ruby

2010-11-17 Thread Benjamin Black
Cassandra.new(keyspace, server, {:protocol => Thrift::BinaryProtocolAccelerated}) On Tue, Nov 16, 2010 at 5:13 PM, Ryan King wrote: > On Tue, Nov 16, 2010 at 10:25 AM, Jonathan Ellis wrote: >> On Tue, Sep 28, 2010 at 6:35 PM, Ryan King wrote: >>> One thing you should try is to make thrift use >

Re: avro + cassandra + ruby

2010-11-16 Thread Ryan King
On Tue, Nov 16, 2010 at 10:25 AM, Jonathan Ellis wrote: > On Tue, Sep 28, 2010 at 6:35 PM, Ryan King wrote: >> One thing you should try is to make thrift use >> BinaryProtocolAccelerated, rather than the pure-ruby implementation >> (we should change the default). > > Dumb question time: how do yo

Re: avro + cassandra + ruby

2010-11-16 Thread Jonathan Ellis
On Tue, Sep 28, 2010 at 6:35 PM, Ryan King wrote: > One thing you should try is to make thrift use > BinaryProtocolAccelerated, rather than the pure-ruby implementation > (we should change the default). Dumb question time: how do you do this? $ find . -name "*.rb" |xargs grep -i binaryprotocol

Re: avro + cassandra + ruby

2010-09-30 Thread Ryan King
On Thu, Sep 30, 2010 at 1:08 PM, Gabor Torok wrote: > I added a comment to an existing issue: > https://issues.apache.org/jira/browse/AVRO-537 Cool. I'll work with Jeff (who sits about 10 feet from me) to get this fixed. :) -ryan

RE: avro + cassandra + ruby

2010-09-30 Thread Gabor Torok
I added a comment to an existing issue: https://issues.apache.org/jira/browse/AVRO-537 Thanks, --Gabor

RE: avro + cassandra + ruby

2010-09-30 Thread Stu Hood
Coool. Would you mind opening an Avro issue for that, or should I? -Original Message- From: "Gabor Torok" Sent: Thursday, September 30, 2010 2:36pm To: "user@cassandra.apache.org" Subject: RE: avro + cassandra + ruby The ruby code creates a new http connect

Re: avro + cassandra + ruby

2010-09-30 Thread Aaron Morton
If you turn logging up to DEBUG do you see any lines such as this when running your script.DEBUG [pool-1-thread-22] 2010-10-01 08:22:12,723 ClientState.java (line 107) logged out: #And out of interest, if you send two multiget_slice calls, do they both log from the same thread? e.g. DEBUG [pool-1-t

RE: avro + cassandra + ruby

2010-09-30 Thread Gabor Torok
The ruby code creates a new http connection for each call to transceive. Here is what I changed to make it work: gabor$ diff /usr/local/lib/ruby/gems/1.8/gems/avro-1.4.0/lib/avro/ipc.rb ~/avro-trunk/lang/ruby/lib/avro/ipc.rb 518d517 < require "net/http" 525d523 < @conn = Net::HTTP.start

Re: avro + cassandra + ruby

2010-09-30 Thread Gabor Torok
I ran the python code like Gary suggested and it succeeded. (As an aside, it would be nice if I could run the python code for avro without having thrift installed.) Then I re-created my ruby example in python (essentially calling set_keyspace and then making a multiget_slice call) and it also s

Re: avro + cassandra + ruby

2010-09-30 Thread Gabor Torok
The server exception is: WARN 09:49:56,644 user error org.apache.cassandra.avro.KeyspaceNotDefinedException at org.apache.cassandra.avro.AvroValidation.validateKeyspace(AvroValidation.java:73) at org.apache.cassandra.avro.AvroValidation.validateColumnParent(AvroValidation.java:12

Re: avro + cassandra + ruby

2010-09-29 Thread Ryan King
On Tue, Sep 28, 2010 at 4:06 PM, Gabor Torok wrote: > Hi, > I'm attempting to use avro to talk to cassandra because the ruby thrift > client's read performance is pretty bad (I measured 4x slower than java). > > However, I run into a problem when calling multiget_slice. > The server gives a Keysp

Re: avro + cassandra + ruby

2010-09-29 Thread Gary Dusbabek
We have a system test that tests this (in avro python). see test/system/test_avro_standard.py:TestStandardOperations.test_multiget_slice_simple. On Wed, Sep 29, 2010 at 01:06, Gabor Torok wrote: > Hi, > I'm attempting to use avro to talk to cassandra because the ruby thrift > client's read perf

Re: avro + cassandra + ruby

2010-09-28 Thread Gabor Torok
Thanks, that made things better by about 30%. Unfortunately for me that's still unacceptable... :-( I feel like I'm doing something wrong with avro (see my original post). Was anyone able to make it work?

Re: avro + cassandra + ruby

2010-09-28 Thread Ryan King
On Tue, Sep 28, 2010 at 4:06 PM, Gabor Torok wrote: > Hi, > I'm attempting to use avro to talk to cassandra because the ruby thrift > client's read performance is pretty bad (I measured 4x slower than java). Only 4x feels like a win. :) One thing you should try is to make thrift use BinaryProto

avro + cassandra + ruby

2010-09-28 Thread Gabor Torok
Hi, I'm attempting to use avro to talk to cassandra because the ruby thrift client's read performance is pretty bad (I measured 4x slower than java). However, I run into a problem when calling multiget_slice. The server gives a KeyspaceNotDefinedException because clientState.getKeyspace() retur