Re: bandwidth limiting Cassandra's replication and access control

2009-11-10 Thread Jonathan Ellis
2009/11/10 Ted Zlatanov : > (BTW, I use Eclipse for Java development, is there a way to run the Ant > tasks automatically to rebuild the generated source if necessary?  It > works fine otherwise.) Someone who uses eclipse want to chime in here? >From IDEA I just use ant on the command line. > I

Re: bandwidth limiting Cassandra's replication and access control

2009-11-10 Thread Ted Zlatanov
On Tue, 10 Nov 2009 13:53:58 -0600 Jonathan Ellis wrote: JE> 2009/11/10 Ted Zlatanov : >> I also would really like a way to limit access to the Thrift interface >> with at least some rudimentary username/password combination.  I don't >> see a way to do that currently. JE> Yeah, lots of people

Re: Timeout Exception

2009-11-10 Thread Jonathan Ellis
I suspect there may be a connection between "the server was busy with something and didn't die immediately with kill -INT" and "I was getting timeout exceptions." On Tue, Nov 10, 2009 at 2:42 PM, Chris Were wrote: > As in... kill -9 > > On Tue, Nov 10, 2009 at 12:38 PM, Jonathan Ellis wrote: >>

Re: Timeout Exception

2009-11-10 Thread Chris Were
I've restarted with debugging and it seems to be ok for the time being. Interesting to note that cassandra wouldn't shut down properly and had to be killed. On Tue, Nov 10, 2009 at 11:55 AM, Jonathan Ellis wrote: > if you're timing out doing a slice on 10 columns w/ 10% cpu used, > something is

Re: Timeout Exception

2009-11-10 Thread Jonathan Ellis
if you're timing out doing a slice on 10 columns w/ 10% cpu used, something is broken is it consistent as to which keys this happens on? try turning on debug logging and seeing where the latency is coming from. On Tue, Nov 10, 2009 at 1:53 PM, Chris Were wrote: > > On Tue, Nov 10, 2009 at 11:50

Re: bandwidth limiting Cassandra's replication and access control

2009-11-10 Thread Jonathan Ellis
2009/11/10 Ted Zlatanov : > One of my concerns is bandwidth usage; I don't want Cassandra > replication traffic swamping more important traffic.  I want to know if > there's a way to limit the bandwidth usage within Cassandra Nope. > I also would really like a way to limit access to the Thrift in

Re: Timeout Exception

2009-11-10 Thread Chris Were
On Tue, Nov 10, 2009 at 11:50 AM, Jonathan Ellis wrote: > On Tue, Nov 10, 2009 at 1:49 PM, Chris Were wrote: > > Maybe... but it's not just multigets, it also happens when retreiving one > > row with get_slice. > > how many of the 3M columns are you trying to slice at once? > Sorry, I must have

Re: Timeout Exception

2009-11-10 Thread Jonathan Ellis
On Tue, Nov 10, 2009 at 1:49 PM, Chris Were wrote: > Maybe... but it's not just multigets, it also happens when retreiving one > row with get_slice. how many of the 3M columns are you trying to slice at once?

bandwidth limiting Cassandra's replication and access control

2009-11-10 Thread Ted Zlatanov
I'm evaluating Cassandra as a storage mechanism for monitoring data: machine and process status reports, inventory, etc. One of my concerns is bandwidth usage; I don't want Cassandra replication traffic swamping more important traffic. I want to know if there's a way to limit the bandwidth usage

Re: Timeout Exception

2009-11-10 Thread Chris Were
On Tue, Nov 10, 2009 at 11:34 AM, Jonathan Ellis wrote: > On Tue, Nov 10, 2009 at 1:23 PM, Chris Were wrote: > > It seems odd that the error sometimes says received 1 response, but it > still > > times out, as I only have one node. > > if it gets a response between when it decides to time out an

Get_slice with super column

2009-11-10 Thread Richard grossman
hi I insert data like this Calendar calendar = Calendar.getInstance(); calendar.setTime(dateAction); calendar.set(Calendar.MILLISECOND, 0); String millis = String.valueOf(calendar.getTimeInMillis()); ColumnPath columnPath = new ColumnPath(columnFamily, millis.getBytes("UTF

Re: Timeout Exception

2009-11-10 Thread Jonathan Ellis
On Tue, Nov 10, 2009 at 1:23 PM, Chris Were wrote: > It seems odd that the error sometimes says received 1 response, but it still > times out, as I only have one node. if it gets a response between when it decides to time out and when it logs the message, that could happen. or does it happen fre

Re: Timeout Exception

2009-11-10 Thread Chris Were
There's no error on the source node other than the Timeout. It appears to be occurring across multiple CF's (the majority of which are normal columns). I don't know an exact number but some of the CF's would have ~3million rows. It seems odd that the error sometimes says received 1 response, but it

Re: Strange Data distribution in 0.4.2

2009-11-10 Thread Jonathan Ellis
... of course this will change over time, which is why we're adding active load balancing in 0.5, but the closer you can get to a reasonable starting point, the better. On Tue, Nov 10, 2009 at 11:08 AM, Jonathan Ellis wrote: > yup, so you need to decide what dates are actually going to appear in

Re: Strange Data distribution in 0.4.2

2009-11-10 Thread Jonathan Ellis
yup, so you need to decide what dates are actually going to appear in your data On Tue, Nov 10, 2009 at 10:59 AM, Richard grossman wrote: > ok but If it's not defined ? for example 1 field is a date there is no end > for date ? > > On Tue, Nov 10, 2009 at 6:57 PM, Jonathan Ellis wrote: >> >> no.

Re: Strange Data distribution in 0.4.2

2009-11-10 Thread Richard grossman
ok but If it's not defined ? for example 1 field is a date there is no end for date ? On Tue, Nov 10, 2009 at 6:57 PM, Jonathan Ellis wrote: > no. > > for randompartitioner, you use integers from 0 to 2**127, but for OPP > you use strings from your key universe. > > On Tue, Nov 10, 2009 at 10:37

Re: Strange Data distribution in 0.4.2

2009-11-10 Thread Jonathan Ellis
no. for randompartitioner, you use integers from 0 to 2**127, but for OPP you use strings from your key universe. On Tue, Nov 10, 2009 at 10:37 AM, Richard grossman wrote: > If I understand good if I transform my String key :: to > some long value and If I've 3 server then I put on the first ser

Re: Strange Data distribution in 0.4.2

2009-11-10 Thread Richard grossman
If I understand good if I transform my String key :: to some long value and If I've 3 server then I put on the first server initialToken : 0 second : Long.max() /2 third : Long.max() Is it correct ?? or there is something be

Re: Strange Data distribution in 0.4.2

2009-11-10 Thread Jonathan Ellis
for OPP, tokens are equivalent to keys so pick keys evenly spaced apart On Tue, Nov 10, 2009 at 9:55 AM, Richard grossman wrote: > hi > > I've understand this but I don't know what to write into initialtoken is it > "1" or "a" or something else ? > as I've said in a previous post My keys are buil

Re: Strange Data distribution in 0.4.2

2009-11-10 Thread Richard grossman
hi I've understand this but I don't know what to write into initialtoken is it "1" or "a" or something else ? as I've said in a previous post My keys are build like :: Is there any link ? Thanks, On Tue, Nov 10, 2009 at 5:48 PM, Jonathan Ellis wrote: > if you're not specifying initialtoken, ev

Re: Strange Data distribution in 0.4.2

2009-11-10 Thread Jonathan Ellis
if you're not specifying initialtoken, every time you wipe your installation it will generate new tokens. for a small number of machines you'll definitely see some random tokens better balanced than others. On Tue, Nov 10, 2009 at 9:38 AM, Richard grossman wrote: > Hi > > I've build the 0.4.2 fr

Strange Data distribution in 0.4.2

2009-11-10 Thread Richard grossman
Hi I've build the 0.4.2 from the tags in SVN. I've made exactly the same cluster with same configuration as 0.4.1 I've delete all the data in all server Now I send the data to first server and the data is not more distributed across the other server as previously. I've configured replica to 1 he

Re: Timeout Exception

2009-11-10 Thread Richard grossman
For me the timeout occurs when I've a lot of request to the server. It was working at 100% CPU and it seems that cassandra was receiving request and keep them into the queue for more than 5000 millis then all the request was rejected with timeout. I can't think about another solution or to increas