Re: Error during startup

2010-05-31 Thread David Boxenhorn
Thanks! On Tue, Jun 1, 2010 at 9:09 AM, Jonathan Ellis wrote: > Created https://issues.apache.org/jira/browse/CASSANDRA-1146 > > On Tue, Jun 1, 2010 at 12:46 AM, David Boxenhorn > wrote: > > 0.6.2 > > > > On Mon, May 31, 2010 at 9:50 PM, Jonathan Ellis > wrote: > >> > >> What version of Cassan

Re: Can't get data after building cluster

2010-05-31 Thread David Boxenhorn
I don't think it can be the case that "at most data in the token range assigned to that node will be affected" - the new node had no knowledge of any of our data. Any fake "data" that it might have had through some error on my part could not have been within the range of real data. I had 4.25 G of

Re: nodetool cleanup isn't cleaning up?

2010-05-31 Thread Ran Tavory
ok, let me try and translate your answer ;) Are you saying that the data that was left on the node is non-primary-replicas of rows from the time before the move? So this implies that when a node moves in the ring, it will affect distribution of: - new keys - old keys primary node -- but will not a

writing speed test

2010-05-31 Thread Shuai Yuan
Hi all, I'm testing writing speed of cassandra with 4 servers. I'm confused by the behavior of cassandra. ---env--- load-data app written in c++, using libcassandra (w/ modified batch insert) 20 writing threads in 2 processes running on 2 servers ---optimization--- 1.turn log level to INFO 2.JVM

Re: searching keys of the form substring*

2010-05-31 Thread Sagar Agrawal
Thanks Vineet for replying, but I am not able to understand how can we use variable substitution in it. On Mon, May 31, 2010 at 4:42 PM, vd wrote: > Hi Sagar > > You can use variable substitution. > ___ > Vineet Daniel > _

Re: Can't get data after building cluster

2010-05-31 Thread Jonathan Ellis
To elaborate: If you manage to screw things up to where it thinks a node has data, but it does not (adding a node without bootstrap would do this, for instance, which is probably what you did), at most data in the token range assigned to that node will be affected. On Tue, Jun 1, 2010 at 12:45 AM

Re: Error during startup

2010-05-31 Thread Jonathan Ellis
Created https://issues.apache.org/jira/browse/CASSANDRA-1146 On Tue, Jun 1, 2010 at 12:46 AM, David Boxenhorn wrote: > 0.6.2 > > On Mon, May 31, 2010 at 9:50 PM, Jonathan Ellis wrote: >> >> What version of Cassandra was this? >> >> On Sun, May 30, 2010 at 8:49 AM, David Boxenhorn >> wrote: >> >

Re: How to insert a row with a TimeUUIDType column in C++

2010-05-31 Thread Jonathan Ellis
http://php.net/manual/en/function.pack.php 2010/5/31 刘大伟 : > How can I get 16 bytes timeUUID ? > > > string(36) "4698cc00-6d2f-11df-8c7f-9f342400a648" TException: UUIDs must be > exactly 16 bytes Error: > > > On Fri, Apr 23, 2010 at 5:59 PM, Olivier Rosello > wrote: >> >> Here is my test code : >

Re: Error during startup

2010-05-31 Thread David Boxenhorn
0.6.2 On Mon, May 31, 2010 at 9:50 PM, Jonathan Ellis wrote: > What version of Cassandra was this? > > On Sun, May 30, 2010 at 8:49 AM, David Boxenhorn > wrote: > > I deleted the system/LocationInfo files, and now everything works. > > > > Yay! (...what happened?) > > > > On Sun, May 30, 2010 a

Re: Can't get data after building cluster

2010-05-31 Thread David Boxenhorn
You say "no", but that is exactly what I just observed. Can I have some more explanation? To recap: I added a server to my cluster. It had some junk in the system/LocationInfo files from previous, unsuccessful attempts to add the server to the cluster. (They were unsuccessful because I hadn't open

Re: How to insert a row with a TimeUUIDType column in C++

2010-05-31 Thread 刘大伟
How can I get 16 bytes timeUUID ? string(36) "4698cc00-6d2f-11df-8c7f-9f342400a648" TException: UUIDs must be exactly 16 bytes Error: On Fri, Apr 23, 2010 at 5:59 PM, Olivier Rosello wrote: > Here is my test code : > > ColumnPath new_col; > new_col.__isset.column = true; /* this is required! *

Re: Inconsistency even after nodetool repair?

2010-05-31 Thread Stu Hood
The nodes only begin sending the data after the compactions have finished... https://issues.apache.org/jira/browse/CASSANDRA-579 -Original Message- From: "James Golick" Sent: Monday, May 31, 2010 3:33pm To: user@cassandra.apache.org Subject: Re: Inconsistency even after nodetool repair?

Re: Ruby and Cassandra blog post

2010-05-31 Thread Jonathan Ellis
Added to http://wiki.apache.org/cassandra/ArticlesAndPresentations. Thanks! On Mon, May 31, 2010 at 3:52 PM, Mike Subelsky wrote: > hey everyone, > > I've been using Cassandra with Ruby for about a month now and am > finding it very helpful.  I wrote up a blog post about my experiences, > with t

Re: nodetool cleanup isn't cleaning up?

2010-05-31 Thread Jonathan Ellis
well, there you are then. On Mon, May 31, 2010 at 2:34 PM, Ran Tavory wrote: > yes, replication factor = 2 > > On Mon, May 31, 2010 at 10:07 PM, Jonathan Ellis wrote: >> >> you have replication factor > 1 ? >> >> On Mon, May 31, 2010 at 7:23 AM, Ran Tavory wrote: >> > I hope I understand nodeto

Re: Continuously increasing RAM usage

2010-05-31 Thread Kyusik Chung
Hmm...heap usage slowly growing over time...the picture doesnt look like the problems we were running into, and I dont think they should be related to mmap-ing your data (since that is not counted in heap mem usage). Kyusik Chung On May 29, 2010, at 10:16 AM, James Golick wrote: > Well, it's b

Ruby and Cassandra blog post

2010-05-31 Thread Mike Subelsky
hey everyone, I've been using Cassandra with Ruby for about a month now and am finding it very helpful. I wrote up a blog post about my experiences, with the goal of adding more Ruby-specific examples to the blogosphere. Hope this is helpful! http://www.subelsky.com/2010/05/real-world-ruby-and-

Re: Inconsistency even after nodetool repair?

2010-05-31 Thread James Golick
It may not have actually finished at that point. Though, according to JMX, both compactions of each CF had completed, so I assumed it was done. On Mon, May 31, 2010 at 11:29 AM, Stu Hood wrote: > Did you watch in the logs to confirm that repair had actually finished? The > `nodetool repair` call

Re: nodetool cleanup isn't cleaning up?

2010-05-31 Thread Ran Tavory
yes, replication factor = 2 On Mon, May 31, 2010 at 10:07 PM, Jonathan Ellis wrote: > you have replication factor > 1 ? > > On Mon, May 31, 2010 at 7:23 AM, Ran Tavory wrote: > > I hope I understand nodetool cleanup correctly - it should clean up all > data > > that does not (currently) belong

Re: HintedHandoffEnabled

2010-05-31 Thread Jonathan Ellis
Ah... no, that's just its "is there anything to deliver" check. Basically a no-op if there are no data files left. On Mon, May 31, 2010 at 2:05 PM, Ran Tavory wrote: > I deleted all files in the system dir, including hints before starting the > servers. > It's not a big deal. but can it be someth

Re: Can't get data after building cluster

2010-05-31 Thread Jonathan Ellis
No. On Mon, May 31, 2010 at 10:47 AM, David Boxenhorn wrote: > So this means that I can take my entire cluster off line if I make a > mistake adding a new server??? Yikes! > > On Mon, May 31, 2010 at 6:41 PM, David Boxenhorn wrote: >> >> OK. Got it working. >> >> I had some data in the 2nd s

Re: sorting by column value

2010-05-31 Thread Jonathan Ellis
I'm afraid not. (We have to sort by name to allow fetching individual columns from large rows w/o pulling the whole row into memory.) On Mon, May 31, 2010 at 9:47 AM, Torsten Curdt wrote: > Is it possible to have columns in a super column sorted by value > rather than name? > I assume not but I

Re: nodetool cleanup isn't cleaning up?

2010-05-31 Thread Jonathan Ellis
you have replication factor > 1 ? On Mon, May 31, 2010 at 7:23 AM, Ran Tavory wrote: > I hope I understand nodetool cleanup correctly - it should clean up all data > that does not (currently) belong to this node. If so, I think it might not > be working correctly. > Look at nodes 192.168.252.124

Re: HintedHandoffEnabled

2010-05-31 Thread Ran Tavory
I deleted all files in the system dir, including hints before starting the servers. It's not a big deal. but can it be something else? On Mon, May 31, 2010 at 9:53 PM, Jonathan Ellis wrote: > disabling hinted handoff will prevent creation of new hints, but it > will continue to attempt to delive

Re: HintedHandoffEnabled

2010-05-31 Thread Jonathan Ellis
disabling hinted handoff will prevent creation of new hints, but it will continue to attempt to deliver existing ones unless you manually delete the hint files in the system/ dir. On Mon, May 31, 2010 at 6:04 AM, Ran Tavory wrote: > In 0.6.2 I disabled hinted handoff, however tpstats and cfstats

Re: Start key must sort before (or equal to) finish key in your partitioner

2010-05-31 Thread Jonathan Ellis
OPP uses lexical ordering on the keys, which isn't going to be the same as the natural order for a time-based uuid. On Mon, May 31, 2010 at 2:57 AM, Leslie Viljoen wrote: > Hello! > > I am using an OrderPreservingPartitioner and sequential UUID's as > keys. When I use get_range I frequently get a

Re: Algorithm for distributing key of Cassandra

2010-05-31 Thread Jonathan Ellis
Doesn't ring a bell. Maybe if you included the link to which you refer? On Sun, May 30, 2010 at 10:37 AM, JKnight JKnight wrote: > Dear all, > At the blog of JONATHAN ELLIS, he said that Cassandra use a hack (trick) for > distributing key for each node. But the link point to that document is not

Re: Error during startup

2010-05-31 Thread Jonathan Ellis
What version of Cassandra was this? On Sun, May 30, 2010 at 8:49 AM, David Boxenhorn wrote: > I deleted the system/LocationInfo files, and now everything works. > > Yay! (...what happened?) > > On Sun, May 30, 2010 at 4:18 PM, David Boxenhorn wrote: >> >> I'm getting an "Expected both token and

RE: Inconsistency even after nodetool repair?

2010-05-31 Thread Stu Hood
Did you watch in the logs to confirm that repair had actually finished? The `nodetool repair` call is not blocking before 0.6.3 (unreleased): see https://issues.apache.org/jira/browse/CASSANDRA-1090 -Original Message- From: "James Golick" Sent: Sunday, May 30, 2010 3:43am To: cassandra-

Re: Can't get data after building cluster

2010-05-31 Thread David Boxenhorn
So this means that I can take my entire cluster off line if I make a mistake adding a new server??? Yikes! On Mon, May 31, 2010 at 6:41 PM, David Boxenhorn wrote: > OK. Got it working. > > I had some data in the 2nd server from previous failed attempts at hooking > up to the cluster. When I

Re: Can't get data after building cluster

2010-05-31 Thread David Boxenhorn
OK. Got it working. I had some data in the 2nd server from previous failed attempts at hooking up to the cluster. When I deleted that data and tried again, it said "bootstrapping" and my 1st server started working again. On Mon, May 31, 2010 at 4:50 PM, David Boxenhorn wrote: > I am trying to g

sorting by column value

2010-05-31 Thread Torsten Curdt
Is it possible to have columns in a super column sorted by value rather than name? I assume not but I thought I ask anyway. What I would love to do is something along the lines of /user//country/DE += 1 and then get the sorted result of "/user//country" cheers -- Torsten

Can't get data after building cluster

2010-05-31 Thread David Boxenhorn
I am trying to get a cluster up and working for the first time. I got one server up and running, with lots of data on it, which I can see with the CLI. I added my 2nd server, they seem to recognize each other. Now I can't see my data with the CLI. I do a get and it returns null. The data files s

Administration Memory for Noobs. (GC for ConcurrentMarkSweep ?)

2010-05-31 Thread xavier manach
Hi. I search informations for basic tunning of memory in Cassandra. My situation : I started to test larges imports of data in Cassandra 6.1. My first import worked fine : 100 Millions row in 2 hours ~ around 1 insert row by seconds My second is slower with the same script in another colu

cluster throwing errors when new or existing node joins

2010-05-31 Thread vd
Hi I have a setup of 4 nodes, whenever I am restarting any of the nodes, even after deleting the data directories and commit log I get the following error ERROR 18:46:41,296 Fatal exception in thread Thread[COMMIT-LOG-WRITER,5,main] java.lang.RuntimeException: java.lang.NullPointerException

Re: How to drop a column family (Cassandra 6.1)

2010-05-31 Thread xavier manach
Perfect :) Thanks Ran. 2010/5/31 Ran Tavory > 1. nodetool flush > 2. stop server > 3. delete all files (data, index, filter) > 4. start server > > note that this will delete the data, not the CF definition (not like "drop > table" in sql-ish). > > system_drop_column_family will drop the CF de

Re: nodetool cleanup isn't cleaning up?

2010-05-31 Thread Maxim Kramarenko
Hello! I think (but not sure, please correct me if required), that after you change token, nodes just receive new data, but don't immediate deletes old one. It seems like "clean" will mark them as tombstone and it will be deleted when you run "compact" after GCGraceSeconds seconds. On 31.05.

Re: nodetool cleanup isn't cleaning up?

2010-05-31 Thread Ran Tavory
Do you think it's the tombstones that take up the disk space? Shouldn't the tombstones be moved along with the data? On Mon, May 31, 2010 at 3:29 PM, Maxim Kramarenko wrote: > Hello! > > You likely need wait for GCGraceSeconds seconds or modify this param. > > http://spyced.blogspot.com/2010/02/d

Re: Creating a Cassandra cluster under Windows XP

2010-05-31 Thread David Boxenhorn
Thanks to huajun qi too. On Mon, May 31, 2010 at 3:33 PM, David Boxenhorn wrote: > Thank you! That's the problem!!! > > On Mon, May 31, 2010 at 2:57 PM, Mishail wrote: > >> Are required ports (http://wiki.apache.org/cassandra/FAQ#ports) opened >> at Windows Firewall? >> >> David Boxenhorn wrote:

Re: Creating a Cassandra cluster under Windows XP

2010-05-31 Thread David Boxenhorn
Thank you! That's the problem!!! On Mon, May 31, 2010 at 2:57 PM, Mishail wrote: > Are required ports (http://wiki.apache.org/cassandra/FAQ#ports) opened > at Windows Firewall? > > David Boxenhorn wrote: > > Just to clarify things: I'm trying to get my first cluster up and > > running and it's n

Re: nodetool cleanup isn't cleaning up?

2010-05-31 Thread Maxim Kramarenko
Hello! You likely need wait for GCGraceSeconds seconds or modify this param. http://spyced.blogspot.com/2010/02/distributed-deletes-in-cassandra.html === Thus, a delete operation can't just wipe out all traces of the data being removed immediately: if we did, and a replica did not receive the

nodetool cleanup isn't cleaning up?

2010-05-31 Thread Ran Tavory
I hope I understand nodetool cleanup correctly - it should clean up all data that does not (currently) belong to this node. If so, I think it might not be working correctly. Look at nodes 192.168.252.124 and 192.168.252.99 below 192.168.252.99Up 279.35 MB 35446079887597756610768188274

Re: Creating a Cassandra cluster under Windows XP

2010-05-31 Thread Mishail
Are required ports (http://wiki.apache.org/cassandra/FAQ#ports) opened at Windows Firewall? David Boxenhorn wrote: > Just to clarify things: I'm trying to get my first cluster up and > running and it's not working. >

Re: Ruby get_range with :reversed?

2010-05-31 Thread Leslie Viljoen
On Sat, May 29, 2010 at 11:55 PM, Jonathan Ellis wrote: > Cassandra supports slicing columns within a row in reversed order, but > not iterating rows in reverse. > Thanks Jonathan

Re: searching keys of the form substring*

2010-05-31 Thread vd
Hi Sagar You can use variable substitution. ___ Vineet Daniel ___ Let your email find you On Mon, May 31, 2010 at 3:44 PM, Sagar Agrawal wrote: > Hi folks, > > I want to fetch all those records from my column family

HintedHandoffEnabled

2010-05-31 Thread Ran Tavory
In 0.6.2 I disabled hinted handoff, however tpstats and cfstats report seems odd. On all servers in the cluster I have: false tpstats reports 5 completed handoffs. $ nodetool -h cass25 -p 9004 tpstats Pool NameActive Pending Completed FILEUTILS-DELETE-POOL

searching keys of the form substring*

2010-05-31 Thread Sagar Agrawal
Hi folks, I want to fetch all those records from my column family such that the key starts with a specified string... e.g. Suppose I have a CF keyed on full names(first name + last name) of persons... now I want to fetch all those records whose first name is 'John' Right now, I am using OPP an

How can I get a right 16-bytes UUIDs TException: UUIDs must be exactly 16 bytes Error:

2010-05-31 Thread 刘大伟
When I using Thrift with PHP-api batch_insert , It Throw Exception " TException: UUIDs must be exactly 16 bytes Error:" PHP Codes: $column_data[0] = new cassandra_Column(); $column_data[0]->name = 'status_id'; $column_data[0]->value = '1'; $column_data[0]->timestamp = time(); $

Re: Creating a Cassandra cluster under Windows XP

2010-05-31 Thread huajun qi
try this: ** * 192.168.80.12* * **192.168.80.234* * *

Re: How to drop a column family (Cassandra 6.1)

2010-05-31 Thread Ran Tavory
1. nodetool flush 2. stop server 3. delete all files (data, index, filter) 4. start server note that this will delete the data, not the CF definition (not like "drop table" in sql-ish). system_drop_column_family will drop the CF definition truncate (available from 0.7) will delete the data, whic

How to drop a column family (Cassandra 6.1)

2010-05-31 Thread xavier manach
Hi In the API I see : system_drop_column_family *Requires Cassandra 0.7 * How to drop a column family with Cassandra 6.1 ? * Delete *the files MYCOLUMNFAMILY-XXX-Data.db, MYCOLUMNFAMILY-XXX-Filter.db , MYCOLUMNFAMILY-XXX-Index.db is a good ways ? Can I recreate this columnfamily after this de

Re: Creating a Cassandra cluster under Windows XP

2010-05-31 Thread David Boxenhorn
Just to clarify things: I'm trying to get my first cluster up and running and it's not working. I have Cassandra working on one machine just fine, with all my data, but when I put Cassandra on a 2nd machine, and point it to my first machine, nothing happens. There seems to be some communication be

Start key must sort before (or equal to) finish key in your partitioner

2010-05-31 Thread Leslie Viljoen
Hello! I am using an OrderPreservingPartitioner and sequential UUID's as keys. When I use get_range I frequently get an error indicating that my start key is not before or equal to my finish key, which seems impossible. The code to request slices looks like this: sometime = Time.now a = UUIDTools