Data management on a ring

2010-11-09 Thread Jean-Yves LEBLEU
Hello all, We have an installation of 10 nodes, and we choose to deploy 5 rings of 2 nodes. We would like to change to a ring of 10 nodes. Some data have to be replicated on the 10 nodes, some should stay on 2 nodes. Do you have any idea or documentation pointer in order to have a ring of 10 nod

Austin, LA, London Cassandra trainings

2010-11-09 Thread Jonathan Ellis
Riptano's next full-day Cassandra training events are - Austin, Nov 12 (this Friday!): http://www.eventbrite.com/event/1002593785 - Santa Monica, Dec 8: http://www.eventbrite.com/event/1002369113 - London, Dec 9: eventbrite page coming soon -- subscribe to be notified at http://www.eventbrite.c

Re: Backup Strategy

2010-11-09 Thread Wayne
Thanks for the details. I think we were slowly starting to realize a similar pattern, but you definitely helped fill in the gaps: home brew rsync with lzop in the middle. We have raid1 system/commit log drives we are copying to once a day, and off cluster...maybe once a week. Thanks On Tue, Nov

Re: Multiple inserts cause consistency failures

2010-11-09 Thread Aaron Morton
time.time() returns the number of seconds since epoch, with fractions. The definition of the timestamp param for insert is 64 bit int. So my guess is thrift is passing your timestamp to int() and so you are always sending the same timestamp as the code runs 3 times in the same second. You are seein

Multiple inserts cause consistency failures

2010-11-09 Thread Rajat Chopra
Requesting the forum's kind attention to consistency failures that I notice. Cassandra version - 0.6.4 Thrift version - 0.4.0 Driving Language - Python Machine - 4 core, 8G, Fedora 13, i686 storage_conf.xml - default I took the example from -> http://wiki.apache.org/cassandra/ThriftExamples#Pytho

Re: Bulk insertion in Cassandra 0.7 beta3

2010-11-09 Thread Aaron Morton
The node(s) you are connecting to have disappeared, look at the server side logs for errors. It's probably running out of memory, if so turn off things like the key cache and key_cache_save_period until you have a stable system, then gradually turn them back on. You may also want to have a read of

Bulk insertion in Cassandra 0.7 beta3

2010-11-09 Thread Tomas Zulberti
We are making some tests using 3 nodes: A, B, C. We are bulk inserting 87500 keys, and for each of them 1 super column with 768 columns. We are using hector 0.7.0-18 to insert the data, and at some point an exception is raised, and sometimes cassandra deamon stop running in one of the nodes. The no

RE: Cassandra - python communication problem

2010-11-09 Thread Dr. Andrew Perella
Thanks - I will look into this. The reason for trying to get the python_cassandra package working is that I have a working site talking to a windows hosted version of Cassandra. I now want to move this to linux but cannot get the corresponding linux version (Unfortunately the windows machine wa

RE: Cassandra - python communication problem

2010-11-09 Thread Dr. Andrew Perella
Indeed, that has certainly troubled me! The python package index just links back to the main apache cassandra page and I can see no later version. My google-fu skills seem to be weak in tracking down any source repository of this. Are you saying that no later version exists and I will have to cr

Re: Cassandra - python communication problem

2010-11-09 Thread Tyler Hobbs
I would recommend using pycassa 0.5.2 for working with 0.7.0-beta3 in python. It's much nicer than raw Thrift, too :) - Tyler On Tue, Nov 9, 2010 at 12:19 PM, Jonathan Ellis wrote: > python_cassandra-0.6.1 sure doesn't look like a package I'd expect to > work

Re: Cassandra - python communication problem

2010-11-09 Thread Jonathan Ellis
python_cassandra-0.6.1 sure doesn't look like a package I'd expect to work with 0.7. On Tue, Nov 9, 2010 at 12:07 PM, Dr. Andrew Perella wrote: > Thanks Jonathan, > So it looks like the python bindings are using a deprecated non framed > protocol. Leaving that problem aside for a moment I change

RE: Cassandra - python communication problem

2010-11-09 Thread Dr. Andrew Perella
Thanks Jonathan, So it looks like the python bindings are using a deprecated non framed protocol. Leaving that problem aside for a moment I changed the server to work in non framed mode and now get a different error: v...@vs001:~/apache-cassandra-0.7.0-beta3/interface/gen-py/cassandra$ Cassan

Re: Cassandra - python communication problem

2010-11-09 Thread Jonathan Ellis
You're using an unframed transport to talk to a framed server, or vice versa. On Tue, Nov 9, 2010 at 11:47 AM, Dr. Andrew Perella wrote: > Hi, > > > > I have been trying to connect to Cassandra 0.7.0-beta3 via python to no > avail: > > > > v...@vs001:~/apache-cassandra-0.7.0-beta3/interface/gen-p

Cassandra - python communication problem

2010-11-09 Thread Dr. Andrew Perella
Hi, I have been trying to connect to Cassandra 0.7.0-beta3 via python to no avail: v...@vs001:~/apache-cassandra-0.7.0-beta3/interface/gen-py/cassandra$ Cassandra-remote -h localhost:9160 describe_keyspace system Traceback (most recent call last): File "/usr/local/bin/Cassandra-remote", line

Re: Could Not connect to cassandra-cli on windows

2010-11-09 Thread Alaa Zubaidi
Thanks Jim, It works when using it as arguments to cassandra-cli and using -port... is this a bug?? E:\Cassandra\Cass07b3\apache-cassandra-0.7.0-beta3>bin\cassandra-cli.bat -host 192.168.1.11 -port 9160 Starting Cassandra Client Connected to: "Test Cluster" on 192.168.1.11/9160 Welcome to ca

Re: Backup Strategy

2010-11-09 Thread Edward Capriolo
On Tue, Nov 9, 2010 at 8:15 AM, Wayne wrote: > I got some very good advice on manual compaction so I thought I would throw > out another question on raid/backup strategies for production clusters. > > We are debating going with raid 0 vs. raid 10 on our nodes for data storage. > Currently all stor

Re: Could Not connect to cassandra-cli on windows

2010-11-09 Thread Jim Ancona
On Mon, Nov 8, 2010 at 8:31 PM, Alaa Zubaidi wrote: > Hi, > Failing to connect to cassandra client: on windows > > [defa...@unknown] connect localhost/9160 > Exception connecting to localhost/9160. Reason: Connection refused: connect. > > [defa...@unknown] connect xxx.xxx.x.xx/9160 > Syntax error

Backup Strategy

2010-11-09 Thread Wayne
I got some very good advice on manual compaction so I thought I would throw out another question on raid/backup strategies for production clusters. We are debating going with raid 0 vs. raid 10 on our nodes for data storage. Currently all storage we use is raid 10 as drives always fail and raid 10

Re: cassandra.thrift error

2010-11-09 Thread Abdul Fattah Mahran
Thanks a lot Jonathan On Mon, Nov 8, 2010 at 5:02 PM, Jonathan Ellis wrote: > Cassandra IDL is correct, for the version of Thrift it is intended to > be built with. Thrift broke this in a later version. > > On Mon, Nov 8, 2010 at 6:27 AM, Abdul Fattah Mahran > wrote: > > Dear all, > >I