Re: Using Cassandra for storing large objects

2011-01-27 Thread Narendra Sharma
Thanks Anand. Let's keep exchanging our experiences. -Naren On Thu, Jan 27, 2011 at 8:50 PM, Anand Somani wrote: > At this point we are not in production, in the lab only. The longest test > so far has been about 2-3 days, the datasize at this point is about 2-3 TB > per node, we have 2 nodes.

Re: Using Cassandra for storing large objects

2011-01-27 Thread Anand Somani
At this point we are not in production, in the lab only. The longest test so far has been about 2-3 days, the datasize at this point is about 2-3 TB per node, we have 2 nodes. We do see spikes to high response times (and timeouts), which seemed to be around the time GC kicks in. We were pushing the

Re: Using Cassandra for storing large objects

2011-01-27 Thread Narendra Sharma
Thanks Anand. Few questions: - What is the size of nodes (in terms for data)? - How long have you been running? - Howz compaction treating you? Thanks, Naren On Thu, Jan 27, 2011 at 12:13 PM, Anand Somani wrote: > Using it for storing large immutable objects, like Aaron was suggesting we > are

Re: Using Cassandra for storing large objects

2011-01-27 Thread buddhasystem
.n2.nabble.com/Using-Cassandra-for-storing-large-objects-tp5965418p5967730.html Sent from the cassandra-u...@incubator.apache.org mailing list archive at Nabble.com.

Re: Using Cassandra for storing large objects

2011-01-27 Thread Anand Somani
Using it for storing large immutable objects, like Aaron was suggesting we are splitting the blob across multiple columns. Also we are reading it a few columns at a time (for memory considerations). Currently we have only gone upto about 300-400KB size objects. We do have machines with 32Gb memory

Re: Using Cassandra for storing large objects

2011-01-27 Thread buddhasystem
Will it work for a billion rows? Because that's where eventually I'll end up being. -- View this message in context: http://cassandra-user-incubator-apache-org.3065146.n2.nabble.com/Using-Cassandra-for-storing-large-objects-tp5965418p5966284.html Sent from the c

Re: Using Cassandra for storing large objects

2011-01-27 Thread aaron morton
Millions of rows/items is no problem, megabytes per item is doable. Generally people have talked about chunking blobs and storing them across multiple columns. See http://wiki.apache.org/cassandra/LargeDataSetConsiderations http://wiki.apache.org/cassandra/CassandraLimitations Hope that helps

Using Cassandra for storing large objects

2011-01-26 Thread Narendra Sharma
Anyone using Cassandra for storing large number (millions) of large (mostly immutable) objects (200KB-5MB size each)? I would like to understand the experience in general considering that Cassandra is not considered a good fit for large objects. https://issues.apache.org/jira/browse/CASSANDRA-265