RE: Problems after trying a migration

Hi Jan, Thank you for your help, we’ll see during next week. Have a nice day. Best regards, [cid:image001.png@01D062FA.DDD7FC50] David CHARBONNIER Sysadmin T : +33 411 934 200 david.charbonn...@rgsystem.com ZAC Aéroport 125 Impasse Adam Smith 34470

Re: Adding new node to Cassandra cluster is too slow

You won't lose data unless you have run nodetool cleanup on the existing nodes. Rahul > On Mar 19, 2015, at 9:16 PM, Pranay Agarwal wrote: > > Also, the new nodes (3 of them, in UJ state) are showing some data size > (~10g). Is there any data loss chances with stopping the cassandra on them?

Store data with cassandra

Hello All; Please, i have created this table. lastname | age | city | email | firstname --+-+---+-+--- Doe | 36 | Beverly Hills | jane...@email.com | Jane Byrne | 24 | San Diego | robby...@email.com |

Re: Store data with cassandra

I have used this tutoriel to create my data base http://planetcassandra.org/insert-select-records/ /var/lib/cassandra/data# ls demo system system_traces :/var/lib/cassandra/data# cd demo/ :/var/lib/cassandra/data/demo# ls users :/var/lib/cassandra/data/demo# cd users/ :/var/lib/cassandra/data/de

Re: Store data with cassandra

You seem to be missing the point here. Cassandra does not manage files, it manages data in a highly distributed cluster. If you are attempting to manage files, you are quite simply using the wrong tool and Cassandra is not for you. On Fri, Mar 20, 2015 at 9:10 AM, jean paul wrote: > I have use

Re: Store data with cassandra

What about this so http://www.datastax.com/wp-content/uploads/2012/02/Screen-Shot-2012-02-10-at-11.21.55-AM.png i read also some documents about storing blob with cassandra !! 2015-03-20 15:04 GMT+01:00 Michael Dykman : > You seem to be missing the point here. > > Cassandra does not manage file

Re: Store data with cassandra

The files you store have to personally be vetted by the cassandra community. Only if they're found to not contain anything inappropriate, does cassandra let you store them. (A 3/4 majority vote is necessary). Please send your files for approval to j...@reallycereal.com On Fri, Mar 20, 2015 at 8:4

Re: Store data with cassandra

i'd like to store MyFile.txt using cassandra (replicat = 2) and see on what node the file and its replicas are stored on my cluster of 10 nodes it is a simple file with simple content (text) is that possible ? 2015-03-20 16:44 GMT+01:00 Ali Akhtar : > The files you store have to personally be

Re: Store data with cassandra

It has been decided that the file cannot be allowed to be stored, sorry. However, if a sacrifice to the gods is prepared, it may be possible to change things. On Fri, Mar 20, 2015 at 8:49 PM, jean paul wrote: > i'd like to store MyFile.txt using cassandra (replicat = 2) and see on > what node th

Re: Store data with cassandra

( I apologize, I'm only joking. To answer your question, Cassandra tends to cache the first 300MB or so of data in memory, only when it grows beyond that does it start to write it to files. But, Cassandra is not the write choice for storing files. In the screenshot you linked, its only storing the

Re: Store data with cassandra

Please, can you explain details in this two links: https://wiki.apache.org/cassandra/FAQ#large_file_and_blob_storage 2015-03-20 16:58 GMT+01:00 Ali Akhtar : > ( I apologize, I'm only joking. To answer your question, Cassandra tends > to cache the first 300MB or so of data in memory, only when i

Re: Store data with cassandra

> > Please, can you explain details in this two links: > > https://wiki.apache.org/cassandra/FAQ#large_file_and_blob_storage > http://stackoverflow.com/questions/9219222/how-to-store-small-files-in-cassandra

Re: Store data with cassandra

Sounds like this is a job for jackrabbit ? http://jackrabbit.apache.org From: Ali Akhtar mailto:ali.rac...@gmail.com>> Reply-To: "user@cassandra.apache.org" mailto:user@cassandra.apache.org>> Date: Friday, 20 March 2015 15:58 To: "user@cassandra.apache.org

Re: Store data with cassandra

> > Please, can you explain details in this two links: > > https://wiki.apache.org/cassandra/FAQ#large_file_and_blob_storage > http://stackoverflow.com/questions/9219222/how-to-store-small-files-in-cassandra 2015-03-20 17:07 GMT+01:00 Sibbald, Charles : > Sounds like this is a job for jackrabbi

Re: Deleted snapshot files filling up /var/lib/cassandra

Sorry for the late reply. To immediately solve the problem you can restart Cassandra and all the open file descriptors to the deleted snapshots should disappear. As for why it happened I would first address the disk space issue and see if the snapshot errors + open file descriptors issue still oc

Re: Logging client ID for YCSB workloads on Cassandra?

HI Jatin;  besides enabling Tracing,   is there any other way to get the task done  ?  (to log the client ID for every operation)Please share with the community the solution, so that we could collectively learn from your experience.  cheersJan/ On Friday, February 20, 2015 12:48 PM, Jatin

Re: Store data with cassandra

Jean, I'm not sure you will receive any reply unless you ask specific questions about those links. Cheers, Jens – Skickat från Mailbox On Fri, Mar 20, 2015 at 5:08 PM, Sibbald, Charles wrote: > Sounds like this is a job for jackrabbit ? > http://jackrabbit.apache.org > From: Ali Akhtar mai

Re: Adding new node to Cassandra cluster is too slow

Thank Rahul, you are right. Unless the node complete joins the ring, there is no data dependency on them. On Fri, Mar 20, 2015 at 4:46 AM, Rahul Neelakantan wrote: > You won't lose data unless you have run nodetool cleanup on the existing > nodes. > > Rahul > > On Mar 19, 2015, at 9:16 PM, Pran

Cassandra cluster Too high DISK IOs

Hi All. I am using 15 nodes cassandra cluster(m3.2xlarge) with provisioned IOPS disks (4000). I can see around 12k reads/sec ops on the cassandra cluster. But I see around *~3500 read IOPS* on each of the cassandra nodes. Is that normal? I am using LevelledCompaction and I can see in the histog

Re: Cassandra cluster Too high DISK IOs

That probably depends on how many read / write queries your cluster is processing? Also, since you mentioned provisoned IOPS, are you using EBS for storing the data? If so, you probably want to switch to the ephemeral storage since its locally attached to the instance and doesn't require a network

Re: Cassandra cluster Too high DISK IOs

The cluster is processing something like 12k reads and 2k writes/seconds. The disks are locally attached and latency is just fine. It's the number of disk iops that's too high. On Fri, Mar 20, 2015 at 11:05 AM, Ali Akhtar wrote: > That probably depends on how many read / write queries your clust

Re: Adding new node to Cassandra cluster is too slow

Also, typically how long does it take for a node to join? I have in total 1 TB of data in 15 nodes cassandra cluster. On Fri, Mar 20, 2015 at 10:53 AM, Pranay Agarwal wrote: > Thank Rahul, you are right. Unless the node complete joins the ring, there > is no data dependency on them. > > > On Fri

Re: Cassandra cluster Too high DISK IOs

On 20/03/15 19:34, Pranay Agarwal wrote: The cluster is processing something like 12k reads and 2k writes/seconds. The disks are locally attached and latency is just fine. It's the number of disk iops that's too high. Maybe each read is accessing many sstables. Ciao, Duncan.

Re: Cassandra cluster Too high DISK IOs

No. as shown in the histograms, 99% of reads are using 2 or less number of tables. What's typical usually? Can anyone share from experience? On Fri, Mar 20, 2015 at 1:12 PM, Duncan Sands wrote: > On 20/03/15 19:34, Pranay Agarwal wrote: > >> The cluster is processing something like 12k reads and

Re: Adding new node to Cassandra cluster is too slow

On Thu, Mar 19, 2015 at 6:02 PM, Pranay Agarwal wrote: > What do you mean by point 3? Also, by doing one at a time, does it mean > wait till nodetool status of the new node is UN from UJ? > point 3 is "look at nodetool status/nodetool ring/nodetool info/etc. on other cluster nodes and make sure

Re: Store data with cassandra

On Fri, Mar 20, 2015 at 5:06 AM, jean paul wrote: Btw, Jean Paul... are you sure you don't want this? https://github.com/mogilefs/ As a general statement, storing files in Cassandra seems like a bad idea to me. =Rob

Re: Adding new node to Cassandra cluster is too slow

Thanks a lot Rob. I guess now, I have decide it's better to upgrade to 2.1.6+ or downgrade to stable release and safe way to do that. On Fri, Mar 20, 2015 at 3:35 PM, Robert Coli wrote: > On Thu, Mar 19, 2015 at 6:02 PM, Pranay Agarwal > wrote: > >> What do you mean by point 3? Also, by doing

Re: Adding new node to Cassandra cluster is too slow

On Fri, Mar 20, 2015 at 3:57 PM, Pranay Agarwal wrote: > I guess now, I have decide it's better to upgrade to 2.1.6+ or downgrade > to stable release and safe way to do that. > You can't downgrade across major versions, you'd have to read out everything from the "new" cluster and write it to a d

Re: Adding new node to Cassandra cluster is too slow

Thanks, will do that. Also, the very fact the new nodes get some data (~10gb) and then get stuck, the configurations and process I am using must be correct, and there is no immediate fix besides upgrade the version? On Fri, Mar 20, 2015 at 4:02 PM, Robert Coli wrote: > On Fri, Mar 20, 2015 at 3

Re: Deleted snapshot files filling up /var/lib/cassandra

Sorry if I was unclear. The /var/lib/cassandra partition didn't literally become 100% full. Our low-disk-space alarms started going off, and that's when we noticed that the disk usage on several nodes was steadily increasing much faster than expected. We restarted the worst-affected node before it

Re: Adding new node to Cassandra cluster is too slow

On Fri, Mar 20, 2015 at 4:08 PM, Pranay Agarwal wrote: > Also, the very fact the new nodes get some data (~10gb) and then get > stuck, the configurations and process I am using must be correct, and there > is no immediate fix besides upgrade the version? > That is correct, it sounds like a corre

Re: Adding new node to Cassandra cluster is too slow

Thanks Rob. Anyway, Ideally for a new node to join with ~50GB data of it's share, it should be done in couple of minutes or hour tops, right? On Fri, Mar 20, 2015 at 6:07 PM, Robert Coli wrote: > On Fri, Mar 20, 2015 at 4:08 PM, Pranay Agarwal > wrote: > >> Also, the very fact the new nodes ge