Re: Huge number of sstables after adding server to existing cluster

2015-04-03 Thread Pranay Agarwal
I remember once that happening to me. The SStables were way beyond the limit (32 default) but the compaction were still not starting. All I did was nodetool enableautocompaction keyspace table and the compaction immediately started and count of SSTables were down to normal level. It was little

Re: Adding new node to Cassandra cluster is too slow

2015-03-20 Thread Pranay Agarwal
Thanks Rob. Anyway, Ideally for a new node to join with ~50GB data of it's share, it should be done in couple of minutes or hour tops, right? On Fri, Mar 20, 2015 at 6:07 PM, Robert Coli rc...@eventbrite.com wrote: On Fri, Mar 20, 2015 at 4:08 PM, Pranay Agarwal agarwalpran...@gmail.com wrote

Re: Cassandra cluster Too high DISK IOs

2015-03-20 Thread Pranay Agarwal
, 2015 at 10:57 PM, Pranay Agarwal agarwalpran...@gmail.com wrote: Hi All. I am using 15 nodes cassandra cluster(m3.2xlarge) with provisioned IOPS disks (4000). I can see around 12k reads/sec ops on the cassandra cluster. But I see around *~3500 read IOPS* on each of the cassandra nodes

Re: Adding new node to Cassandra cluster is too slow

2015-03-20 Thread Pranay Agarwal
Also, typically how long does it take for a node to join? I have in total 1 TB of data in 15 nodes cassandra cluster. On Fri, Mar 20, 2015 at 10:53 AM, Pranay Agarwal agarwalpran...@gmail.com wrote: Thank Rahul, you are right. Unless the node complete joins the ring, there is no data

Re: Adding new node to Cassandra cluster is too slow

2015-03-20 Thread Pranay Agarwal
PM, Pranay Agarwal agarwalpran...@gmail.com wrote: Also, the new nodes (3 of them, in *UJ state*) are showing some data size (~10g). Is there any data loss chances with stopping the cassandra on them? On Thu, Mar 19, 2015 at 6:02 PM, Pranay Agarwal agarwalpran...@gmail.com wrote: Thanks

Cassandra cluster Too high DISK IOs

2015-03-20 Thread Pranay Agarwal
Hi All. I am using 15 nodes cassandra cluster(m3.2xlarge) with provisioned IOPS disks (4000). I can see around 12k reads/sec ops on the cassandra cluster. But I see around *~3500 read IOPS* on each of the cassandra nodes. Is that normal? I am using LevelledCompaction and I can see in the

Re: Cassandra cluster Too high DISK IOs

2015-03-20 Thread Pranay Agarwal
No. as shown in the histograms, 99% of reads are using 2 or less number of tables. What's typical usually? Can anyone share from experience? On Fri, Mar 20, 2015 at 1:12 PM, Duncan Sands duncan.sa...@gmail.com wrote: On 20/03/15 19:34, Pranay Agarwal wrote: The cluster is processing something

Re: Adding new node to Cassandra cluster is too slow

2015-03-19 Thread Pranay Agarwal
, Pranay Agarwal agarwalpran...@gmail.com wrote: I have 14 nodes cassandra cluster, each node as around 50gb of data. I added 3 new nodes to the cluster and I can see the status as *UJ *for the new nodes. They have been in that for almost a day now and their data size seems to be same as well

Re: Adding new node to Cassandra cluster is too slow

2015-03-19 Thread Pranay Agarwal
Also, the new nodes (3 of them, in *UJ state*) are showing some data size (~10g). Is there any data loss chances with stopping the cassandra on them? On Thu, Mar 19, 2015 at 6:02 PM, Pranay Agarwal agarwalpran...@gmail.com wrote: Thanks Rob, You are right. I am using ReleaseVersion: 2.1.0

Cassandra Bulk loader, serious issue

2015-03-09 Thread Pranay Agarwal
Hi All, I used sstableloader to export data from first cassandra cluster (RF 3) to another cluster with RF 1. Afther all the tables were copied and second cluster was working fine I decided to run node repair on the second cluster as regular operation. *This repair cause the data size on the

Re: Changing replication factor of Cassandra cluster

2015-01-06 Thread Pranay Agarwal
having to backup the token ring range but just the data backup? -Pranay On Mon, Dec 29, 2014 at 1:58 PM, Robert Coli rc...@eventbrite.com wrote: On Mon, Dec 29, 2014 at 1:40 PM, Pranay Agarwal agarwalpran...@gmail.com wrote: I want to understand what is the best way to increase/change

Re: Changing replication factor of Cassandra cluster

2014-12-29 Thread Pranay Agarwal
. Restoring from backup to a new cluster (including how to handle token ranges) is discussed in detail here http://www.datastax.com/documentation/cassandra/2.0/cassandra/operations/ops_snapshot_restore_new_cluster.html On Mon, Dec 15, 2014 at 4:14 PM, Pranay Agarwal agarwalpran...@gmail.com

Changing replication factor of Cassandra cluster

2014-12-15 Thread Pranay Agarwal
Hi All, I have 20 nodes cassandra cluster with 500gb of data and replication factor of 1. I increased the replication factor to 3 and ran nodetool repair on each node one by one as the docs says. But it takes hours for 1 node to finish repair. Is that normal or am I doing something wrong? Also,