Re: Node is UNREACHABLE after decommission

2020-09-17 Thread Krish Donald
's why it no > longer shows up on describecluster, but this shouldn't be necessary. You > should check that the node successfully decommissioned if it doesn't show > up on "nodetool status". > > Em qui., 17 de set. de 2020 às 14:26, Krish Donald > escreveu: > >>

Re: Node is UNREACHABLE after decommission

2020-09-17 Thread Krish Donald
We are on 3.11.5 opensource cassandra On Thu, Sep 17, 2020 at 10:25 AM Krish Donald wrote: > Hi, > > We decommissioned a node from the cluster. > On decommissioned node it said in system.log that node has been > decommissioned . > But after couple of minutes only , on rest of

Node is UNREACHABLE after decommission

2020-09-17 Thread Krish Donald
Hi, We decommissioned a node from the cluster. On decommissioned node it said in system.log that node has been decommissioned . But after couple of minutes only , on rest of the nodes the node is showing UNREACHABLE when we issue nodetool describecluster . nodetool status is not showing the node

How to know if we need to increase heap size?

2020-08-20 Thread Krish Donald
Hi, We have a cluster where if reads are increased 2-3 times suddenly then cassandra cpu goes around 100% (We have 48 cpu machines with 128GB RAM) for few nodes and cassandra becomes unresponsive . We are on 3.11.5 and using G1GC with 16GB heap size. When going through the system.logs and gc.log

Re: Hints replays very slow in one DC

2020-02-27 Thread Krish Donald
Thanks everyone for the response. How to debug more on GC issue ? Is there any GC issue which is present in 3.11.0 ? On Thu, Feb 27, 2020 at 8:46 AM Reid Pinchback wrote: > Our experience with G1GC was that 31gb wasn’t optimal (for us) because > while you have less frequent full GCs they are

Re: Hints replays very slow in one DC

2020-02-26 Thread Krish Donald
Nodes are going down due to Out of Memory and we are using 31GB heap size in DC1 , however in DC2 (Which serves the traffic) has 16GB heap . Why we had to increase heap in DC1 is because , DC1 nodes were going down due Out of Memory issue but DC2 nodes never went down . We also noticed below kind

Re: Hints replays very slow in one DC

2020-02-25 Thread Krish Donald
DC2 is our main datacenter which serves all the traffic. This cluster has Materialized views. On Tue, Feb 25, 2020 at 9:32 PM Erick Ramirez wrote: > Krish, with the limited info and assuming things like hint throttle and > delivery threads all being equal, my guess would be DC1 is your primary

Hints replays very slow in one DC

2020-02-25 Thread Krish Donald
Hi, We have 2 datacenters in our cassandra cluster. Whenever a node goes down in DC1 and hints gets collected in all other nodes then what we have noticed is that hints replay is very very slow in DC1 node but if a node goes down in DC2 and comes back, hints replay fast. We are on 3.11.0 We are

Re: What is "will be anticompacted on range" ?

2020-02-10 Thread Krish Donald
n mark the repaired data with a repairedAt timestamp > annotation on the data file / sstable. > > > On Mon, Feb 10, 2020 at 9:39 AM Krish Donald wrote: > >> Hi, >> >> I noticed few messages in system.log like below: >> INFO [CompactionExecutor:21] 2020-02-

What is "will be anticompacted on range" ?

2020-02-10 Thread Krish Donald
Hi, I noticed few messages in system.log like below: INFO [CompactionExecutor:21] 2020-02-08 17:56:16,998 CompactionManager.java:677 - [repair #fb044b01-4ab5-11ea-a736-a367dba4ed71] SSTable BigTableReader(path='xyz/mc-79976-big-Data.db') ((-8828745000913291684,8954981413747359495]) will be

Re: Cassandra Repair question

2019-10-18 Thread Krish Donald
; -pr option is to be run on all nodes in a rolling manner. > > Regards > Manish > > On 19 Oct 2019 10:03, "Krish Donald" wrote: > >> Hi Cassandra experts, >> >> >> We are on Cassandra 3.11.1. >> >> We have to run repairs for a big clu

Cassandra Repair question

2019-10-18 Thread Krish Donald
Hi Cassandra experts, We are on Cassandra 3.11.1. We have to run repairs for a big cluster. We have 2 DCs. 3 RACs in each DC. Replication factor is 3 for each datacenter . So if I run repair on all nodes of a single RAC with "pr" option then ideally it will cover all the ranges. Please

Backups in Cassandra

2019-08-07 Thread Krish Donald
Hi Folks, First question is , Do you take backup for your cassandra cluster ? If answer is yes then question follows: 1. How do you take backup ? 1.1 ) Is it only snapshot? 1.2 ) We are on AWS with very large cluster around 51 nodes with 1TB data on each node.

CDC enabled settings and performance impact

2019-07-29 Thread Krish Donald
Hi, We need to enable CDC in one of the cluster which is on DSE 5.1. We need to change below settings : cdc_enabled cdc_raw_directory cdc_total_space_in_mb cdc_free_space_check_interval_ms What is the value you keep it for below? cdc_total_space_in_mb cdc_free_space_check_interval_ms Is there

Cheat Sheet for Unix based OS, Performance troubleshooting

2019-07-26 Thread Krish Donald
Any one has Cheat Sheet for Unix based OS, Performance troubleshooting ?

Openings in BayArea/Remote for Cassandra Admin

2019-07-26 Thread Krish Donald
Hi, This community is very helpful. Looking for any pointers. Anyone knows any opening in your team for Cassandra Admin skill in BayArea / Remote? Please send me email . Thanks Krish

Re: Cassandra STIG

2019-04-02 Thread Krish Donald
Joseph Testa wrote: > There is a recently published CIS benchmark for Cassandra. > > Joe > > > On Tue, Apr 2, 2019 at 4:19 PM Krish Donald wrote: > >> Hi, >> >> Does anyone has Cassandra STIG ? >> >> Thanks >> Krish >> >

Cassandra STIG

2019-04-02 Thread Krish Donald
Hi, Does anyone has Cassandra STIG ? Thanks Krish

Re: How do u setup networking for Opening Solr Web Interface when on cloud?

2019-04-01 Thread Krish Donald
e, the world’s premiere #ApacheCassandra > conference, and I want to see you there! Use my code Singh50 for 50% off > your registration. www.datastax.com/accelerate > > > On Mon, Apr 1, 2019 at 12:19 PM Krish Donald wrote: > >> Hi, >> >> We have DSE cassandra cluster

How do u setup networking for Opening Solr Web Interface when on cloud?

2019-04-01 Thread Krish Donald
Hi, We have DSE cassandra cluster running on AWS. Now we have requirement to enable Solr and Spark on the cluster. We have cassandra on private data subnet which has connectivity to app layer. >From cassandra , we cant open direct Solr Web interface. We tried using SSH tunneling and it is working

What kind of Automation you have for Cassandra related operations on AWS ?

2018-02-08 Thread Krish Donald
Hi All, What kind of Automation you have for Cassandra related operations on AWS like restacking, restart of the cluster , changing cassandra.yaml parameters etc ? Thanks

Error while starting Cassandra for the first time

2015-02-04 Thread Krish Donald
Hi, I am getting below error: Not able to understand why ?? [csduser@master bin]$ ./cassandra -f CompilerOracle: inline org/apache/cassandra/db/AbstractNativeCell.compareTo (Lorg/apache/cassandra/db/composites/Composite;)I CompilerOracle: inline

Case Study for Learning Cassandra

2015-02-04 Thread Krish Donald
Hi, I am new to Cassandra and have setup 4 nodes Cassandra cluster using VMs. Looking for any case study which I can do to understand the Cassandra Administration and put in my resume as well. Any help is appreciated. Thanks Krish

Re: Error while starting Cassandra for the first time

2015-02-04 Thread Krish Donald
to start. You should be able to validate your yaml file with some online validator such as http://www.yamllint.com/ Regards, Mark On 4 February 2015 at 22:23, Krish Donald gotomyp...@gmail.com wrote: Hi, I am getting below error: Not able to understand why ?? [csduser@master bin]$ ./cassandra