Apache Cassandra start up script

[Anumod Mullachery]

Hi All ,

I’ve installed Apache Cassandra( Tarball install )..
But there is no way to see the Cassandra status / stop option .


Anyone has the Apache Cassandra start / stop script for Cassandra 3.12

Can some one help on this ?


Thanks,

Anumod
Mob-718-844-3841
PA,USA

Sent from my iPhone
-
To unsubscribe, e-mail: user-unsubscr...@cassandra.apache.org
For additional commands, e-mail: user-h...@cassandra.apache.org

Re: Snapshot - files- 2.1 vs 3.x

[Anumod Mullachery]

Thanks Jeff for the information.
regards,
-Anumod



On Mon, Dec 11, 2017 at 1:53 PM, Jeff Jirsa <jji...@gmail.com> wrote:

> Agree that it's annoying. Came from https://issues.apache.
> org/jira/browse/CASSANDRA-6962 - in part to make windows compatibility
> easier (windows has path size limits, and it was pretty easy to hit those
> limits with any meaningful ks/table name combination).
>
>
>
> On Mon, Dec 11, 2017 at 10:05 AM, Anumod Mullachery <
> anumodmullache...@gmail.com> wrote:
>
>>
>> Hi ,
>>
>> In 2.1 , the snapshots are created with keyspace-table.db , (eg-
>> janusgraph-txlog-ka-1-Filter.db)
>>
>> but in 3.1   its seems like - mc-3-big-Data.db.
>>
>> Is there any reason for the change, and is there any alternative method
>> to change 3.1 snapshot files with keyspace-table name format.
>>
>> Our restore scripts are failing due to the naming convention change in
>> 2.1 vs 3.x.
>>
>> If some one can put some light in this case, will be greatly appreciated.
>>
>>
>> Thanks,
>>
>> Anumod.
>>
>>
>

Snapshot - files- 2.1 vs 3.x

[Anumod Mullachery]

Hi ,

In 2.1 , the snapshots are created with keyspace-table.db , (eg-
janusgraph-txlog-ka-1-Filter.db)

but in 3.1   its seems like - mc-3-big-Data.db.

Is there any reason for the change, and is there any alternative method to
change 3.1 snapshot files with keyspace-table name format.

Our restore scripts are failing due to the naming convention change in 2.1
vs 3.x.

If some one can put some light in this case, will be greatly appreciated.


Thanks,

Anumod.

Re: Cassandra 3.10 - Hints & Dropped messages logs Vs Cass 2.x version

[Anumod Mullachery]

Okay ..

Thanks,will check ..

Anumod
PA,USA

Sent from my iPhone

> On Nov 2, 2017, at 5:40 PM, kurt greaves <k...@instaclustr.com> wrote:
> 
> Well, pretty sure they still are. at least the mutation one is. but you 
> should really use the dedicated metrics for this.
> 
>> On 3 Nov. 2017 01:38, "Anumod Mullachery" <anumodmullache...@gmail.com> 
>> wrote:
>> thanks ..
>> 
>> so the dropped hints & messages are not captured in cassandra logs, post 3.x 
>> vs 2.x.
>> 
>> -Anumod
>> 
>> 
>> 
>>> On Wed, Nov 1, 2017 at 4:50 PM, kurt greaves <k...@instaclustr.com> wrote:
>>> You can get dropped message statistics over JMX. for example nodetool 
>>> tpstats has a counter for dropped hints from startup. that would be the 
>>> preferred method for tracking this info, rather than parsing logs
>>> 
>>> On 2 Nov. 2017 6:24 am, "Anumod Mullachery" <anumodmullache...@gmail.com> 
>>> wrote:
>>> 
>>> Hi All,
>>> 
>>> In cassandra  v 2.1.15 , I'm able to pull the hints drop and dropped 
>>> messages from cassandra.log as below-
>>> 
>>> 
>>> dropped hints-->
>>> 
>>> "/opt/xcal/apps/cassandra/logs/cassandra.log--> 
>>> HintedHandoffMetrics.java:79 - /96.115.91.69 has 5 dropped hints, because 
>>> node is down past configured hint window."
>>> 
>>> Dropped messages -->
>>> 
>>> "/opt/xcal/apps/cassandra/logs/cassandra.log--> NFO 
>>> MessagingService 1 MUTATION messages dropped in last 5000ms"
>>> 
>>> 
>>> But in Cassandra V 3.10 , I'm not able to get the cassandra logs as v 
>>> 2.1.15.
>>> 
>>> I'm not able to get any info from the cassandra logs for dropped hints & 
>>> dropped messages. ( I was testing this on Test cluster by stopping the 
>>> cassandra services on one of the node , where the hints window is set to 05 
>>> Mins and kept the node down for 1 hour , and monitoring the cassandra logs, 
>>> but nothing generated on dropped hints on any other nodes in the cluster ).
>>> 
>>> The only message I found is on the down node is that - "Paused hints 
>>> dispatch".
>>> 
>>> Can some one put some light on this issue on 3.10 , is there any changes in 
>>> the hints & dropped messages , logs or the process.
>>> 
>>> thanks in advance,
>>> 
>>> regards,
>>> 
>>> Anumod.
>>> 
>>> 
>> 

Re: Cassandra 3.10 - Hints & Dropped messages logs Vs Cass 2.x version

[Anumod Mullachery]

thanks ..

so the dropped hints & messages are not captured in cassandra logs, post
3.x vs 2.x.

-Anumod



On Wed, Nov 1, 2017 at 4:50 PM, kurt greaves <k...@instaclustr.com> wrote:

> You can get dropped message statistics over JMX. for example nodetool
> tpstats has a counter for dropped hints from startup. that would be the
> preferred method for tracking this info, rather than parsing logs
>
> On 2 Nov. 2017 6:24 am, "Anumod Mullachery" <anumodmullache...@gmail.com>
> wrote:
>
>
> Hi All,
>
> In cassandra  v 2.1.15 , I'm able to pull the hints drop and dropped
> messages from cassandra.log as below-
>
>
> dropped hints-->
>
> "/opt/xcal/apps/cassandra/logs/cassandra.log
> <https://splunk.ccp.cable.comcast.com/en-US/app/search/search?q=search%20ring%3A%3A*%20%20%20NOT%20ring%3A%3AXHOMEcls_Prod0%20%20%20NOT%20ring%3A%3AXBO_prod0%20source%3D%22*cassandra.log*%22%20%22dropped%20hints%22%20%20ring%3DCI_ParentalControlCQL%20%7C%20rex%20%22HintedHandoffMetrics%20%5C%2F(%3F%3Cdestination%3E.*)%5Cshas%20(%3F%3Cdropped%3E%5Cd%2B)%22%20%7C%20bucket%20span%3D15m%20_time%20=smart_ratio=1=-4h=now=events=events=1509561773.447850_874E67FA-980C-410D-A52B-FE91D5E0AAAE#>
> --> HintedHandoffMetrics.java:79 - /96.115.91.69 has 5 dropped hints,
> because node is down past configured hint window."
>
> Dropped messages -->
>
> "/opt/xcal/apps/cassandra/logs/cassandra.log
> <https://splunk.ccp.cable.comcast.com/en-US/app/search/search?q=search%20ring%3A%3A*%20ring!%3D*xbo*%20(sourcetype%3Dcassandra%20OR%20sourcetype%3Ddse)%20%22messages%20dropped%22%20=smart_ratio=1=-4h=now=events=events=1509562391.448085_874E67FA-980C-410D-A52B-FE91D5E0AAAE#>
> --> NFO MessagingService 1 MUTATION messages dropped in last 5000ms"
>
>
> But in Cassandra *V 3.10* , I'm not able to get the cassandra logs as v
> 2.1.15.
>
> I'm not able to get any info from the cassandra logs for dropped hints &
> dropped messages. ( I was testing this on Test cluster by stopping the
> cassandra services on one of the node , where the hints window is set to 05
> Mins and kept the node down for 1 hour , and monitoring the cassandra logs,
> but nothing generated on dropped hints on any other nodes in the cluster ).
>
> The only message I found is on the down node is that - "Paused hints
> dispatch".
>
> Can some one put some light on this issue on 3.10 , is there any changes
> in the hints & dropped messages , logs or the process.
>
> thanks in advance,
>
> regards,
>
> Anumod.
>
>
>

Cassandra 3.10 - Hints & Dropped messages logs Vs Cass 2.x version

[Anumod Mullachery]

Hi All,

In cassandra  v 2.1.15 , I'm able to pull the hints drop and dropped
messages from cassandra.log as below-


dropped hints-->

"/opt/xcal/apps/cassandra/logs/cassandra.log

--> HintedHandoffMetrics.java:79 - /96.115.91.69 has 5 dropped hints,
because node is down past configured hint window."

Dropped messages -->

"/opt/xcal/apps/cassandra/logs/cassandra.log

--> NFO MessagingService 1 MUTATION messages dropped in last 5000ms"


But in Cassandra *V 3.10* , I'm not able to get the cassandra logs as v
2.1.15.

I'm not able to get any info from the cassandra logs for dropped hints &
dropped messages. ( I was testing this on Test cluster by stopping the
cassandra services on one of the node , where the hints window is set to 05
Mins and kept the node down for 1 hour , and monitoring the cassandra logs,
but nothing generated on dropped hints on any other nodes in the cluster ).

The only message I found is on the down node is that - "Paused hints
dispatch".

Can some one put some light on this issue on 3.10 , is there any changes in
the hints & dropped messages , logs or the process.

thanks in advance,

regards,

Anumod.

Re: Cassandra 3.10 Bootstrap- Error

[Anumod Mullachery]

Hi All,

thanks for all your inputs, appreciate it.

the issue resolved , nodes are able to join.

Pls find the solution I applied,


: Enable 256 bit encryption

  a : Copy the jce_policy-8.zip from  ..  to all nodes.

  b : Unzip jce_policy-8.zip,

  c : Copy local_policy.jar  and US_export_policy.jar from
UnlimitedJCEPolicyJDK8/ to /usr/java/jdk1.8.0_102/jre/lib/security/.

(or the latest java version directory being used )

& make sure the cassandra-topology.properties file details ; are in sync
with joining nodes.

restart the nodes.


regards

Anumod.



On Tue, Oct 24, 2017 at 9:12 AM, Dipan Shah <dipan@hotmail.com> wrote:

> Hi Anumod,
>
>
> I faced the same issue with 3.11 and I'll suggest you first go through
> this link to check if the new node is able to communicate back on forth on
> the required port with the seed node.
>
>
> https://support.datastax.com/hc/en-us/articles/209691483-
> Bootstap-fails-with-Unable-to-gossip-with-any-seeds-yet-new-
> node-can-connect-to-seed-nodes
>
> <https://support.datastax.com/hc/en-us/articles/209691483-Bootstap-fails-with-Unable-to-gossip-with-any-seeds-yet-new-node-can-connect-to-seed-nodes>
> Bootstap fails with "Unable to gossip with any seeds" yet ...
> <https://support.datastax.com/hc/en-us/articles/209691483-Bootstap-fails-with-Unable-to-gossip-with-any-seeds-yet-new-node-can-connect-to-seed-nodes>
> support.datastax.com
> DataStax Support; DataStax Enterprise; Install/Upgrade; Bootstap fails
> with "Unable to gossip with any seeds" yet new node can connect to seed
> nodes
>
> This will mostly be the issue but even if that is not solving your
> problem, check the following points:
>
>
> 1) Check free disk space on the seed nodes. There should be sufficient
> free space for data migration to the new node.
>
> 2) Check logs of the seed nodes and see if there are any errors. I found
> some gossip file corruption on one of the seed nodes.
>
> 3) Finally, restart server\cassandra services on the seed nodes and see if
> that helps.
>
>
> Do let me know if this solved your problem.
>
>
>
> Thanks,
>
> Dipan Shah
>
>
> --
> *From:* Anumod Mullachery <anumodmullache...@gmail.com>
> *Sent:* Tuesday, October 24, 2017 2:12 AM
> *To:* user@cassandra.apache.org
> *Subject:* Cassandra 3.10 Bootstrap- Error
>
> Hi,
>
> We are using cassandra *3.10* , with *Network topology strategy* , &* 2
> DC* having *only 1 node each*.
>
> We are trying to add New nodes (auto_bootstrap: true) in yaml ,  but
> getting the below error-
>
> In the Seed nodes list, we have provided both the existing nodes from both
> DC(total -2 nodes). & tried with different option, by keeping only 1 node,
> but no hope.
>
>
> 2017-10-23 20:06:31,739 [MessagingService-Outgoing-/96.115.209.92-Gossip]
> WARN   SSLFactory.java:221 - Filtering out [TLS_RSA_WITH_AES_256_CBC_SHA]
> as it isn't supported by the socket
> 2017-10-23 20:06:31,739 [MessagingService-Outgoing-/96.115.209.92-Gossip]
> ERROR  OutboundTcpConnection.java:487 - SSL handshake error for outbound
> connection to 15454e08[SSL_NULL_WITH_NULL_NULL: Socket[addr=/96.115.209.92
> ,port=10145,localport=60859]]
> javax.net.ssl.SSLHandshakeException: No appropriate protocol (protocol is
> disabled or cipher suites are inappropriate)
>
>
> *2017-10-23 20:06:32,655 [main] ERROR  CassandraDaemon.java:752 -
> Exception encountered during startup java.lang.RuntimeException: Unable to
> gossip with any seeds*
>
> 2017-10-23 20:06:32,666 [StorageServiceShutdownHook] INFO
> HintsService.java:221 - Paused hints dispatch
> 2017-10-23 20:06:32,667 [StorageServiceShutdownHook] WARN
> Gossiper.java:1514 - No local state, state is in silent shutdown, or node
> hasn't joined, not announcing shutdown
> 2017-10-23 20:06:32,667 [StorageServiceShutdownHook] INFO
> MessagingService.java:964 - Waiting for messaging service to quiesce
> 2017-10-23 20:06:32,667 [ACCEPT-/96.115.208.150] INFO
> MessagingService.java:1314 - MessagingService has terminated the accept()
> thread
> 2017-10-23 20:06:33,134 [StorageServiceShutdownHook] INFO
> HintsService.java:221 - Paused hints dispatch
>
> Can some one able to put some light on this issue, will be a great help.
>
> thanks in advance,
>
> - regards
>
> Anumod.
>

Cassandra 3.10 Bootstrap- Error

[Anumod Mullachery]

Hi,

We are using cassandra *3.10* , with *Network topology strategy* , &* 2 DC*
having *only 1 node each*.

We are trying to add New nodes (auto_bootstrap: true) in yaml ,  but
getting the below error-

In the Seed nodes list, we have provided both the existing nodes from both
DC(total -2 nodes). & tried with different option, by keeping only 1 node,
but no hope.


2017-10-23 20:06:31,739 [MessagingService-Outgoing-/96.115.209.92-Gossip]
WARN   SSLFactory.java:221 - Filtering out [TLS_RSA_WITH_AES_256_CBC_SHA]
as it isn't supported by the socket
2017-10-23 20:06:31,739 [MessagingService-Outgoing-/96.115.209.92-Gossip]
ERROR  OutboundTcpConnection.java:487 - SSL handshake error for outbound
connection to 15454e08[SSL_NULL_WITH_NULL_NULL: Socket[addr=/96.115.209.92
,port=10145,localport=60859]]
javax.net.ssl.SSLHandshakeException: No appropriate protocol (protocol is
disabled or cipher suites are inappropriate)


*2017-10-23 20:06:32,655 [main] ERROR  CassandraDaemon.java:752 - Exception
encountered during startupjava.lang.RuntimeException: Unable to gossip with
any seeds*

2017-10-23 20:06:32,666 [StorageServiceShutdownHook] INFO
HintsService.java:221 - Paused hints dispatch
2017-10-23 20:06:32,667 [StorageServiceShutdownHook] WARN
Gossiper.java:1514 - No local state, state is in silent shutdown, or node
hasn't joined, not announcing shutdown
2017-10-23 20:06:32,667 [StorageServiceShutdownHook] INFO
MessagingService.java:964 - Waiting for messaging service to quiesce
2017-10-23 20:06:32,667 [ACCEPT-/96.115.208.150] INFO
MessagingService.java:1314 - MessagingService has terminated the accept()
thread
2017-10-23 20:06:33,134 [StorageServiceShutdownHook] INFO
HintsService.java:221 - Paused hints dispatch

Can some one able to put some light on this issue, will be a great help.

thanks in advance,

- regards

Anumod.

Re: Read-/ Write Latency - Cassandra 2.1 .15 vs 3.10

[Anumod Mullachery]

Thanks for the info..

Thanks,

Anumod


Sent from my iPhone

> On Oct 3, 2017, at 12:07 PM, Chris Lohfink <clohf...@apple.com> wrote:
> 
> RecentReadLatency metrics has been deprecated for years (1.1 or 1.2) and were 
> removed in 2.2. It was a very misleading metric. Instead pull from the 
> Table's ReadLatency metrics from the org.apache.cassandra.metrics domain. 
> http://cassandra.apache.org/doc/latest/operating/metrics.html?highlight=metrics#table-metrics
> 
> Chris
> 
>> On Oct 3, 2017, at 10:06 AM, Anumod Mullachery <anumodmullache...@gmail.com> 
>> wrote:
>> 
>> Hi,  We were running splunk queries to pull read / write latency.  It's 
>> working fine in 2.1.15 , but not returning result from upgraded version 
>> 3.10.  The bean used in the script is as shown below.  Let me know, if any 
>> changes on the functionality on 2.1.15 vs 3.10 or it replaced to some other 
>> bean.   perf_queries= { "org.apache.cassandra.db:type=StorageProxy" => 
>> "RecentReadLatencyMicros,RecentWriteLatencyMicros", }  stage_queries= { 
>> "org.apache.cassandra.request:type=*" => 
>> "ActiveCount,PendingTasks,CurrentlyBlockedTasks", }  curl 
>> http://localhost:8778/jolokia/read/org.apache.cassandra.db:type=StorageProxy/RecentReadLatencyMicros,RecentWriteLatencyMicros
>>   curl 
>> http://localhost:8778/jolokia/read/org.apache.cassandra.request:type=*/ActiveCount,PendingTasks,CurrentlyBlockedTasks
>>   
>> 
>> ~ Thanks ~  Anumod
> 

Read-/ Write Latency - Cassandra 2.1 .15 vs 3.10

[Anumod Mullachery]

Hi,

We were running splunk  queries to pull read / write latency.

It's working fine in 2.1.15 , but not returning result from upgraded
version 3.10.

The bean used in the script is as shown below.

Let me know, if any changes on the functionality on 2.1.15 vs 3.10 or
it replaced to some other bean.


perf_queries= {
   "org.apache.cassandra.db:type=StorageProxy" =>
"RecentReadLatencyMicros,RecentWriteLatencyMicros",
}

stage_queries= {
   "org.apache.cassandra.request:type=*" =>
"ActiveCount,PendingTasks,CurrentlyBlockedTasks",
}

curl 
http://localhost:8778/jolokia/read/org.apache.cassandra.db:type=StorageProxy/RecentReadLatencyMicros,RecentWriteLatencyMicros

curl 
http://localhost:8778/jolokia/read/org.apache.cassandra.request:type=*/ActiveCount,PendingTasks,CurrentlyBlockedTasks


~ Thanks ~

Anumod