[jira] [Comment Edited] (CASSANDRA-13240) FailureDetector.java

2017-02-22 Thread Romain Hardouin (JIRA)

[ 
https://issues.apache.org/jira/browse/CASSANDRA-13240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1587#comment-1587
 ] 

Romain Hardouin edited comment on CASSANDRA-13240 at 2/22/17 8:00 AM:
--

You have to reset logging levels with nodetool, just type the following command 
on all nodes:

{code}
nodetool setlogginglevel
{code}

FYI {{setlogginglevel}} command takes arguments when you want to put a class or 
a whole package on DEBUG or TRACE, e.g:

{code}
nodetool setlogginglevel org.apache.cassandra.gms.FailureDetector TRACE
{code}


Also check your logback.xml and compare it with the upstream file of your 
Cassandra version to see if someone changed something.


was (Author: rha):
You have to reset logging levels with nodetool, just type the following command 
on all nodes:

{code}
nodetool setlogginglevel
{code}

FYI {{setlogginglevel}} command takes arguments when you want to put a class or 
a whole package on DEBUG or TRACE, e.g:

{code}
nodetool setlogginglevel org.apache.cassandra.gms.FailureDetector TRACE
{code}


Also check you logback.xml and compare it with the upstream file of your 
Cassandra version to see if someone changed something.

> FailureDetector.java
> 
>
> Key: CASSANDRA-13240
> URL: https://issues.apache.org/jira/browse/CASSANDRA-13240
> Project: Cassandra
>  Issue Type: Bug
>  Components: Configuration
> Environment: Production
>Reporter: Chetan Rawal
>Priority: Minor
>
> We are getting frequent  FailureDetector.java messages in Cassandra logs.
> TRACE [GossipStage:1] 2017-02-17 07:06:00,156 FailureDetector.java (line 164) 
> reporting /10.21.176.84
> TRACE [GossipStage:1] 2017-02-17 07:06:00,157 Gossiper.java (line 920) 
> /10.21.176.84local generation 1478408871, remote generation 1478408871
> TRACE [GossipStage:1] 2017-02-17 07:06:00,157 Gossiper.java (line 966) 
> Updating heartbeat state version to 9025996 from 9025995 for /10.21.176.84 ...
> TRACE [OptionalTasks:1] 2017-02-17 07:06:00,239 MeteredFlusher.java (line 
> 111) memtable memory usage is 10485760 bytes with 10485760 live
> TRACE [GossipTasks:1] 2017-02-17 07:06:00,451 Gossiper.java (line 126) My 
> heartbeat is now 9040716
> TRACE [GossipTasks:1] 2017-02-17 07:06:00,451 Gossiper.java (line 385) Gossip 
> Digests are : /10.21.181.60:1478392309:9040716 
> /10.21.176.84:1478408871:9025996 
> TRACE [GossipTasks:1] 2017-02-17 07:06:00,451 Gossiper.java (line 570) 
> Sending a GossipDigestSynMessage to /10.21.176.84 ...
> TRACE [GossipTasks:1] 2017-02-17 07:06:00,451 MessagingService.java (line 
> 450) /10.21.181.60 sending GOSSIP_DIGEST_SYN to 27612718@/10.21.176.84
> TRACE [GossipTasks:1] 2017-02-17 07:06:00,451 Gossiper.java (line 165) 
> Performing status check ...
> TRACE [GossipTasks:1] 2017-02-17 07:06:00,452 FailureDetector.java (line 185) 
> PHI for /10.21.176.84 : 0.12728519330605453
> TRACE [Thread-50] 2017-02-17 07:06:00,453 IncomingTcpConnection.java (line 
> 112) Version is now 5
> TRACE [Thread-50] 2017-02-17 07:06:00,453 MessagingService.java (line 572) 
> /10.21.181.60 received GOSSIP_DIGEST_ACK from 27177304@/10.21.176.84
> TRACE [GossipStage:1] 2017-02-17 07:06:00,453 GossipDigestAckVerbHandler.java 
> (line 47) Received a GossipDigestAckMessage from /10.21.176.84
> TRACE [GossipStage:1] 2017-02-17 07:06:00,453 Gossiper.java (line 726) local 
> heartbeat version 9040716 greater than 9040715 for /10.21.181.60
> TRACE [GossipStage:1] 2017-02-17 07:06:00,453 GossipDigestAckVerbHandler.java 
> (line 84) Sending a GossipDigestAck2Message to /10.21.176.84
> TRACE [GossipStage:1] 2017-02-17 07:06:00,453 MessagingService.java (line 
> 450) /10.21.181.60 sending GOSSIP_DIGEST_ACK2 to 27612719@/10.21.176.84
> TRACE [Thread-50] 2017-02-17 07:06:01,132 IncomingTcpConnection.java (line 
> 112) Version is now 5
> TRACE [Thread-50] 2017-02-17 07:06:01,132 MessagingService.java (line 572) 
> /10.21.181.60 received GOSSIP_DIGEST_SYN from 27177305@/10.21.176.84
> TRACE [GossipStage:1] 2017-02-17 07:06:01,133 GossipDigestSynVerbHandler.java 
> (line 46) Received a GossipDigestSynMessage from /10.21.176.84
> TRACE [GossipStage:1] 2017-02-17 07:06:01,133 GossipDigestSynVerbHandler.java 
> (line 76) Gossip syn digests are : /10.21.181.60:1478392309:9040716 
> /10.21.176.84:1478408871:9025997 
> TRACE [GossipStage:1] 2017-02-17 07:06:01,133 GossipDigestSynVerbHandler.java 
> (line 90) Sending a GossipDigestAckMessage to /10.21.176.84
> TRACE [GossipStage:1] 2017-02-17 07:06:01,133 MessagingService.java (line 
> 450) /10.21.181.60 sending GOSSIP_DIGEST_ACK to 27612720@/10.21.176.84
> TRACE [Thread-50] 2017-02-17 07:06:01,134 IncomingTcpConnection.java (line 
> 112) Version is now 5
> TRACE [Thread-50] 2017-02-17 07:06:01,134 MessagingService.java (line 572) 
> /10.21.181.60 received GOSSIP_DIG

[jira] [Comment Edited] (CASSANDRA-13240) FailureDetector.java

2017-02-21 Thread Romain Hardouin (JIRA)

[ 
https://issues.apache.org/jira/browse/CASSANDRA-13240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1587#comment-1587
 ] 

Romain Hardouin edited comment on CASSANDRA-13240 at 2/21/17 8:01 AM:
--

You have to reset logging levels with nodetool, just type the following command 
on all nodes:

{code}
nodetool setlogginglevel
{code}

FYI {{setlogginglevel}} command takes arguments when you want to put a class or 
a whole package on DEBUG or TRACE, e.g:

{code}
nodetool setlogginglevel org.apache.cassandra.gms.FailureDetector TRACE
{code}


Also check you logback.xml and compare it with the upstream file of your 
Cassandra version to see if someone changed something.


was (Author: rha):
You have to reset logging levels with nodetool, just type:

{code}
nodetool setlogginglevel
{code}

FYI {{setlogginglevel}} command takes arguments when you want to put a class or 
a whole package on DEBUG or TRACE, e.g:

{code}
nodetool setlogginglevel org.apache.cassandra.gms.FailureDetector TRACE
{code}


Also check you logback.xml and compare it with the upstream file of your 
Cassandra version to see if someone changed something.

> FailureDetector.java
> 
>
> Key: CASSANDRA-13240
> URL: https://issues.apache.org/jira/browse/CASSANDRA-13240
> Project: Cassandra
>  Issue Type: Bug
>  Components: Configuration
> Environment: Production
>Reporter: Chetan Rawal
>Priority: Minor
>
> We are getting frequent  FailureDetector.java messages in Cassandra logs.
> TRACE [GossipStage:1] 2017-02-17 07:06:00,156 FailureDetector.java (line 164) 
> reporting /10.21.176.84
> TRACE [GossipStage:1] 2017-02-17 07:06:00,157 Gossiper.java (line 920) 
> /10.21.176.84local generation 1478408871, remote generation 1478408871
> TRACE [GossipStage:1] 2017-02-17 07:06:00,157 Gossiper.java (line 966) 
> Updating heartbeat state version to 9025996 from 9025995 for /10.21.176.84 ...
> TRACE [OptionalTasks:1] 2017-02-17 07:06:00,239 MeteredFlusher.java (line 
> 111) memtable memory usage is 10485760 bytes with 10485760 live
> TRACE [GossipTasks:1] 2017-02-17 07:06:00,451 Gossiper.java (line 126) My 
> heartbeat is now 9040716
> TRACE [GossipTasks:1] 2017-02-17 07:06:00,451 Gossiper.java (line 385) Gossip 
> Digests are : /10.21.181.60:1478392309:9040716 
> /10.21.176.84:1478408871:9025996 
> TRACE [GossipTasks:1] 2017-02-17 07:06:00,451 Gossiper.java (line 570) 
> Sending a GossipDigestSynMessage to /10.21.176.84 ...
> TRACE [GossipTasks:1] 2017-02-17 07:06:00,451 MessagingService.java (line 
> 450) /10.21.181.60 sending GOSSIP_DIGEST_SYN to 27612718@/10.21.176.84
> TRACE [GossipTasks:1] 2017-02-17 07:06:00,451 Gossiper.java (line 165) 
> Performing status check ...
> TRACE [GossipTasks:1] 2017-02-17 07:06:00,452 FailureDetector.java (line 185) 
> PHI for /10.21.176.84 : 0.12728519330605453
> TRACE [Thread-50] 2017-02-17 07:06:00,453 IncomingTcpConnection.java (line 
> 112) Version is now 5
> TRACE [Thread-50] 2017-02-17 07:06:00,453 MessagingService.java (line 572) 
> /10.21.181.60 received GOSSIP_DIGEST_ACK from 27177304@/10.21.176.84
> TRACE [GossipStage:1] 2017-02-17 07:06:00,453 GossipDigestAckVerbHandler.java 
> (line 47) Received a GossipDigestAckMessage from /10.21.176.84
> TRACE [GossipStage:1] 2017-02-17 07:06:00,453 Gossiper.java (line 726) local 
> heartbeat version 9040716 greater than 9040715 for /10.21.181.60
> TRACE [GossipStage:1] 2017-02-17 07:06:00,453 GossipDigestAckVerbHandler.java 
> (line 84) Sending a GossipDigestAck2Message to /10.21.176.84
> TRACE [GossipStage:1] 2017-02-17 07:06:00,453 MessagingService.java (line 
> 450) /10.21.181.60 sending GOSSIP_DIGEST_ACK2 to 27612719@/10.21.176.84
> TRACE [Thread-50] 2017-02-17 07:06:01,132 IncomingTcpConnection.java (line 
> 112) Version is now 5
> TRACE [Thread-50] 2017-02-17 07:06:01,132 MessagingService.java (line 572) 
> /10.21.181.60 received GOSSIP_DIGEST_SYN from 27177305@/10.21.176.84
> TRACE [GossipStage:1] 2017-02-17 07:06:01,133 GossipDigestSynVerbHandler.java 
> (line 46) Received a GossipDigestSynMessage from /10.21.176.84
> TRACE [GossipStage:1] 2017-02-17 07:06:01,133 GossipDigestSynVerbHandler.java 
> (line 76) Gossip syn digests are : /10.21.181.60:1478392309:9040716 
> /10.21.176.84:1478408871:9025997 
> TRACE [GossipStage:1] 2017-02-17 07:06:01,133 GossipDigestSynVerbHandler.java 
> (line 90) Sending a GossipDigestAckMessage to /10.21.176.84
> TRACE [GossipStage:1] 2017-02-17 07:06:01,133 MessagingService.java (line 
> 450) /10.21.181.60 sending GOSSIP_DIGEST_ACK to 27612720@/10.21.176.84
> TRACE [Thread-50] 2017-02-17 07:06:01,134 IncomingTcpConnection.java (line 
> 112) Version is now 5
> TRACE [Thread-50] 2017-02-17 07:06:01,134 MessagingService.java (line 572) 
> /10.21.181.60 received GOSSIP_DIGEST_ACK2 from 27177306@/10.21.176.84