We have the same issue. We observed the JMX only cleared after exactly 72 hours too.
On Jul 29, 2019, at 11:23 AM, Rahul Reddy <rahulreddy1...@gmail.com> wrote: And also system.peers table doesn't have the information on old nodes only ghost nodes to be there in JMX > On Mon, Jul 29, 2019, 7:39 AM Rahul Reddy <rahulreddy1...@gmail.com> wrote: > We removed many times nodes from a cluster but never seen the jmx metric down > stay for 72 hours. So it has to be completely removed from gossip to show the > metric as expected? This would be problem for using the metric to alert on > call > >> On Mon, Jul 29, 2019, 7:28 AM Oleksandr Shulgin >> <oleksandr.shul...@zalando.de> wrote: >>> On Mon, Jul 29, 2019 at 1:21 PM Rahul Reddy <rahulreddy1...@gmail.com> >>> wrote: >> >>> >>> Decommissioned 2 nodes from cluster nodetool status doesn't list the nodes >>> as expected but jmx metrics shows still those 2 nodes has down. Nodetool >>> gossip shows the 2 nodes in Left state. Why does my jmx still shows those >>> nodes down even after 24 hours. Cassandra version 3.11.3 ? >> >> AFAIK, the nodes are not removed from gossip for 72 hours by default. >> >>> Anything else need to be done? >> >> Wait another 48 hours? ;-) >> >> -- >> Alex >>
