Re: RC1 - joining cluster

2021-05-09 Thread Kane Wilson 
How long are you waiting for the node to join? Have you checked nodetool
netstats and compactionstats to see if all streams/compactions are complete?

raft.so - Cassandra consulting, support, and managed services


On Sat, May 8, 2021 at 11:23 AM Joe Obernberger <
joseph.obernber...@gmail.com> wrote:

> Whoops - had it in the wrong datacenter.  Same issue - new node is
> stuck in UJ, but I can start/stop OK with systemctl.
>
> Datacenter: datacenter1
> ===
> Status=Up/Down
> |/ State=Normal/Leaving/Joining/Moving
> --  AddressLoad
> Tokens  Owns (effective)  Host
> ID   Rack
> UN  helene.querymasters.com423.92 MiB  30Â
> 18.6% 2529b6ed-cdb2-43c2-bdd7-171cfe308bd3  rack1
> UJ  fortuna.querymasters.com   1.75 GiB200   Â
> ? 49e4f571-7d1c-4e1e-aca7-5bbe076596f7
> rack1
> UN  charon.querymasters.com2.22 GiB200   Â
> 98.5% d9702f96-256e-45ae-8e12-69a42712be50  rack1
> UN  eros.querymasters.com  2.21 GiB200   Â
> 98.5% 93f9cb0f-ea71-4e3d-b62a-f0ea0e888c47  rack1
> UN  hercules.querymasters.com  58.65 MiB   4 Â
> 2.6%  a1a16910-9167-4174-b34b-eb859d36347e  rack1
> UN  chaos.querymasters.com 1.82 GiB120   Â
> 81.8% 08a19658-40be-4e55-8709-812b3d4ac750  rack1
>
> I am able to restart the server (fortuna - after about 3 hours), but I
> then get this:
>
> ERROR [Stream-Deserializer-/172.16.100.253:7000-493728e3] 2021-05-07
> 21:17:35,805 StreamingInboundHandler.java:205 - [Stream channel:
> 493728e3] stream operation from /172.16.100.253:7000 failed
> java.lang.IllegalStateException: unknown stream session:
> 27c00760-af9b-11eb-b7ee-5d6a136b5405 - 0
> at
>
> org.apache.cassandra.streaming.messages.IncomingStreamMessage$1.deserialize(IncomingStreamMessage.java:45)
> at
>
> org.apache.cassandra.streaming.messages.IncomingStreamMessage$1.deserialize(IncomingStreamMessage.java:38)
> at
>
> org.apache.cassandra.streaming.messages.StreamMessage.deserialize(StreamMessage.java:53)
> at
>
> org.apache.cassandra.streaming.async.StreamingInboundHandler$StreamDeserializingTask.run(StreamingInboundHandler.java:172)
> at
>
> io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
> at java.base/java.lang.Thread.run(Thread.java:829)
> ERROR [Stream-Deserializer-/172.16.100.253:7000-e313e37d] 2021-05-07
> 21:17:36,208 StreamSession.java:882 - [Stream
> #27c00760-af9b-11eb-b7ee-5d6a136b5405] Remote peer /172.16.100.253:7000
> failed stream session.
> INFO  [Stream-Deserializer-/172.16.100.253:7000-e313e37d] 2021-05-07
> 21:17:36,209 StreamResultFuture.java:192 - [Stream
> #27c00760-af9b-11eb-b7ee-5d6a136b5405] Session with /172.16.100.253:7000
> is complete
> INFO  [Stream-Deserializer-/172.16.100.253:7000-e313e37d] 2021-05-07
> 21:17:36,209 StreamSession.java:359 - [Stream
> #27c00760-af9b-11eb-b7ee-5d6a136b5405] Starting streaming to
> /172.16.100.37:7000
> INFO  [Stream-Deserializer-/172.16.100.253:7000-e313e37d] 2021-05-07
> 21:17:36,214 StreamCoordinator.java:263 - [Stream
> #27c00760-af9b-11eb-b7ee-5d6a136b5405, ID#0] Beginning stream session
> with /172.16.100.37:7000
> INFO  [Stream-Deserializer-/172.16.100.36:7000-9d343b7e] 2021-05-07
> 21:17:37,808 StreamResultFuture.java:178 - [Stream
> #27c00760-af9b-11eb-b7ee-5d6a136b5405 ID#0] Prepare completed. Receiving
> 0 files(0.000KiB), sending 0 files(0.000KiB)
> INFO  [Stream-Deserializer-/172.16.100.39:7000-1c5eddba] 2021-05-07
> 21:17:37,809 StreamResultFuture.java:178 - [Stream
> #27c00760-af9b-11eb-b7ee-5d6a136b5405 ID#0] Prepare completed. Receiving
> 0 files(0.000KiB), sending 0 files(0.000KiB)
> INFO  [Stream-Deserializer-/172.16.100.36:7000-9d343b7e] 2021-05-07
> 21:17:38,209 StreamResultFuture.java:192 - [Stream
> #27c00760-af9b-11eb-b7ee-5d6a136b5405] Session with /172.16.100.36:7000
> is complete
> INFO  [Stream-Deserializer-/172.16.100.39:7000-1c5eddba] 2021-05-07
> 21:17:38,210 StreamResultFuture.java:192 - [Stream
> #27c00760-af9b-11eb-b7ee-5d6a136b5405] Session with /172.16.100.39:7000
> is complete
> INFO  [Stream-Deserializer-/172.16.100.37:7000-d2676988] 2021-05-07
> 21:17:41,416 StreamResultFuture.java:178 - [Stream
> #27c00760-af9b-11eb-b7ee-5d6a136b5405 ID#0] Prepare completed. Receiving
> 0 files(0.000KiB), sending 0 files(0.000KiB)
> INFO  [Stream-Deserializer-/172.16.100.37:7000-d2676988] 2021-05-07
> 21:17:41,818 StreamResultFuture.java:192 - [Stream
> #27c00760-af9b-11eb-b7ee-5d6a136b5405] Session with /172.16.100.37:7000
> is complete
> WARN  [Stream-Deserializer-/172.16.100.37:7000-d2676988] 2021-05-07
> 21:17:41,822 StreamResultFuture.java:219 - [Stream
> #27c00760-af9b-11eb-b7ee-5d6a136b5405] Stream failed
> ERROR [main] 2021-05-07 21:17:41,823 StorageService.java:1773 - Error
> while waiting on bootstrap to complete. Bootstrap will have to be
> restarted.
> java.util.concurrent.ExecutionExce

Re: 4.0 best feature/fix?

2021-05-09 Thread Jonathan Koppenhofer 
I addition to Jeff's answer... Certificate hot reloading... For an
organization that uses annual certs :)


On Fri, May 7, 2021, 8:47 AM Durity, Sean R 
wrote:

> There is not enough 4.0 chatter here. What feature or fix of the 4.0
> release is most important for your use case(s)/environment? What is working
> well so far? What needs more work? Is there anything that needs more
> explanation?
>
>
>
> Sean Durity
>
> Staff Systems Engineer – Cassandra
>
> #cassandra - for the latest news and updates
>
>
>
>
>
> --
>
> The information in this Internet Email is confidential and may be legally
> privileged. It is intended solely for the addressee. Access to this Email
> by anyone else is unauthorized. If you are not the intended recipient, any
> disclosure, copying, distribution or any action taken or omitted to be
> taken in reliance on it, is prohibited and may be unlawful. When addressed
> to our clients any opinions or advice contained in this Email are subject
> to the terms and conditions expressed in any applicable governing The Home
> Depot terms of business or client engagement letter. The Home Depot
> disclaims all responsibility and liability for the accuracy and content of
> this attachment and for any damages or losses arising from any
> inaccuracies, errors, viruses, e.g., worms, trojan horses, etc., or other
> items of a destructive nature, which may be contained in this attachment
> and shall not be liable for direct, indirect, consequential or special
> damages in connection with this e-mail message or its attachment.
>