Hi Team
ODL version used: NEON-SR1
ODL Cluster was up and running for few days. To enable akka logs, we have
restarted all the controller nodes after enabling logs using akka.conf file
One of the nodes have not joined the cluster and could see below logs are
written continuously in that node. Restarted the node multiple times and
observed the same issue.
bundle:diag indicates all the bundles are in GRACE PERIOD
Can someone please explain what could have gone bad and how to recover?
2019-11-20T13:19:30,751 | WARN | ForkJoinPool.commonPool-worker-1 |
AbstractShardBackendResolver | 365 -
org.opendaylight.controller.sal-distributed-datastore - 1.9.1 | Failed to
resolve shard
java.util.concurrent.TimeoutException: Connection attempt failed
at
org.opendaylight.controller.cluster.databroker.actors.dds.AbstractShardBackendResolver.wrap(AbstractShardBackendResolver.java:148)
~[?:?]
at
org.opendaylight.controller.cluster.databroker.actors.dds.AbstractShardBackendResolver.onConnectResponse(AbstractShardBackendResolver.java:165)
~[?:?]
at
org.opendaylight.controller.cluster.databroker.actors.dds.AbstractShardBackendResolver.lambda$connectShard$4(AbstractShardBackendResolver.java:158)
~[?:?]
at
java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:760)
[?:?]
at
java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:736)
[?:?]
at
java.util.concurrent.CompletableFuture$Completion.exec(CompletableFuture.java:443)
[?:?]
at java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:289) [?:?]
at
java.util.concurrent.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1056)
[?:?]
at java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1692)
[?:?]
at
java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:157)
[?:?]
Caused by:
org.opendaylight.controller.cluster.access.concepts.RetiredGenerationException:
Originating generation 0 was superseded by 8
at
org.opendaylight.controller.cluster.datastore.Shard.findFrontend(Shard.java:478)
~[?:?]
at
org.opendaylight.controller.cluster.datastore.Shard.handleConnectClient(Shard.java:519)
~[?:?]
at
org.opendaylight.controller.cluster.datastore.Shard.handleNonRaftCommand(Shard.java:321)
~[?:?]
at
org.opendaylight.controller.cluster.raft.RaftActor.handleCommand(RaftActor.java:270)
~[?:?]
at
org.opendaylight.controller.cluster.common.actor.AbstractUntypedPersistentActor.onReceiveCommand(AbstractUntypedPersistentActor.java:46)
~[?:?]
at
akka.persistence.UntypedPersistentActor.onReceive(PersistentActor.scala:297)
~[?:?]
at
org.opendaylight.controller.cluster.common.actor.MeteringBehavior.apply(MeteringBehavior.java:104)
~[?:?]
at
akka.actor.ActorCell$$anonfun$become$1.applyOrElse(ActorCell.scala:628) ~[?:?]
at akka.actor.Actor.aroundReceive(Actor.scala:539) ~[?:?]
at akka.actor.Actor.aroundReceive$(Actor.scala:537) ~[?:?]
at
akka.persistence.UntypedPersistentActor.akka$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:295)
~[?:?]
at
akka.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:858)
~[?:?]
at akka.persistence.Eventsourced.aroundReceive(Eventsourced.scala:244)
~[?:?]
at akka.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:243)
~[?:?]
at
akka.persistence.UntypedPersistentActor.aroundReceive(PersistentActor.scala:295)
~[?:?]
at akka.actor.ActorCell.receiveMessage(ActorCell.scala:610) ~[?:?]
at akka.actor.ActorCell.invoke(ActorCell.scala:579) ~[?:?]
at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:268) ~[?:?]
at akka.dispatch.Mailbox.run(Mailbox.scala:229) ~[?:?]
at akka.dispatch.Mailbox.exec(Mailbox.scala:241) ~[?:?]
at akka.dispatch.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
~[?:?]
at
akka.dispatch.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
~[?:?]
at
akka.dispatch.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) ~[?:?]
at
akka.dispatch.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
~[?:?]
Thanks
Vikram
Please see our privacy statement at
https://www.advaoptical.com/en/about-us/legal/privacy-statement for details of
how ADVA processes personal information.
-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#14913):
https://lists.opendaylight.org/g/controller-dev/message/14913
Mute This Topic: https://lists.opendaylight.org/mt/60940312/21656
Group Owner: [email protected]
Unsubscribe: https://lists.opendaylight.org/g/controller-dev/unsub
[[email protected]]
-=-=-=-=-=-=-=-=-=-=-=-
