A few possible reasons: 1) Use latest stable Akka version, i.e. 2.4.0 or 2.3.14
2) Binding to hostname 0.0.0.0 is not supported 3) It may take a while until ClusterClient and the servers side receptionists knows about the target destinations, and then messages might be dropped You should look for dead letters in the logs <http://doc.akka.io/docs/akka/2.4.0/scala/logging.html#Logging_of_Dead_Letters> . Cheers, Patrik On Thu, Oct 29, 2015 at 2:26 PM, Arpit <arpit.rajpuro...@gmail.com> wrote: > Consumers are IO bound. > > > On Wednesday, 28 October 2015 20:21:16 UTC+5:30, Arpit Rajpurohit wrote: >> >> Hi, >> >> Following is my app.conf. I am losing almost 50% of the messages. Is it >> because of the ClusterRouterPool ? >> >> Running it on 2 node cluster(each is m4.xlarge machine) >> >> There are two actors- >> >> akka { >> loglevel = "INFO" >> loggers = ["akka.event.slf4j.Slf4jLogger"] >> log-dead-letters-during-shutdown = off >> log-dead-letters = 0 >> stdout-loglevel = "INFO" >> log-config-on-start = off >> daemonic = off >> jvm-exit-on-fatal-error = on >> actor { >> provider = "akka.cluster.ClusterActorRefProvider" >> unstarted-push-timeout = 100s >> default-mailbox { >> mailbox-type = "akka.dispatch.SingleConsumerOnlyUnboundedMailbox" >> mailbox-push-timeout-time = 20s >> } >> >> default-dispatcher { >> type = Dispatcher >> executor = "fork-join-executor" >> fork-join-executor { >> parallelism-min = 16 >> parallelism-factor = 16 >> parallelism-max = 64 >> } >> throughput = 1 >> } >> producer-dispatcher { >> type = Dispatcher >> executor = "fork-join-executor" >> fork-join-executor { >> parallelism-min = 16 >> parallelism-factor = 4.0 >> parallelism-max = 64 >> } >> throughput = 1 >> } >> consumer-dispatcher { >> type = Dispatcher >> executor = "fork-join-executor" >> fork-join-executor { >> parallelism-min = 4 >> parallelism-factor = 4.0 >> parallelism-max = 4 >> } >> throughput = 1 >> } >> } >> remote { >> log-remote-lifecycle-events = on >> netty.tcp { >> hostname = "0.0.0.0" >> port = 2551 >> } >> } >> extensions = [ >> "akka.contrib.pattern.DistributedPubSubExtension" >> ] >> cluster { >> seed-nodes = [ >> "akka.tcp://myapp@0.0.0.0:2551", >> "akka.tcp://myapp@0.0.0.0:2552" >> ] >> auto-down-unreachable-after = 30s >> } >> } >> >> akka.contrib.cluster.pub-sub { >> name = myappPubSubMediator >> role = "" >> routing-logic = round-robin >> gossip-interval = 1s >> removed-time-to-live = 120s >> } >> >> spray.httpx { >> compact-json-printing = true >> } >> >> spray.can { >> server { >> pipelining-limit = 20 >> reaping-cycle = infinite >> request-chunk-aggregation-limit = 0 >> stats-support = off >> remote-address-header = on >> } >> client { >> max-connections = 64 >> max-retries = 5 >> parsing = ${spray.can.parsing} >> } >> parsing { >> max-uri-length = 4k >> max-response-reason-length = 64 >> max-header-name-length = 64 >> max-header-value-length = 8k >> max-header-count = 64 >> max-content-length = 512m >> max-chunk-ext-length = 512 >> max-chunk-size = 4m >> illegal-header-warnings = off >> } >> } >> >> >> >> This is how I am creating cluster Pool for both the actors - >> >> system.actorOf( >> ClusterRouterPool(AdaptiveLoadBalancingPool( >> SystemLoadAverageMetricsSelector), >> ClusterRouterPoolSettings( >> totalInstances = instances * 64, maxInstancesPerNode = >> instances, >> allowLocalRoutees = isLocal, useRole = None) >> ).props(Props[T]).withDispatcher(dispatcher), name) >> } >> >> Instances above is 16. >> >> Following are the versions - >> "io.spray" %% "spray-can" >> % "1.3.2", >> "io.spray" %% "spray-routing" >> % "1.3.2", >> "io.spray" %% "spray-testkit" >> % "1.3.2" % "test", >> "io.spray" %% "spray-client" >> % "1.3.2", >> "io.spray" %% "spray-json" >> % "1.2.6", >> "com.typesafe.akka" %% "akka-actor" >> % "2.3.6", >> "com.typesafe.akka" %% "akka-cluster" >> % "2.3.6", >> "com.typesafe.akka" %% "akka-contrib" >> % "2.3.6", >> "com.typesafe.akka" %% "akka-slf4j" >> % "2.3.6", >> "com.typesafe.akka" %% "akka-testkit" >> % "2.3.6" % "test" >> >> - Two actors: Producers and Consumers >> >> -- Sending in a following way - >> system.actorOf(ClusterClient.props(actorSet,Duration.create(10, >> TimeUnit.SECONDS))) >> clusterClient ! ClusterClient.Send(String.format("/user/%s", target), >> message, localAffinity = localAffinity) >> >> -- Throughput is 500 per second. >> >> -- Messages are being lost randomly. Tough to find any pattern. >> >> -- Can't find anything in the logs >> >> -- I even tried Bounded mailbox along with " >> automatic-back-pressure-handling = on" to make it blocking. But still >> losing messages. >> >> >> -- > >>>>>>>>>> Read the docs: http://akka.io/docs/ > >>>>>>>>>> Check the FAQ: > http://doc.akka.io/docs/akka/current/additional/faq.html > >>>>>>>>>> Search the archives: https://groups.google.com/group/akka-user > --- > You received this message because you are subscribed to the Google Groups > "Akka User List" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to akka-user+unsubscr...@googlegroups.com. > To post to this group, send email to akka-user@googlegroups.com. > Visit this group at http://groups.google.com/group/akka-user. > For more options, visit https://groups.google.com/d/optout. > -- Patrik Nordwall Typesafe <http://typesafe.com/> - Reactive apps on the JVM Twitter: @patriknw -- >>>>>>>>>> Read the docs: http://akka.io/docs/ >>>>>>>>>> Check the FAQ: >>>>>>>>>> http://doc.akka.io/docs/akka/current/additional/faq.html >>>>>>>>>> Search the archives: https://groups.google.com/group/akka-user --- You received this message because you are subscribed to the Google Groups "Akka User List" group. To unsubscribe from this group and stop receiving emails from it, send an email to akka-user+unsubscr...@googlegroups.com. To post to this group, send email to akka-user@googlegroups.com. Visit this group at http://groups.google.com/group/akka-user. For more options, visit https://groups.google.com/d/optout.
