Work pulling (see my previous link) might be a good choice. Note that it's not only about that the end consumers might not consume fast enough, it's also anything on the way there, such as serialization and deserialization (which I think is your bottleneck).
On Thu, May 25, 2017 at 1:16 PM, chaitanya <chaitanya.e...@gmail.com> wrote: > We used Single Producer and Multiple Consumer pattern > > > On Thursday, 25 May 2017 15:56:15 UTC+5:30, chaitanya wrote: >> >> " The buffers in Artery are bounded and will start dropping messages if >> overwhelmed " - >> >> which pattern would be best to resolve this issue and faster? >> >> >> On Wednesday, 24 May 2017 17:54:11 UTC+5:30, Patrik Nordwall wrote: >>> >>> You have to implement some flow control, such as as using the "Work >>> Pulling" pattern >>> <https://groups.google.com/forum/#!searchin/akka-user/%22work$20pulling%22%7Csort:relevance>, >>> throttling, or send acknowledgment messages back from the consumer. If >>> producer is sending messages at a higher rate than they can be consumed >>> those messages must be buffered somewhere and that can eventually result in >>> out of memory. The buffers in Artery are bounded and will start dropping >>> messages if overwhelmed. >>> >>> Cheers, >>> Patrik >>> >>> On Wed, May 24, 2017 at 9:57 AM, chaitanya <chaitan...@gmail.com> wrote: >>> >>>> Following is the console output of my program it says Dropping messages >>>> due to overflow of send queue. How to solve this? >>>> >>>> GET Messages >>>>>>>>>>> Content >>>> GET Messages >>>>>>>>>>> Content >>>> 12:49:35.091 [ClusterSystem-akka.actor.default-dispatcher-3] DEBUG >>>> a.r.a.Association(akka://ClusterSystem) - Dropping message >>>> [ActorSelectionMessage(java.lang.String)] from >>>> [Actor[akka://ClusterSystem/user/master_1#-495216506]] to >>>> [Actor[akka://ClusterSystem@127.0.0.1:2551/]] due to overflow of send >>>> queue, size [3072] >>>> 12:49:35.092 [ClusterSystem-akka.actor.default-dispatcher-3] DEBUG >>>> a.r.a.Association(akka://ClusterSystem) - Dropping message >>>> [ActorSelectionMessage(java.lang.String)] from >>>> [Actor[akka://ClusterSystem/user/master_1#-495216506]] to >>>> [Actor[akka://ClusterSystem@127.0.0.1:2551/]] due to overflow of send >>>> queue, size [3072] >>>> 12:49:35.092 [ClusterSystem-akka.actor.default-dispatcher-3] DEBUG >>>> a.r.a.Association(akka://ClusterSystem) - Dropping message >>>> [ActorSelectionMessage(java.lang.String)] from >>>> [Actor[akka://ClusterSystem/user/master_1#-495216506]] to >>>> [Actor[akka://ClusterSystem@127.0.0.1:2551/]] due to overflow of send >>>> queue, size [3072] >>>> 12:49:35.092 [ClusterSystem-akka.actor.default-dispatcher-3] INFO >>>> a.r.RemoteActorRefProvider$RemoteDeadLetterActorRef - Message >>>> [java.lang.String] from >>>> Actor[akka://ClusterSystem/user/master_1#-495216506] >>>> to Actor[akka://ClusterSystem/deadLetters] was not delivered. [1] dead >>>> letters encountered. This logging can be turned off or adjusted with >>>> configuration settings 'akka.log-dead-letters' and >>>> 'akka.log-dead-letters-during-shutdown'. >>>> 12:49:35.093 [ClusterSystem-akka.actor.default-dispatcher-3] INFO >>>> a.r.RemoteActorRefProvider$RemoteDeadLetterActorRef - Message >>>> [java.lang.String] from >>>> Actor[akka://ClusterSystem/user/master_1#-495216506] >>>> to Actor[akka://ClusterSystem/deadLetters] was not delivered. [2] dead >>>> letters encountered. This logging can be turned off or adjusted with >>>> configuration settings 'akka.log-dead-letters' and >>>> 'akka.log-dead-letters-during-shutdown'. >>>> 12:49:35.093 [ClusterSystem-akka.actor.default-dispatcher-2] DEBUG >>>> a.r.a.Association(akka://ClusterSystem) - Dropping message >>>> [ActorSelectionMessage(java.lang.String)] from >>>> [Actor[akka://ClusterSystem/user/master_1#-495216506]] to >>>> [Actor[akka://ClusterSystem@127.0.0.1:2551/]] due to overflow of send >>>> queue, size [3072] >>>> 12:49:35.095 [ClusterSystem-akka.actor.default-dispatcher-2] DEBUG >>>> a.r.a.Association(akka://ClusterSystem) - Dropping message >>>> [ActorSelectionMessage(java.lang.String)] from >>>> [Actor[akka://ClusterSystem/user/master_1#-495216506]] to >>>> [Actor[akka://ClusterSystem@127.0.0.1:2551/]] due to overflow of send >>>> queue, size [3072] >>>> 12:49:35.097 [ClusterSystem-akka.actor.default-dispatcher-2] DEBUG >>>> a.r.a.Association(akka://ClusterSystem) - Dropping message >>>> [ActorSelectionMessage(java.lang.String)] from >>>> [Actor[akka://ClusterSystem/user/master_1#-495216506]] to >>>> [Actor[akka://ClusterSystem@127.0.0.1:2551/]] due to overflow of send >>>> queue, size [3072] >>>> >>>> How can >>>> >>>> On Wednesday, 24 May 2017 00:05:42 UTC+5:30, chaitanya wrote: >>>>> >>>>> Hi guys,' >>>>> I am a newbie to akka cluster and i have created a sample program. I >>>>> am using producer consumer pattern. My producer sends messages to consumer >>>>> which are 2 seed nodes. >>>>> The program works fine when no of messages are less like in thousands >>>>> but the program seems to seize when i send huge no of messages to seed >>>>> nodes. >>>>> >>>>> I have implemented artery remoting and for this i refer to ---- >>>>> http://doc.akka.io/docs/akka/2.5/java/remoting-artery.html >>>>> >>>>> Please find project in attached zip. Can anyone please help me out >>>>> with this ???? >>>>> >>>>> -- >>>> >>>>>>>>>> Read the docs: http://akka.io/docs/ >>>> >>>>>>>>>> Check the FAQ: http://doc.akka.io/docs/akka/c >>>> urrent/additional/faq.html >>>> >>>>>>>>>> Search the archives: https://groups.google.com/grou >>>> p/akka-user >>>> --- >>>> You received this message because you are subscribed to the Google >>>> Groups "Akka User List" group. >>>> To unsubscribe from this group and stop receiving emails from it, send >>>> an email to akka-user+...@googlegroups.com. >>>> To post to this group, send email to akka...@googlegroups.com. >>>> Visit this group at https://groups.google.com/group/akka-user. >>>> For more options, visit https://groups.google.com/d/optout. >>>> >>> >>> >>> >>> -- >>> >>> Patrik Nordwall >>> Akka Tech Lead >>> Lightbend <http://www.lightbend.com/> - Reactive apps on the JVM >>> Twitter: @patriknw >>> >>> -- > >>>>>>>>>> Read the docs: http://akka.io/docs/ > >>>>>>>>>> Check the FAQ: http://doc.akka.io/docs/akka/ > current/additional/faq.html > >>>>>>>>>> Search the archives: https://groups.google.com/group/akka-user > --- > You received this message because you are subscribed to the Google Groups > "Akka User List" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to akka-user+unsubscr...@googlegroups.com. > To post to this group, send email to akka-user@googlegroups.com. > Visit this group at https://groups.google.com/group/akka-user. > For more options, visit https://groups.google.com/d/optout. > -- Patrik Nordwall Akka Tech Lead Lightbend <http://www.lightbend.com/> - Reactive apps on the JVM Twitter: @patriknw -- >>>>>>>>>> Read the docs: http://akka.io/docs/ >>>>>>>>>> Check the FAQ: >>>>>>>>>> http://doc.akka.io/docs/akka/current/additional/faq.html >>>>>>>>>> Search the archives: https://groups.google.com/group/akka-user --- You received this message because you are subscribed to the Google Groups "Akka User List" group. To unsubscribe from this group and stop receiving emails from it, send an email to akka-user+unsubscr...@googlegroups.com. To post to this group, send email to akka-user@googlegroups.com. Visit this group at https://groups.google.com/group/akka-user. For more options, visit https://groups.google.com/d/optout.
