One thing that I've discovered while debugging this is that if you throw an exception in onPull the same behavior seems to happen...I'd almost consider it a bug that an exception thrown in a PushPull stage is silently dropped...I would at least expect a behavior like that to be called out in the docs. Perhaps an "AutofailingPushPullStag" or something that wraps the methods in a `try` and ctx.fails if there's an error?
Russell On Tuesday, June 2, 2015 at 7:05:09 PM UTC-7, Russell Cohen wrote: > > Hi All, > We've been trying to debug a tricky intermittent failure mode we're > having with akka-streams. We are setting up a large fan in (~32 nodes) and > periodically one of the nodes will inexplicably lead to an RST packet being > sent, aborting the entire graph. Below, I have debug logging from the > fan-in master as well as from the child that sent the failing packet along > with my commentary: > > > Fan in master: > > [DEBUG] [06/02/2015 18:13:09.228] [nrt-akka.actor.default-dispatcher-25] [ > akka.tcp://nrt@long-nrt-1:2551/system/IO-TCP/selectors/$a/143] Attempting > connection to [long-nrt-20/IP_REDACTED:2552] > [DEBUG] [06/02/2015 18:13:09.229] [nrt-akka.actor.default-dispatcher-19] [ > akka.tcp://nrt@long-nrt-1:2551/system/IO-TCP/selectors/$a/143] Connection > established to [long-nrt-20/IP_REDACTED:2552] > [DEBUG] [06/02/2015 18:13:09.230] [nrt-akka.actor.default-dispatcher-25] [ > akka.tcp://nrt@long-nrt-1:2551/system/IO-TCP/selectors/$a/143] > [Actor[akka://nrt/system/IO-TCP-STREAM/client-127-long-nrt-20%2IP_REDACTED%3A2552#-368113801]] > > registered as connection handler > [DEBUG] [06/02/2015 18:13:09.230] [nrt-akka.actor.default-dispatcher-20] [ > akka.tcp://nrt@long-nrt-1:2551/system/IO-TCP/selectors/$a/143] Wrote [8] > bytes to channel > [DEBUG] [06/02/2015 18:13:09.230] [nrt-akka.actor.default-dispatcher-20] [ > akka.tcp://nrt@long-nrt-1:2551/system/IO-TCP/selectors/$a/143] Got > ConfirmedClose command, sending FIN. > [DEBUG] [06/02/2015 18:13:09.324] [nrt-akka.actor.default-dispatcher-20] [ > akka.tcp://nrt@long-nrt-1:2551/system/IO-TCP/selectors/$a/143] Read > [7695] bytes. > [DEBUG] [06/02/2015 18:13:09.324] [nrt-akka.actor.default-dispatcher-25] [ > akka.tcp://nrt@long-nrt-1:2551/system/IO-TCP/selectors/$a/143] Read > [9545] bytes. > [DEBUG] [06/02/2015 18:13:09.325] [nrt-akka.actor.default-dispatcher-23] [ > akka.tcp://nrt@long-nrt-1:2551/system/IO-TCP/selectors/$a/143] Read > [1794] bytes. > [DEBUG] [06/02/2015 18:13:09.325] [nrt-akka.actor.default-dispatcher-20] [ > akka.tcp://nrt@long-nrt-1:2551/system/IO-TCP/selectors/$a/143] Read > [1794] bytes. > [DEBUG] [06/02/2015 18:13:09.333] [nrt-akka.actor.default-dispatcher-25] [ > akka.tcp://nrt@long-nrt-1:2551/system/IO-TCP/selectors/$a/143] Read > [12439] bytes. > [DEBUG] [06/02/2015 18:13:09.340] [nrt-akka.actor.default-dispatcher-20] [ > akka.tcp://nrt@long-nrt-1:2551/system/IO-TCP/selectors/$a/143] Read > [1566] bytes. > [DEBUG] [06/02/2015 18:13:09.346] [nrt-akka.actor.default-dispatcher-2] [ > akka.tcp://nrt@long-nrt-1:2551/system/IO-TCP/selectors/$a/143] Read > [5210] bytes. > [DEBUG] [06/02/2015 18:13:09.346] [nrt-akka.actor.default-dispatcher-20] [ > akka.tcp://nrt@long-nrt-1:2551/system/IO-TCP/selectors/$a/143] Read > [4344] bytes. > (snip) > [DEBUG] [06/02/2015 18:13:24.800] [nrt-akka.actor.default-dispatcher-27] [ > akka.tcp://nrt@long-nrt-1:2551/system/IO-TCP/selectors/$a/143] Read > [131072] bytes. > [DEBUG] [06/02/2015 18:13:24.800] [nrt-akka.actor.default-dispatcher-27] [ > akka.tcp://nrt@long-nrt-1:2551/system/IO-TCP/selectors/$a/143] Read > [131072] bytes. > [DEBUG] [06/02/2015 18: > ... -- >>>>>>>>>> Read the docs: http://akka.io/docs/ >>>>>>>>>> Check the FAQ: >>>>>>>>>> http://doc.akka.io/docs/akka/current/additional/faq.html >>>>>>>>>> Search the archives: https://groups.google.com/group/akka-user --- You received this message because you are subscribed to the Google Groups "Akka User List" group. To unsubscribe from this group and stop receiving emails from it, send an email to akka-user+unsubscr...@googlegroups.com. To post to this group, send email to akka-user@googlegroups.com. Visit this group at http://groups.google.com/group/akka-user. For more options, visit https://groups.google.com/d/optout.
