Thanks Endre. Ticket created https://github.com/akka/akka/issues/21020
Perhaps I mislead by using the word "elastic" in my subject. I just need "configurable". That said, why would I need consistent hashing? It seems that if I'm just preserving order within a channel by ensuring that all stream elements from a channel are sent to the same worker, channelId modulo n would suffice, no? Also, shouldn't there just be a partition() operator? On Fri, Jul 22, 2016 at 3:10 AM, Akka Team <akka.offic...@gmail.com> wrote: > > > On Fri, Jul 22, 2016 at 2:14 AM, Richard Rodseth <rrods...@gmail.com> > wrote: > >> Or perhaps you are talking about something like >> >> >> http://doc.akka.io/docs/akka/2.4.8/scala/stream/stream-cookbook.html#Balancing_jobs_to_a_fixed_pool_of_workers >> > > Yes > > >> >> but using the Partition stage instead of Balance >> > >> >> http://doc.akka.io/api/akka/2.4.7/?_ga=1.10841340.933910455.1454640777#akka.stream.scaladsl.Partition >> > > Exactly! > > >> >> which does not appear to be documented here >> >> >> http://doc.akka.io/docs/akka/2.4.8/scala/stream/stages-overview.html#Fan-out_stages >> > > > Meh, that is true. Please file a ticket (or even better, send a PR towards > us :) ). > > -Endre > > >> >> >> On Thu, Jul 21, 2016 at 10:00 AM, Richard Rodseth <rrods...@gmail.com> >> wrote: >> >>> Thanks. That gives me some terms to Google, but any further pointers >>> welcome. I see references to FlexiRoute being replaced by GraphStage. >>> Presumably that's what I need to study next? >>> >>> On Thu, Jul 21, 2016 at 12:59 AM, Viktor Klang <viktor.kl...@gmail.com> >>> wrote: >>> >>>> A routing stage with consistent hashing and then a N-Way merge to >>>> insert into db? >>>> >>>> -- >>>> Cheers, >>>> √ >>>> >>>> On Jul 20, 2016 9:09 PM, "Richard Rodseth" <rrods...@gmail.com> wrote: >>>> >>>>> I'm sure I've asked this before in numerous ways, but it's still an >>>>> issue for me. >>>>> >>>>> I have an ETL stream that reads per-channel data and writes it to a >>>>> destination without backpressure. Within a channel, order of writes must >>>>> be >>>>> preserved. So I want parallelism between channels, but not within. >>>>> >>>>> If I groupBy by channel, I can't control the degree of parallelism >>>>> and the destination is overwhelmed. >>>>> Should I make an ActorSubscriber for the write, that backpressures >>>>> (based on an integer value) and use alsoTo on the SubFlow? >>>>> >>>>> Any way to achieve this with standard components? >>>>> >>>>> -- >>>>> >>>>>>>>>> Read the docs: http://akka.io/docs/ >>>>> >>>>>>>>>> Check the FAQ: >>>>> http://doc.akka.io/docs/akka/current/additional/faq.html >>>>> >>>>>>>>>> Search the archives: >>>>> https://groups.google.com/group/akka-user >>>>> --- >>>>> You received this message because you are subscribed to the Google >>>>> Groups "Akka User List" group. >>>>> To unsubscribe from this group and stop receiving emails from it, send >>>>> an email to akka-user+unsubscr...@googlegroups.com. >>>>> To post to this group, send email to akka-user@googlegroups.com. >>>>> Visit this group at https://groups.google.com/group/akka-user. >>>>> For more options, visit https://groups.google.com/d/optout. >>>>> >>>> -- >>>> >>>>>>>>>> Read the docs: http://akka.io/docs/ >>>> >>>>>>>>>> Check the FAQ: >>>> http://doc.akka.io/docs/akka/current/additional/faq.html >>>> >>>>>>>>>> Search the archives: >>>> https://groups.google.com/group/akka-user >>>> --- >>>> You received this message because you are subscribed to the Google >>>> Groups "Akka User List" group. >>>> To unsubscribe from this group and stop receiving emails from it, send >>>> an email to akka-user+unsubscr...@googlegroups.com. >>>> To post to this group, send email to akka-user@googlegroups.com. >>>> Visit this group at https://groups.google.com/group/akka-user. >>>> For more options, visit https://groups.google.com/d/optout. >>>> >>> >>> >> -- >> >>>>>>>>>> Read the docs: http://akka.io/docs/ >> >>>>>>>>>> Check the FAQ: >> http://doc.akka.io/docs/akka/current/additional/faq.html >> >>>>>>>>>> Search the archives: https://groups.google.com/group/akka-user >> --- >> You received this message because you are subscribed to the Google Groups >> "Akka User List" group. >> To unsubscribe from this group and stop receiving emails from it, send an >> email to akka-user+unsubscr...@googlegroups.com. >> To post to this group, send email to akka-user@googlegroups.com. >> Visit this group at https://groups.google.com/group/akka-user. >> For more options, visit https://groups.google.com/d/optout. >> > > > > -- > Akka Team > Lightbend <http://www.lightbend.com/> - Reactive apps on the JVM > Twitter: @akkateam > > -- > >>>>>>>>>> Read the docs: http://akka.io/docs/ > >>>>>>>>>> Check the FAQ: > http://doc.akka.io/docs/akka/current/additional/faq.html > >>>>>>>>>> Search the archives: https://groups.google.com/group/akka-user > --- > You received this message because you are subscribed to the Google Groups > "Akka User List" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to akka-user+unsubscr...@googlegroups.com. > To post to this group, send email to akka-user@googlegroups.com. > Visit this group at https://groups.google.com/group/akka-user. > For more options, visit https://groups.google.com/d/optout. > -- >>>>>>>>>> Read the docs: http://akka.io/docs/ >>>>>>>>>> Check the FAQ: >>>>>>>>>> http://doc.akka.io/docs/akka/current/additional/faq.html >>>>>>>>>> Search the archives: https://groups.google.com/group/akka-user --- You received this message because you are subscribed to the Google Groups "Akka User List" group. To unsubscribe from this group and stop receiving emails from it, send an email to akka-user+unsubscr...@googlegroups.com. To post to this group, send email to akka-user@googlegroups.com. Visit this group at https://groups.google.com/group/akka-user. For more options, visit https://groups.google.com/d/optout.
