http://doc.akka.io/api/akka/2.4/?_ga=1.252408265.1579561034.1353497989#akka.stream.scaladsl.Partition
http://doc.akka.io/api/akka/2.4/?_ga=1.252408265.1579561034.1353497989#akka.stream.scaladsl.Merge On Wed, Aug 24, 2016 at 8:44 PM, Drew Kutcharian <d...@venarc.com> wrote: > Source class doesn’t have partition/merge functions. Am I missing > something? > > - Drew > > On Aug 24, 2016, at 1:08 AM, Viktor Klang <viktor.kl...@gmail.com> wrote: > > Partition + merge? > > On Wed, Aug 24, 2016 at 8:58 AM, Drew Kutcharian <d...@venarc.com> wrote: > >> Hi Guys, >> >> How can I do scatter-gather with Akka streams. Basically: >> >> 1. I’m reading messages from Kafka using akka-stream-kafka >> 2. Then I group the messages using “groupedWithin” >> 3. Then I need to split the resulting batch into multiple groups (1 per >> logical shard) >> 4. I want to be able to process the batches from step 3 concurrently >> 5. Once all the batches have been processed, I need to commit the last >> offset to Kafka >> >> I know I can do #3 using groupBy, but then I lose the ability to commit >> the last offset to Kafka. Is there an equivalence to Future.sequence or >> something similar in Akka Stream? >> >> Thanks, >> >> Drew >> >> -- >> >>>>>>>>>> Read the docs: http://akka.io/docs/ >> >>>>>>>>>> Check the FAQ: http://doc.akka.io/docs/akka/c >> urrent/additional/faq.html >> >>>>>>>>>> Search the archives: https://groups.google.com/grou >> p/akka-user >> --- >> You received this message because you are subscribed to the Google Groups >> "Akka User List" group. >> To unsubscribe from this group and stop receiving emails from it, send an >> email to akka-user+unsubscr...@googlegroups.com. >> To post to this group, send email to akka-user@googlegroups.com. >> Visit this group at https://groups.google.com/group/akka-user. >> For more options, visit https://groups.google.com/d/optout. >> > > > > -- > Cheers, > √ > > -- > >>>>>>>>>> Read the docs: http://akka.io/docs/ > >>>>>>>>>> Check the FAQ: http://doc.akka.io/docs/akka/ > current/additional/faq.html > >>>>>>>>>> Search the archives: https://groups.google.com/group/akka-user > --- > You received this message because you are subscribed to the Google Groups > "Akka User List" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to akka-user+unsubscr...@googlegroups.com. > To post to this group, send email to akka-user@googlegroups.com. > Visit this group at https://groups.google.com/group/akka-user. > For more options, visit https://groups.google.com/d/optout. > > > -- > >>>>>>>>>> Read the docs: http://akka.io/docs/ > >>>>>>>>>> Check the FAQ: http://doc.akka.io/docs/akka/ > current/additional/faq.html > >>>>>>>>>> Search the archives: https://groups.google.com/group/akka-user > --- > You received this message because you are subscribed to the Google Groups > "Akka User List" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to akka-user+unsubscr...@googlegroups.com. > To post to this group, send email to akka-user@googlegroups.com. > Visit this group at https://groups.google.com/group/akka-user. > For more options, visit https://groups.google.com/d/optout. > -- Cheers, √ -- >>>>>>>>>> Read the docs: http://akka.io/docs/ >>>>>>>>>> Check the FAQ: >>>>>>>>>> http://doc.akka.io/docs/akka/current/additional/faq.html >>>>>>>>>> Search the archives: https://groups.google.com/group/akka-user --- You received this message because you are subscribed to the Google Groups "Akka User List" group. To unsubscribe from this group and stop receiving emails from it, send an email to akka-user+unsubscr...@googlegroups.com. To post to this group, send email to akka-user@googlegroups.com. Visit this group at https://groups.google.com/group/akka-user. For more options, visit https://groups.google.com/d/optout.
