Re: [akka-user] How to do shuffle in reactive stream

2014-07-21 Thread Dean Wampler
You can do this easily with Spark. The API is similar. dean On Mon, Jul 21, 2014 at 5:44 AM, Akka Team wrote: > Hi Sean, > > There is no such operation in the streams DSL. This setup is fairly > big-data specific which is outside the scope of Akka Streams. I imagine > that there will be people

Re: [akka-user] How to do shuffle in reactive stream

2014-07-21 Thread Akka Team
Hi Sean, There is no such operation in the streams DSL. This setup is fairly big-data specific which is outside the scope of Akka Streams. I imagine that there will be people writing such tools on top of Akka Streams though, but we have no plans to have this right now. Where Akka Streams can still

Re: [akka-user] How to do shuffle in reactive stream

2014-07-13 Thread Sean Zhong
Hi Martynas, I am trying to do a data shuffle between two layers. On the upstream, there are a layer with multiple actors. On the downstream, there are another layer with multiple actors. Each upstream actor will distribute the message flowed by it to all downstream actors, maybe groupped the me

Re: [akka-user] How to do shuffle in reactive stream

2014-07-11 Thread Martynas Mickevičius
Hi Sean, could you elaborate a bit mote what are you trying to do? On Thu, Jul 10, 2014 at 4:41 AM, Sean Zhong wrote: > > > > > > Take wordcount as an example, S is a list of files, > >

[akka-user] How to do shuffle in reactive stream

2014-07-10 Thread Sean Zhong
Take wordcount as an example, S is a list of files, Flow(S).foreach(fileName => val file = Source.fromFile(fileName) Flow(file.getLines()) .flatMap(splitWords) .groupB