[akka-user] Re: [akka-streams] Dynamically add route output port

2014-11-18 Thread Oscar Broman 
Some messages belong in more than one sub-stream - how would I accomplish 
that using groupBy?

On Sunday, November 16, 2014 1:42:48 AM UTC+1, Oscar Broman wrote:
>
> Hello!
>
> I've been messing around with akka-streams lately and ran into some 
> problems. I'm not sure where to go from this point.
>
> I have a TCP connection to an external data feed, in which I can subscribe 
> to a wide variety of real-time data. What exactly will be subscribed to 
> changes during runtime.
>
> Messages from the external feed can land in one or many actors, and these 
> actors have varying lifespans. Where the messages end up depend on their 
> type and different types of information inside them.
>
> How would I do this? From what I gather, using a FlexiRoute means I cannot 
> add output ports after it has been materialized.
>
> At one point the stream could look like this:
>
>  tcp io
>|
>   transform(chop at LF)
>|
> map(_.utf8String)
>|
>   map(FeedMessageParser(_)) // data is now Option(FeedMessage)
>|
>filter(_ != None)
>|
>   /|\
>  / | \
> /  |  \
>/   |   \
>   /|\
>  / | \
> /  |  \
>  TYPE=1  ID=3   TYPE=4,ID=4 // different prerequisites decide where the 
> data flows next
>|   |  / \
>|   | /   \
>|   | |   |
>|   | |   |
>|   | |   |
>   sub1 | |   |
>  sub2|   |
>sub3 sub4
>
>
> How do I do this best? Should I take a step back and look over my options, 
> or is there a way to tame the river?
>

-- 
>>  Read the docs: http://akka.io/docs/
>>  Check the FAQ: 
>> http://doc.akka.io/docs/akka/current/additional/faq.html
>>  Search the archives: https://groups.google.com/group/akka-user
--- 
You received this message because you are subscribed to the Google Groups "Akka 
User List" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to akka-user+unsubscr...@googlegroups.com.
To post to this group, send email to akka-user@googlegroups.com.
Visit this group at http://groups.google.com/group/akka-user.
For more options, visit https://groups.google.com/d/optout.

[akka-user] Re: [akka-streams] Dynamically add route output port

2014-11-21 Thread Oscar Broman 
Alright, I have created the issue 
here: https://github.com/akka/akka/issues/16363

Thank you for the replies.

On Sunday, November 16, 2014 1:42:48 AM UTC+1, Oscar Broman wrote:
>
> Hello!
>
> I've been messing around with akka-streams lately and ran into some 
> problems. I'm not sure where to go from this point.
>
> I have a TCP connection to an external data feed, in which I can subscribe 
> to a wide variety of real-time data. What exactly will be subscribed to 
> changes during runtime.
>
> Messages from the external feed can land in one or many actors, and these 
> actors have varying lifespans. Where the messages end up depend on their 
> type and different types of information inside them.
>
> How would I do this? From what I gather, using a FlexiRoute means I cannot 
> add output ports after it has been materialized.
>
> At one point the stream could look like this:
>
>  tcp io
>|
>   transform(chop at LF)
>|
> map(_.utf8String)
>|
>   map(FeedMessageParser(_)) // data is now Option(FeedMessage)
>|
>filter(_ != None)
>|
>   /|\
>  / | \
> /  |  \
>/   |   \
>   /|\
>  / | \
> /  |  \
>  TYPE=1  ID=3   TYPE=4,ID=4 // different prerequisites decide where the 
> data flows next
>|   |  / \
>|   | /   \
>|   | |   |
>|   | |   |
>|   | |   |
>   sub1 | |   |
>  sub2|   |
>sub3 sub4
>
>
> How do I do this best? Should I take a step back and look over my options, 
> or is there a way to tame the river?
>

-- 
>>  Read the docs: http://akka.io/docs/
>>  Check the FAQ: 
>> http://doc.akka.io/docs/akka/current/additional/faq.html
>>  Search the archives: https://groups.google.com/group/akka-user
--- 
You received this message because you are subscribed to the Google Groups "Akka 
User List" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to akka-user+unsubscr...@googlegroups.com.
To post to this group, send email to akka-user@googlegroups.com.
Visit this group at http://groups.google.com/group/akka-user.
For more options, visit https://groups.google.com/d/optout.

Re: [akka-user] Re: [akka-streams] Dynamically add route output port

2014-11-21 Thread Akka Team 
Hm... I think that by using smart grouping and fanouts you'd be able to
achieve this, but feels like we should perhaps think this one over with the
team on a larger scale.
Would you mind opening a ticket about a groupBy that an element can go into
multiple groups  please?

-- konrad

On Tue, Nov 18, 2014 at 4:59 PM, Oscar Broman 
wrote:

> Some messages belong in more than one sub-stream - how would I accomplish
> that using groupBy?
>
>
> On Sunday, November 16, 2014 1:42:48 AM UTC+1, Oscar Broman wrote:
>>
>> Hello!
>>
>> I've been messing around with akka-streams lately and ran into some
>> problems. I'm not sure where to go from this point.
>>
>> I have a TCP connection to an external data feed, in which I can
>> subscribe to a wide variety of real-time data. What exactly will be
>> subscribed to changes during runtime.
>>
>> Messages from the external feed can land in one or many actors, and these
>> actors have varying lifespans. Where the messages end up depend on their
>> type and different types of information inside them.
>>
>> How would I do this? From what I gather, using a FlexiRoute means I
>> cannot add output ports after it has been materialized.
>>
>> At one point the stream could look like this:
>>
>>  tcp io
>>|
>>   transform(chop at LF)
>>|
>> map(_.utf8String)
>>|
>>   map(FeedMessageParser(_)) // data is now Option(FeedMessage)
>>|
>>filter(_ != None)
>>|
>>   /|\
>>  / | \
>> /  |  \
>>/   |   \
>>   /|\
>>  / | \
>> /  |  \
>>  TYPE=1  ID=3   TYPE=4,ID=4 // different prerequisites decide where the
>> data flows next
>>|   |  / \
>>|   | /   \
>>|   | |   |
>>|   | |   |
>>|   | |   |
>>   sub1 | |   |
>>  sub2|   |
>>sub3 sub4
>>
>>
>> How do I do this best? Should I take a step back and look over my
>> options, or is there a way to tame the river?
>>
>  --
> >> Read the docs: http://akka.io/docs/
> >> Check the FAQ:
> http://doc.akka.io/docs/akka/current/additional/faq.html
> >> Search the archives: https://groups.google.com/group/akka-user
> ---
> You received this message because you are subscribed to the Google Groups
> "Akka User List" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to akka-user+unsubscr...@googlegroups.com.
> To post to this group, send email to akka-user@googlegroups.com.
> Visit this group at http://groups.google.com/group/akka-user.
> For more options, visit https://groups.google.com/d/optout.
>



-- 
Akka Team
Typesafe - The software stack for applications that scale
Blog: letitcrash.com
Twitter: @akkateam

-- 
>>  Read the docs: http://akka.io/docs/
>>  Check the FAQ: 
>> http://doc.akka.io/docs/akka/current/additional/faq.html
>>  Search the archives: https://groups.google.com/group/akka-user
--- 
You received this message because you are subscribed to the Google Groups "Akka 
User List" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to akka-user+unsubscr...@googlegroups.com.
To post to this group, send email to akka-user@googlegroups.com.
Visit this group at http://groups.google.com/group/akka-user.
For more options, visit https://groups.google.com/d/optout.

Re: [akka-user] Re: [akka-streams] Dynamically add route output port

2014-11-21 Thread Konrad 'ktoso' Malawski 
Thanks, we’ll look into it!

On 21 November 2014 at 16:35:23, Oscar Broman (oscar.bro...@gmail.com) wrote:

Alright, I have created the issue here: 
https://github.com/akka/akka/issues/16363

Thank you for the replies.

On Sunday, November 16, 2014 1:42:48 AM UTC+1, Oscar Broman wrote:
Hello!

I've been messing around with akka-streams lately and ran into some problems. 
I'm not sure where to go from this point.

I have a TCP connection to an external data feed, in which I can subscribe to a 
wide variety of real-time data. What exactly will be subscribed to changes 
during runtime.

Messages from the external feed can land in one or many actors, and these 
actors have varying lifespans. Where the messages end up depend on their type 
and different types of information inside them.

How would I do this? From what I gather, using a FlexiRoute means I cannot add 
output ports after it has been materialized.

At one point the stream could look like this:

         tcp io
           |
  transform(chop at LF)
           |
    map(_.utf8String)
           |
  map(FeedMessageParser(_)) // data is now Option(FeedMessage)
           |
   filter(_ != None)
           |
          /|\
         / | \
        /  |  \
       /   |   \
      /    |    \
     /     |     \
    /      |      \
 TYPE=1  ID=3   TYPE=4,ID=4 // different prerequisites decide where the data 
flows next
   |       |      / \
   |       |     /   \
   |       |     |   |
   |       |     |   |
   |       |     |   |
  sub1     |     |   |
         sub2    |   |
               sub3 sub4


How do I do this best? Should I take a step back and look over my options, or 
is there a way to tame the river?
--
>> Read the docs: http://akka.io/docs/
>> Check the FAQ: 
>> http://doc.akka.io/docs/akka/current/additional/faq.html
>> Search the archives: https://groups.google.com/group/akka-user
---
You received this message because you are subscribed to the Google Groups "Akka 
User List" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to akka-user+unsubscr...@googlegroups.com.
To post to this group, send email to akka-user@googlegroups.com.
Visit this group at http://groups.google.com/group/akka-user.
For more options, visit https://groups.google.com/d/optout.
-- 
Konrad 'ktoso' Malawski
hAkker @ typesafe
http://akka.io

-- 
>>  Read the docs: http://akka.io/docs/
>>  Check the FAQ: 
>> http://doc.akka.io/docs/akka/current/additional/faq.html
>>  Search the archives: https://groups.google.com/group/akka-user
--- 
You received this message because you are subscribed to the Google Groups "Akka 
User List" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to akka-user+unsubscr...@googlegroups.com.
To post to this group, send email to akka-user@googlegroups.com.
Visit this group at http://groups.google.com/group/akka-user.
For more options, visit https://groups.google.com/d/optout.