[akka-user] Dokumentation inconsistency

Hi, i want to report a inconsisty of the akka documentation. the folloing class should be in akka http http://doc.akka.io/api/akka-stream-and-http-experimental/1.0-M2/index.html#akka.http.marshallers.sprayjson.SprayJsonSupport at least to the scaladoc documentation. Due to the javadoc documenta

Re: [akka-user] Re: How to Properly Manage Akka's Memory Usage with 40 Million Lines Task?

Allen, What are your constraints ? Does the output CSV have to maintain the order of the input file ? Do you have an upper bound ? I don't think you are CPU bound so you need to look at ways of reading/writing faster. Maybe async IO using nio can help. You can split the input and process in pa

Re: [akka-user] Re: How to Properly Manage Akka's Memory Usage with 40 Million Lines Task?

Hey Viktor, I'm trying to use Akka to parallelize this process. There shouldn't be any bottleneck, and I don't understand why I got memory overflow with my first version (actor version). The main task is to read in a line, break it up, and turn each segments (strings) into an integer, then

Re: [akka-user] TimeoutException when using tell on an ActorSelection if the target actor is created through AskSupport

On Friday, January 9, 2015 at 7:34:08 PM UTC+1, Patrik Nordwall wrote: > > > 9 jan 2015 kl. 18:10 skrev Ferdinand Hübner >: > > Yes, that is what I'm doing. I'm passing the sender() ActorRef to other > actors until I am able to reply to it with deliver. When I reply with > delivery, I call pat

Re: [akka-user] Re: How to Properly Manage Akka's Memory Usage with 40 Million Lines Task?

Hi Allen, What's the bottleneck? Have you tried enabling the experimental optimizations? On Fri, Jan 9, 2015 at 9:52 PM, Allen Nie wrote: > Thank you Soumya, > >I think Akka-streams is the way to go. However, I would also > appreciate some performance boost as well - still have 40 milli

Re: [akka-user] Re: UnboundedPriorityMailbox breaks message ordering?

On Fri, Jan 9, 2015 at 9:40 PM, David Hotham wrote: > Of course it's normal and expected that a PriorityQueue returns equal > priority elements in arbitrary order. That's just how heaps work. However > that doesn't imply that a mailbox has to do the same thing! > Absolutely, the reordering is

[akka-user] Re: How to Properly Manage Akka's Memory Usage with 40 Million Lines Task?

Thank you Soumya, I think Akka-streams is the way to go. However, I would also appreciate some performance boost as well - still have 40 million lines to go through! But thanks anyway! On Friday, January 9, 2015 at 12:43:49 PM UTC-5, Soumya Simanta wrote: > > I would recommend using th

Re: [akka-user] Re: UnboundedPriorityMailbox breaks message ordering?

Of course it's normal and expected that a PriorityQueue returns equal priority elements in arbitrary order. That's just how heaps work. However that doesn't imply that a mailbox has to do the same thing! For instance, I guess that it shouldn't be very hard for the mailbox to maintain a sequen

Re: [akka-user] Re: UnboundedPriorityMailbox breaks message ordering?

Hi David, yes, I can definitely understand that it can be surprising, but I wouldn't call it a bug -per se-, since it is not a promise that was violated. If you happen to have, or come by, a performant version of a PriorityQueue with the semantics you described, please don't hesitate to share it.

Re: [akka-user] Re: is this a sensible problem for persistence?

Hi Greg Well the history of ETA changes might be useful but certainly is never essential. On 9 January 2015 at 17:30, Greg Young wrote: > Its also very common to CALCULATE the ETA changes and raise them as events > without necessarily persisting them. > > As a thought experiment if your notific

[akka-user] akka-plugins: consolidate repositories under akka

request to external akka module authors: please vote +1 / -1 your opinion here: https://github.com/akka/akka/issues/16618 -- >> Read the docs: http://akka.io/docs/ >> Check the FAQ: >> http://doc.akka.io/docs/akka/current/additional/faq.html >> Sea

Re: [akka-user] TimeoutException when using tell on an ActorSelection if the target actor is created through AskSupport

> 9 jan 2015 kl. 18:10 skrev Ferdinand Hübner : > > Hi Patrik, > > thank you for the reply. > >> On Friday, January 9, 2015 at 9:49:40 AM UTC+1, Patrik Nordwall wrote: >> >> Let me try to understand your original problem. You send a request with ask >> to an Actor with AtLeastOnceDelivery. T

[akka-user] Re: UnboundedPriorityMailbox breaks message ordering?

It occurs to me that I wasn't completely clear: - Of course the priority mailbox must break message ordering in some general sense. Else it wouldn't be a priority mailbox at all! - But it is highly surprising to me that it should break ordering for messages of equal priority between

[akka-user] UnboundedPriorityMailbox breaks message ordering?

Hi, We've been tracking down a bug in which reading from a TCP stream was getting all messed up. It turns out that we see the problem only when our actor handling Tcp.Received messages is using an UnboundedPriorityMailbox; the default mailbox doesn't exhibit any problem. I believe that the i

[akka-user] Re: How to Properly Manage Akka's Memory Usage with 40 Million Lines Task?

I would recommend using the Akka-streams API for this. Here is sample. I was able to process a 1G file with around 1.5 million records in *20MB* of memory. The file read and the writing on the console rates are different but the streams API handles that. This is not the fastest but you at leas

[akka-user] Re: is this a sensible problem for persistence?

Its also very common to CALCULATE the ETA changes and raise them as events without necessarily persisting them. As a thought experiment if your notification system lost 1/1000 would it really matter? On Thursday, January 8, 2015 at 12:59:51 PM UTC+2, Tim Pigden wrote: > > Hmm - on reading o

Re: [akka-user] support for akka persistent plugins

We are close to having official support for the event store one (weeks time frame) On Friday, January 9, 2015 at 10:19:03 AM UTC+2, Patrik Nordwall wrote: > > Hi Tim, > > None of the external plugins are officially supported by Typesafe. You can > contact > Typesafe

Re: [akka-user] TimeoutException when using tell on an ActorSelection if the target actor is created through AskSupport

Hi Patrik, thank you for the reply. On Friday, January 9, 2015 at 9:49:40 AM UTC+1, Patrik Nordwall wrote: > > > Let me try to understand your original problem. You send a request with > ask to an Actor with AtLeastOnceDelivery. There you reply to the sender() > using the deliver method (and th

[akka-user] How to Properly Manage Akka's Memory Usage with 40 Million Lines Task?

Hi, I am trying to process a csv file with 40 million lines of data in there. It's a 5GB size file. I'm trying to use Akka to parallelize the task. However, it seems like I can't stop the quick memory growth. It expanded from 1GB to almost 15GB (the limit I set) under 5 minutes. This is

Re: [akka-user] Akka Persistence on the Query Side: The Conclusion

Maybe in 'The Reactive Manifesto' v3.0: The human user as an auxiliary part of a reactive system should be responsive, resilient, elastic and message-driven too. He may be the weakest link in the chain. W dniu piątek, 9 stycznia 2015 11:56:40 UTC+1 użytkownik Greg Young napisał: > > Usually it c

Re: [akka-user] Not loosing message due to remote actor unavailable.

http://doc.akka.io/docs/akka/2.3.8/common/cluster.html http://doc.akka.io/docs/akka/2.3.8/scala/cluster-usage.html http://doc.akka.io/docs/akka/2.3.8/java/cluster-usage.html On Fri, Jan 9, 2015 at 4:36 PM, Endre Varga wrote: > Hi Matan, > > On Fri, Jan 9, 2015 at 4:30 PM, Matan Safriel wrote:

Re: [akka-user] Not loosing message due to remote actor unavailable.

Hi Matan, On Fri, Jan 9, 2015 at 4:30 PM, Matan Safriel wrote: > Thanks, good to know! Does it include a leader election process for when > the leader isn't available? > >From the docs: "After gossip convergence a leader for the cluster can be determined. There is no leader election process, t

Re: [akka-user] Not loosing message due to remote actor unavailable.

Thanks, good to know! Does it include a leader election process for when the leader isn't available? I was not sure from the documentation whether the leader is a single point of failure, or its relationship to seed nodes. Maybe this should be a different thread. On Fri, Jan 9, 2015 at 5:15 PM, En

Re: [akka-user] Not loosing message due to remote actor unavailable.

Hi, On Fri, Jan 9, 2015 at 4:12 PM, Matan Safriel wrote: > Thanks Patrik, good to know, because the cluster module may seem like a > very specific and rather unfinished reference implementation; > What do you mean by unfinished reference implementation? It is a fully supported module of Akka.

Re: [akka-user] Not loosing message due to remote actor unavailable.

Thanks Patrik, good to know, because the cluster module may seem like a very specific and rather unfinished reference implementation; Good to have this in the core without relying on the cluster module. On Friday, January 9, 2015 at 11:25:30 AM UTC+2, Patrik Nordwall wrote: > > > > On Thu, Jan

Re: [akka-user] Re: File based mailbox - Files under _mb location grows large consistently without getting cleared

On Fri, Jan 9, 2015 at 9:35 AM, wrote: > Hi Jonas, > > Thanks for the reply. I can probably think of moving to Akka Persistence > for our current release project. But, it will be impossible to do it for > the previous version which is in production. > > Do we have any way to get it resolved i? We

Re: [akka-user] Re: Unordered merge of 2..n streams created by groupBy

Hi Tim, Thanks for your interest in contributing. That is of course welcome. Please start by creating an issue, if there is no one already. I don't know if the functionality or design needs any discussion, but that is something we can do in the issue. Base the pull request on branch release-2.3-de

Re: [akka-user] Deficiencies in actor testability?

Let us say that methodB is a call to an external service (preferable returning a Future, but that is irrelevant for the question). That external service is not valid in some test environments and therefore you want to stub it. Valid use case. There are several ways to solve that. For example: 1) b

Re: [akka-user] Not getting an "OnComplete" message for TCP Connection with Stream-M2 and Akka 2.3.7

Thanks for reporting. /Patrik On Wed, Jan 7, 2015 at 2:23 PM, Thomas Zimmer wrote: > Hi, > > i created a simple application ( > https://gist.github.com/Alien2150/9468c871135fd94869a2) to play around > with the SSL-Stream. But as soon as my client has been closed I am seeing > this log-message (w

[akka-user] Database Actor Read Model

Lots of database actor questions, but I couldn't find one that directly addressed data size limits: I want to send requests for data from a frontend to a Cluster Singleton which will forward each request to a Database Actor. The database actor runs query, then from the Row result constructs a d

Re: [akka-user] Akka Cluster node automatically joining.

Ah, excellent idea! Thanks for chiming in Patrik :-) —  Cheers, Konrad Malawski From: Patrik Nordwall Reply: akka-user@googlegroups.com > Date: January 9, 2015 at 12:10:08 PM To: akka-user@googlegroups.com > Cc: Bourne Toulouss > Subject:  Re: [akka-user] Akka Cluster node automatically joining.

Re: [akka-user] Akka Cluster node automatically joining.

On Fri, Jan 9, 2015 at 11:55 AM, Konrad Malawski < konrad.malaw...@typesafe.com> wrote: > Hi Bourne, > automatic joining keep retrying until successful. > > Since you have a very specific way you want this to happen, you should > drive the joining programatically, > refer to > http://doc.akka.io/d

Re: [akka-user] Akka Persistence on the Query Side: The Conclusion

On Fri, Jan 9, 2015 at 11:56 AM, Greg Young wrote: > Usually it comes down to the realization that the computer is not the book > of record. One of my favourites was being asked to build a fully consistent > inventory system. I generally like to approach things with questions, the > one i had was

Re: [akka-user] Akka Persistence on the Query Side: The Conclusion

Usually it comes down to the realization that the computer is not the book of record. One of my favourites was being asked to build a fully consistent inventory system. I generally like to approach things with questions, the one i had was 'sure but how do we get people who are stealing stuff to app

Re: [akka-user] Akka Cluster node automatically joining.

Hi Bourne, automatic joining keep retrying until successful. Since you have a very specific way you want this to happen, you should drive the joining programatically, refer to  http://doc.akka.io/docs/akka/current/scala/cluster-usage.html#joining-to-seed-nodes  for details on how to go about this

Re: [akka-user] Akka Persistence on the Query Side: The Conclusion

Thank you Greg. The mind shift from a preventive to a reactive workflow is not easy for users (humans), because it requires a change of habits. For many people computer systems are kind of authoritative. There is this wrong assumption (from early days of computation?) that a computer accepts on

Re: [akka-user] Not loosing message due to remote actor unavailable.

On Thu, Jan 8, 2015 at 9:56 PM, Matan Safriel wrote: > Sorry for awakening this old thread... > Is it really the case that there is all this fancy supervision > architecture, and then a remote actor that has gone non-responsive, needs > to be handled outside of the supervision hierarchy alltogeth

Re: [akka-user] Re: Actor lifecycle with regard to unresponsive actors

On Thu, Jan 8, 2015 at 9:37 PM, Matan Safriel wrote: > Thanks for the reminder. The Phi Accrual Failure Detector is nice, > although it is unfortunate that tuning the threshold is an art (see mention > of EC2 in http://doc.akka.io/docs/akka/snapshot/scala/remoting.html >

[akka-user] Akka Cluster node automatically joining.

Hi all, At the moment, i have a java application with akka that uses master and slave architecture. masters and workers starts randomly. I want it so if no master's been started yet, then worker will tryto join the cluster with seed nodes as the nodes that the masters reside for a number of time

Re: [akka-user] TimeoutException when using tell on an ActorSelection if the target actor is created through AskSupport

Hi Ferdinand, Let me try to understand your original problem. You send a request with ask to an Actor with AtLeastOnceDelivery. There you reply to the sender() using the deliver method (and the path of the sender()). Is that what you are doing? /Patrik On Wed, Jan 7, 2015 at 8:07 PM, Ferdinand

Re: [akka-user] Akka Cluster: consistent hashing with balancing?

Hi Hector, On Wed, Jan 7, 2015 at 4:29 PM, Héctor Veiga wrote: > Hello, > > I have a setup of 5 nodes running clustered using Akka Cluster (Akka > 2.3.7) and I am using a consistent-hashing router to spread the load among > all nodes. My consistent key is based on a String and I have verified th

Re: [akka-user] Re: File based mailbox - Files under _mb location grows large consistently without getting cleared

Hi Jonas, Thanks for the reply. I can probably think of moving to Akka Persistence for our current release project. But, it will be impossible to do it for the previous version which is in production. Do we have any way to get it resolved i? We are on 2.1.0-2.2.1. Regards, Anoop On Friday, Ja

Re: [akka-user] support for akka persistent plugins

Hi Tim, None of the external plugins are officially supported by Typesafe. You can contact Typesafe to discuss it and at least let Typesafe know that you would be interested in such support. I think geteventstore offers com

Re: [akka-user] Re: is this a sensible problem for persistence?

On Thu, Jan 8, 2015 at 11:59 AM, Tim Pigden wrote: > Hmm - on reading other threads and reflection I think I may have the wrong > model here. The information about the ETA is possibly not something that > should be persisted. It's not hard data. And perhaps my parcel should be > split between a p