Hi Christopher, Did you check Spark <http://spark.apache.org/> to do your batch operations. There processing/Transforming the data is cool. But two things to consider. How big is your data and second one is, Spark accepts input data either as Scala collections or in HDFS format.
But again you mentioned "The data is read and processed sequentially.".. so not sure if Spark will be of any help. thanks Kalidas On Wednesday, April 9, 2014 8:30:37 AM UTC+5:30, Christopher Helck wrote: > > I am new to Akka and am converting an existing program to use it. The > program reads a set of files, processes the data, and writes reports to 20 > files. The data is read and processed sequentially. It seems like a good > project to start with. > > I plan to offload the writing of the files to 20 Actors (they just write > incoming messages to their file -- they block) and my question is is this a > good plan? The mapping of threads to actors is not one to one, thus all of > these blocking actors may make my performance worse. > > Suggestions? > > Christopher Helck -- >>>>>>>>>> Read the docs: http://akka.io/docs/ >>>>>>>>>> Check the FAQ: >>>>>>>>>> http://doc.akka.io/docs/akka/current/additional/faq.html >>>>>>>>>> Search the archives: https://groups.google.com/group/akka-user --- You received this message because you are subscribed to the Google Groups "Akka User List" group. To unsubscribe from this group and stop receiving emails from it, send an email to akka-user+unsubscr...@googlegroups.com. To post to this group, send email to akka-user@googlegroups.com. Visit this group at http://groups.google.com/group/akka-user. For more options, visit https://groups.google.com/d/optout.
