Re: [akka-user] Akka-Stream not truncating and failing

2015-11-05 Thread Martynas Mickevičius
> > a.) I use SynchronousFileSource(file, 1500), does changing *chunkSize* > will make differ huge difference in performance? As I understand (and could > be totally wrong), this is how much you read from file each time, right? > what is the motivation of keeping defaultChunkSize of 8192 > chunkSi

Re: [akka-user] Akka-Stream not truncating and failing

2015-10-11 Thread Harit Himanshu
During my search, I stumbled upon this place, where Adam Warski created a new ParseLinesStage. This worked for me but failed where we so a check for if (buffer.size > maximumLin

Re: [akka-user] Akka-Stream not truncating and failing

2015-10-11 Thread Harit Himanshu
Thanks Konrad This is insightful. In this case, I am not able to read through the entire longline and I asked a question where I am looking for guidance. Any help/recommendation is very much appreciated Thanks again On Sun, Oc

Re: [akka-user] Akka-Stream not truncating and failing

2015-10-11 Thread Konrad Malawski
Are there any performance issues with the seconds approach (scala.io.Source.fromFile(file).getLines()))? If I remember correctly 5 to 10 times slower than SynchronousFileSource, *and* the Source.fromFile used (like in the above) example leaks open FileInputStreams which you never close. Synchro

Re: [akka-user] Akka-Stream not truncating and failing

2015-10-11 Thread Harit Himanshu
Thanks Martynas I just wanted to check what is the difference between val source = Source.synchronousFile(file) and val source = scala.io.Source.fromFile(file).getLines()) (as this also returns Iterator) as I can use it as source.map(_.utf8String).runForeach(println) Are there any performan

Re: [akka-user] Akka-Stream not truncating and failing

2015-10-11 Thread Martynas Mickevičius
Hi Harit, according to the docs allowTruncation controls whether to fail the stream if the last upstream line does not contain a delimiter. The built-in delimiter framing

[akka-user] Akka-Stream not truncating and failing

2015-10-06 Thread Harit Himanshu
Hello there, I am new to Akka-Stream and working on a use case where I need to parse log files. These log files have lines separated by new line. I was looked at GroupLogFile.scala