Re: [akka-user] akka-kafka-stream "Offset Storage in Kafka" question/clarification

2016-11-24 Thread Patrik Nordwall
On Thu, Nov 24, 2016 at 4:51 AM, Arun wrote: > Thanks Patrik. > > So am I safe to use mapAsync greater than 1 (>1) , still my offset will be > stored correctly? > yes > > what will happen if my stream fail/crash which offset will be processed.. > it will start from

Re: [akka-user] akka-kafka-stream "Offset Storage in Kafka" question/clarification

2016-11-23 Thread Arun
Thanks Patrik. So am I safe to use mapAsync greater than 1 (>1) , still my offset will be stored correctly? what will happen if my stream fail/crash which offset will be processed.. Thanks, Arun On Saturday, August 27, 2016 at 12:26:30 PM UTC+5:30, Patrik Nordwall wrote: > > The commit

Re: [akka-user] akka-kafka-stream "Offset Storage in Kafka" question/clarification

2016-08-27 Thread Patrik Nordwall
The commit commands are emitted to the underlying KafkaConsumer in right order. It is waiting for the results of the commits that are done in parallel, and will possibly increase total throughput. We observed better throughput in performance tests. It would be great to clarify this in docs. You

[akka-user] akka-kafka-stream "Offset Storage in Kafka" question/clarification

2016-08-26 Thread Drew Kutcharian
Hi, In the "Offset Storage in Kafka” on http://doc.akka.io/docs/akka-stream-kafka/current/consumer.html#offset-storage-in-kafka there is the following example: .groupedWithin(10, 5.seconds) .map(group