Re: [akka-user] [reactive-kafka 0.9.0.1] Why is my use of reactive-kafka so slow on commit?

2016-04-03 Thread tigerfoot
I'll open a bug. Thanks for the tip about the async. I'm using a flow here because its a model for the much more complex flow I'll be using in my actual project. -- >> Read the docs: http://akka.io/docs/ >> Check the FAQ: >>

Re: [akka-user] [reactive-kafka 0.9.0.1] Why is my use of reactive-kafka so slow on commit?

2016-04-03 Thread Patrik Nordwall
The exception might be a bug. Please open an issue in https://github.com/akka/reactive-kafka You should use mapAsync for the commits. Otherwise you loose the backpressure. commit returns a Future. You don't need to use a graph for that simple flow, see the examples. /Patrik sön 3 apr. 2016 kl.

Re: [akka-user] [reactive-kafka 0.9.0.1] Why is my use of reactive-kafka so slow on commit?

2016-04-01 Thread tigerfoot
Thanks for this tip--I'll check these out! I know my timing methodology is brain-damaged, but I am applying it consistently so I can still get some rough comparative scope. My current clue is the pre-M1 code's manual commit. Kafka is apparently religious (and insistent) on maintaining

Re: [akka-user] [reactive-kafka 0.9.0.1] Why is my use of reactive-kafka so slow on commit?

2016-04-01 Thread tigerfoot
Using Streams 2.4.2. Streams isn't the problem. I can do a "hello world" stream w/o reactive-kafka and get 6-figure results. It's fast! -- >> Read the docs: http://akka.io/docs/ >> Check the FAQ: >> http://doc.akka.io/docs/akka/current/additional/faq.html

Re: [akka-user] [reactive-kafka 0.9.0.1] Why is my use of reactive-kafka so slow on commit?

2016-04-01 Thread Endre Varga
Also, what version of streams is this? There is no reason why the stream version could not produce 6 figure numbers, so something else is going on. Have you profiled it? -Endre On Fri, Apr 1, 2016 at 1:12 PM, Viktor Klang wrote: > Hi Greg, > > I don't know why the

Re: [akka-user] [reactive-kafka 0.9.0.1] Why is my use of reactive-kafka so slow on commit?

2016-04-01 Thread Viktor Klang
Hi Greg, I don't know why the performance is low in your example, but there are several problematic aspects of how you're measuring. For any benchmark on the JVM, plaese use JMH (for sbt projects, see sbt-jmh )

[akka-user] [reactive-kafka 0.9.0.1] Why is my use of reactive-kafka so slow on commit?

2016-03-31 Thread tigerfoot
Hello, I'm using a simple consumer pulled right out of the examples in the github repo: count = 0 val graph = GraphDSL.create(Consumer[Array[Byte], String](provider)) { implicit b => kafka => import GraphDSL.Implicits._ type In = ConsumerRecord[Array[Byte], String]