Re: Samza job throughput much lower than Kafka throughput

2015-05-22 Thread George Li
-performance, samza-version:0.9.0, version:0.0.1 } } From: Guozhang Wang wangg...@gmail.com To: dev@samza.apache.org, Date: 21/05/2015 05:46 PM Subject:Re: Samza job throughput much lower than Kafka throughput Hi George, How is the incoming traffic to your

Re: Samza job throughput much lower than Kafka throughput

2015-05-21 Thread George Li
...@gmail.com To: dev@samza.apache.org, Date: 21/05/2015 12:31 AM Subject:Re: Samza job throughput much lower than Kafka throughput Hi George, Is there any reason you need to set the following configs? systems.kafka.consumer.fetch.wait.max.ms= 1 This setting will basically disable long

Re: Samza job throughput much lower than Kafka throughput

2015-05-21 Thread George Li
:Re: Samza job throughput much lower than Kafka throughput Oops. Sent too soon. I mean: producer.batch.size=262144 producer.linger.ms=5 producer.compression.type=lz4 On Thu, May 21, 2015 at 9:00 AM, Roger Hoover roger.hoo...@gmail.com wrote: Hi George, You might also try tweaking

Re: Samza job throughput much lower than Kafka throughput

2015-05-21 Thread Roger Hoover
throughput much lower than Kafka throughput Hi, George, Could you share w/ us the code and configuration of your sample test job? Thanks! -Yi On Wed, May 20, 2015 at 1:19 PM, George Li g...@ca.ibm.com wrote: Hi, We are evaluating Samza's performance, and our sample