Kafka SimpleStringConsumer NPE

2016-09-03 Thread dbciar
Hello Everyone, I was wondering if anyone could help shed light on where I have introduced an error into my code to get the following error: java.lang.NullPointerException at java.lang.String.(String.java:556) at

Re: Memory Management in Streaming?

2016-09-03 Thread Jamie Grier
Hi Shaosu, Do you have an estimate on the total size of state you are keeping for the windows? How many messages/sec, how large a window, message size, etc would be good details to include. Also, which state backend are you using? Have you considered using the RocksDB state backend. This

Re: How to get latency info from benchmark

2016-09-03 Thread Eric Fukuda
I got the same error with this commit too. Weird :-( I will try picking the necessary classes. Thanks anyway. On Sat, Sep 3, 2016 at 7:41 AM, Robert Metzger wrote: > I also can't checkout the commit locally... which is weird, because GitHub > still seems to be able to

Re: How to get latency info from benchmark

2016-09-03 Thread Robert Metzger
I also can't checkout the commit locally... which is weird, because GitHub still seems to be able to somehow access it. Can you try this commit: df42160832ff65ae2a85b478d1dd0b398fa6ef3f ? I actually believe its probably easier to just pick the classes you need from the "benchmark" repository and

Re: Flink Kafka more consumers than partitions

2016-09-03 Thread neo21 zerro
Hi all,  It turns out that there were other factors influencing my performance tests. (actually hbase)Hence, more consumers than partitions in Flink was not the problem. Thanks for the help! On Wednesday, August 3, 2016 5:42 PM, neo21 zerro wrote: Hello,  I've

Re: Memory Management in Streaming?

2016-09-03 Thread Stefan Richter
Hi, the memory management described in this wiki page only applies to the batch api. The streaming api currently uses the Java heap, but we are strongly considering introducing managed memory for streaming as well. Best, Stefan > Am 02.09.2016 um 22:45 schrieb Shaosu Liu : > >