Re: when use broadcast variable and run on bigdata display this error please help

2015-09-05 Thread Chiwan Park
Hi hagersaleh, You should know why the error occurred with large scale data. Broadcast variables can handle only data of which size is fit for single machine. I meant that using an external system such as Redis, HBase, …, etc. The connection with the external system could be initialized in

Re: BloomFilter Exception

2015-09-05 Thread Greg Hogan
Flavio, It looks like your build is older than some recent fixes in that code. https://github.com/apache/flink/commits/2e6e4de5d1d2b5123f4311493763fd84f52779ab/flink-runtime/src/main/java/org/apache/flink/runtime/operators/hash/MutableHashTable.java Greg On Fri, Sep 4, 2015 at 10:34 AM, Flavio

Re: BloomFilter Exception

2015-09-05 Thread Flavio Pompermaier
ah ok, I'll try to force the update my maven dependencies! Thanks for the support, Flavio On 5 Sep 2015 14:56, "Greg Hogan" wrote: > Flavio, > > It looks like your build is older than some recent fixes in that code. > > >

Re: Flink join with external source

2015-09-05 Thread Aljoscha Krettek
Hi Jerry, it should be possible to just use the Redis API inside a Flink operator, for example a map or flatMap. You can use RichFunctions ( https://ci.apache.org/projects/flink/flink-docs-master/apis/streaming_guide.html#rich-functions) to setup the connection and close it after computation