Hi hagersaleh,
You should know why the error occurred with large scale data. Broadcast
variables can handle only data of which size is fit for single machine.
I meant that using an external system such as Redis, HBase, …, etc. The
connection with the external system could be initialized in
Flavio,
It looks like your build is older than some recent fixes in that code.
https://github.com/apache/flink/commits/2e6e4de5d1d2b5123f4311493763fd84f52779ab/flink-runtime/src/main/java/org/apache/flink/runtime/operators/hash/MutableHashTable.java
Greg
On Fri, Sep 4, 2015 at 10:34 AM, Flavio
ah ok,
I'll try to force the update my maven dependencies!
Thanks for the support,
Flavio
On 5 Sep 2015 14:56, "Greg Hogan" wrote:
> Flavio,
>
> It looks like your build is older than some recent fixes in that code.
>
>
>
Hi Jerry,
it should be possible to just use the Redis API inside a Flink operator,
for example a map or flatMap. You can use RichFunctions (
https://ci.apache.org/projects/flink/flink-docs-master/apis/streaming_guide.html#rich-functions)
to setup the connection and close it after computation