Could you maybe send me a minimal version of that such that I can reproduce it?
On Wed, 6 Jul 2016 at 12:29 Pawel Szczur <[email protected]> wrote: > Verified, I've started getting it consistently this morning after few > more PTransform. > > 2016-07-06 12:27 GMT+02:00 Aljoscha Krettek <[email protected]>: > >> Strange, and you're saying you only sometimes get this exception? Not >> reproducibly? >> >> On Wed, 6 Jul 2016 at 12:02 Pawel Szczur <[email protected]> wrote: >> >>> I have 8 cores. >>> Just IDE. >>> >>> 2016-07-06 12:00 GMT+02:00 Aljoscha Krettek <[email protected]>: >>> >>>> Hi, >>>> are you running this in an IDE or on an actual cluster? >>>> >>>> - >>>> Aljoscha >>>> >>>> On Wed, 6 Jul 2016 at 11:57 Jean-Baptiste Onofré <[email protected]> >>>> wrote: >>>> >>>>> Hi Pawel, >>>>> >>>>> I'm pretty sure that our Flink experts will answer. >>>>> >>>>> I'm assuming you are using a single JVM for Flink, right ? >>>>> I think it could be related to Flink StreamExecutionEnvironment and the >>>>> number of core on your machine. >>>>> More your machine has cores, more you should increase the >>>>> numberOfBuffers. >>>>> >>>>> Regards >>>>> JB >>>>> >>>>> On 07/06/2016 11:26 AM, Pawel Szczur wrote: >>>>> > When running my simple pipeline from time to time I'm getting below >>>>> > exception: >>>>> > >>>>> > Caused by: java.io.IOException: Insufficient number of network >>>>> buffers: >>>>> > required 1, but only 0 available. The total number of network >>>>> buffers is >>>>> > currently set to 2048. You can increase this number by setting the >>>>> > configuration key 'taskmanager.network.numberOfBuffers'. >>>>> > at >>>>> > org.apache.flink.runtime.io >>>>> .network.buffer.NetworkBufferPool.createBufferPool(NetworkBufferPool.java:196) >>>>> > at >>>>> > org.apache.flink.runtime.io >>>>> .network.NetworkEnvironment.registerTask(NetworkEnvironment.java:298) >>>>> > at org.apache.flink.runtime.taskmanager.Task.run(Task.java:469) >>>>> > at java.lang.Thread.run(Thread.java:745) >>>>> > >>>>> > >>>>> > I'm using trunk of Beam with FlinkRunner. I guess it's well known >>>>> Flink >>>>> > problem? Idea how to prevent it? >>>>> > >>>>> > Pawel >>>>> >>>>> -- >>>>> Jean-Baptiste Onofré >>>>> [email protected] >>>>> http://blog.nanthrax.net >>>>> Talend - http://www.talend.com >>>>> >>>> >>> >
