Verified, I've started getting it consistently this morning after few more PTransform.
2016-07-06 12:27 GMT+02:00 Aljoscha Krettek <[email protected]>: > Strange, and you're saying you only sometimes get this exception? Not > reproducibly? > > On Wed, 6 Jul 2016 at 12:02 Pawel Szczur <[email protected]> wrote: > >> I have 8 cores. >> Just IDE. >> >> 2016-07-06 12:00 GMT+02:00 Aljoscha Krettek <[email protected]>: >> >>> Hi, >>> are you running this in an IDE or on an actual cluster? >>> >>> - >>> Aljoscha >>> >>> On Wed, 6 Jul 2016 at 11:57 Jean-Baptiste Onofré <[email protected]> >>> wrote: >>> >>>> Hi Pawel, >>>> >>>> I'm pretty sure that our Flink experts will answer. >>>> >>>> I'm assuming you are using a single JVM for Flink, right ? >>>> I think it could be related to Flink StreamExecutionEnvironment and the >>>> number of core on your machine. >>>> More your machine has cores, more you should increase the >>>> numberOfBuffers. >>>> >>>> Regards >>>> JB >>>> >>>> On 07/06/2016 11:26 AM, Pawel Szczur wrote: >>>> > When running my simple pipeline from time to time I'm getting below >>>> > exception: >>>> > >>>> > Caused by: java.io.IOException: Insufficient number of network >>>> buffers: >>>> > required 1, but only 0 available. The total number of network buffers >>>> is >>>> > currently set to 2048. You can increase this number by setting the >>>> > configuration key 'taskmanager.network.numberOfBuffers'. >>>> > at >>>> > org.apache.flink.runtime.io >>>> .network.buffer.NetworkBufferPool.createBufferPool(NetworkBufferPool.java:196) >>>> > at >>>> > org.apache.flink.runtime.io >>>> .network.NetworkEnvironment.registerTask(NetworkEnvironment.java:298) >>>> > at org.apache.flink.runtime.taskmanager.Task.run(Task.java:469) >>>> > at java.lang.Thread.run(Thread.java:745) >>>> > >>>> > >>>> > I'm using trunk of Beam with FlinkRunner. I guess it's well known >>>> Flink >>>> > problem? Idea how to prevent it? >>>> > >>>> > Pawel >>>> >>>> -- >>>> Jean-Baptiste Onofré >>>> [email protected] >>>> http://blog.nanthrax.net >>>> Talend - http://www.talend.com >>>> >>> >>
