Hi, are you running this in an IDE or on an actual cluster? - Aljoscha
On Wed, 6 Jul 2016 at 11:57 Jean-Baptiste Onofré <[email protected]> wrote: > Hi Pawel, > > I'm pretty sure that our Flink experts will answer. > > I'm assuming you are using a single JVM for Flink, right ? > I think it could be related to Flink StreamExecutionEnvironment and the > number of core on your machine. > More your machine has cores, more you should increase the numberOfBuffers. > > Regards > JB > > On 07/06/2016 11:26 AM, Pawel Szczur wrote: > > When running my simple pipeline from time to time I'm getting below > > exception: > > > > Caused by: java.io.IOException: Insufficient number of network buffers: > > required 1, but only 0 available. The total number of network buffers is > > currently set to 2048. You can increase this number by setting the > > configuration key 'taskmanager.network.numberOfBuffers'. > > at > > org.apache.flink.runtime.io > .network.buffer.NetworkBufferPool.createBufferPool(NetworkBufferPool.java:196) > > at > > org.apache.flink.runtime.io > .network.NetworkEnvironment.registerTask(NetworkEnvironment.java:298) > > at org.apache.flink.runtime.taskmanager.Task.run(Task.java:469) > > at java.lang.Thread.run(Thread.java:745) > > > > > > I'm using trunk of Beam with FlinkRunner. I guess it's well known Flink > > problem? Idea how to prevent it? > > > > Pawel > > -- > Jean-Baptiste Onofré > [email protected] > http://blog.nanthrax.net > Talend - http://www.talend.com >
