Looks like the producers lose the connection to the brokers.
Do the brokers have enough resources to handle all the producers? Does the
network support that throughput?
On Sun, 19 Jun 2016, 17:27 Avi Asulin, wrote:
> Hi
> We are using kafka 0.8.2 with scala 2.10 version
> We currently have 3 brokers and we are working with ~ 170 producers
> We frequently get the Error
>
> ERROR Closing socket for /170.144.181.50 because of error
> (kafka.network.Processor)
> java.io.IOException: Connection reset by peer
> at sun.nio.ch.FileDispatcherImpl.read0(Native Method)
> at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)
> at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:223)
> at sun.nio.ch.IOUtil.read(IOUtil.java:197)
> at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:384)
> at kafka.utils.Utils$.read(Utils.scala:380)
> at
>
> kafka.network.BoundedByteBufferReceive.readFrom(BoundedByteBufferReceive.scala:54)
> at kafka.network.Processor.read(SocketServer.scala:444)
> at kafka.network.Processor.run(SocketServer.scala:340)
> at java.lang.Thread.run(Thread.java:745)
>
> we get the error on many producers ips
> Can somone explain what can cause this error and what can be done to get
> rid of it?
>
> Thanks
> Avi
>
