Hi,
I had a question about the max.message.size parameter. Does this apply to the
size of the messages after or before compression?
Also, I am using the async producer in kafka 0.7.2 and am seeing the following
spam in my logs when zookeeper fails:
2013-04-16 12:08:43,608 [Thread-10-SendThread(10.3.0.31:2181)] INFO
org.apache.zookeeper.ClientCnxn - Opening socket connection to server
10.3.0.30/10.3.0.30:2181
2013-04-16 12:08:43,618 [Thread-10-SendThread(10.3.0.30:2181)] WARN
org.apache.zookeeper.ClientCnxn - Session 0x3e10ca5f060024 for server null,
unexpected error, closing socket connection and attempting reconnect
java.net.ConnectException: Connection refused
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at
sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:567)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1125)
2013-04-16 12:08:43,708 [Thread-9-SendThread(10.3.0.31:2181)] INFO
org.apache.zookeeper.ClientCnxn - Opening socket connection to server
10.3.0.30/10.3.0.30:2181
2013-04-16 12:08:43,708 [Thread-9-SendThread(10.3.0.30:2181)] WARN
org.apache.zookeeper.ClientCnxn - Session 0x3e10ca5f060023 for server null,
unexpected error, closing socket connection and attempting reconnect
java.net.ConnectException: Connection refused
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at
sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:567)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1125)
2013-04-16 12:08:43,798 [Thread-9-SendThread(10.3.0.31:2181)] INFO
org.apache.zookeeper.ClientCnxn - Opening socket connection to server
10.3.0.32/10.3.0.32:2181
2013-04-16 12:08:43,808 [Thread-9-SendThread(10.3.0.32:2181)] WARN
org.apache.zookeeper.ClientCnxn - Session 0x13e10ca621a0002 for server null,
unexpected error, closing socket connection and attempting reconnect
java.net.ConnectException: Connection refused
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at
sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:567)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1125)
2013-04-16 12:08:44,298 [Thread-10-SendThread(10.3.0.31:2181)] INFO
org.apache.zookeeper.ClientCnxn - Opening socket connection to server
10.3.0.32/10.3.0.32:2181
2013-04-16 12:08:44,308 [Thread-10-SendThread(10.3.0.32:2181)] WARN
org.apache.zookeeper.ClientCnxn - Session 0x23e10ca5f0b0004 for server null,
unexpected error, closing socket connection and attempting reconnect
Is there any setting like a connection retry interval I can use to mitigate
having a ton of these messages dumped into the log?
-drew
