Re: java.nio.channels.ClosedChannelException...Firewall Issue?

[Jaikiran Pai]

Hi Su,

How exactly did you start the Kafka server on instance "A"? Are you sure 
the services on it are bound to non localhost IP? What does the 
following command result from instance B:

telnet public.ip.of.A 9092


-Jaikiran
On Tuesday 20 January 2015 07:16 AM, Su She wrote:
Hello Everyone,

Thank you for the help!

Preface: I've created producers/consumers before and they have worked. I
have also made consumers/producers using java programs, but they have all
been locally.

1) I have a Zookeeper/Kafka Server running on an EC2 instance called "A"

2) I started the Zookeeper/Kafka Server on A and created a topic "test"
like it says on the kafka documentation

3) I then started a console consumer on A like the documentation states for
test.

4) I then downloaded Kafka on EC2 instance called "B" and created a console
producer with broker with broker-list public.ip.of.A:9092 and topic test.

5) Once I start publishing messages this is the message I get (what's worse
is that I can't cntrl C to stop and have to exit putty):

WARN Fetching topic metadata with correlation id 16 for topics [Set(test)]
from broker [id:0,host:54.183.40.224,port:9092] failed
(kafka.client.ClientUtils$)

java.nio.channels.ClosedChannelException

         at kafka.network.BlockingChannel.send(BlockingChannel.scala:97)

         at kafka.producer.SyncProducer.liftedTree1$1(SyncProducer.scala:74)

         at
kafka.producer.SyncProducer.kafka$producer$SyncProducer$$doSend(SyncProducer.scala:73)

         at kafka.producer.SyncProducer.send(SyncProducer.scala:114)

         at
kafka.client.ClientUtils$.fetchTopicMetadata(ClientUtils.scala:58)

         at
kafka.producer.BrokerPartitionInfo.updateInfo(BrokerPartitionInfo.scala:82)

         at
kafka.producer.async.DefaultEventHandler$$anonfun$handle$2.apply$mcV$sp(DefaultEventHandler.scala:78)

         at kafka.utils.Utils$.swallow(Utils.scala:172)

         at kafka.utils.Logging$class.swallowError(Logging.scala:106)

         at kafka.utils.Utils$.swallowError(Utils.scala:45)

         at
kafka.producer.async.DefaultEventHandler.handle(DefaultEventHandler.scala:78)

         at
kafka.producer.async.ProducerSendThread.tryToHandle(ProducerSendThread.scala:104)

         at
kafka.producer.async.ProducerSendThread.processEvents(ProducerSendThread.scala:93)

         at
kafka.producer.async.ProducerSendThread.run(ProducerSendThread.scala:44)

[2015-01-20 01:29:28,289] ERROR fetching topic metadata for topics
[Set(test)] from broker [ArrayBuffer(id:0,host:

Meanwhile in ZK...not sure if this happened as soon as I started publishing
messages:

Error:KeeperErrorCode = NoNode for /consumers/console-consumer-2615/offsets
(org.apache.zookeeper.server.PrepRequestProcessor)

Any tips/suggestions are greatly appreciated!