Re: LeaderNotAvailable Exception
FO Property auto.offset.reset is overridden > > to > > > smallest (kafka.utils.VerifiablePr > > > [2013-04-25 10:08:55,547] INFO Property socket.receive.buffer.bytes is > > > overridden to 2097152 (kafka.utils.Ver > > > erties) > > > [2013-04-25 10:08:55,547] INFO Property fetch.wait.max.ms is > overridden > > to > > > 100 (kafka.utils.VerifiablePropert > > > [2013-04-25 10:08:55,547] INFO Property auto.commit.enable is > overridden > > to > > > true (kafka.utils.VerifiablePrope > > > [2013-04-25 10:08:55,547] INFO Property auto.commit.interval.ms is > > > overridden to 1 (kafka.utils.Verifiabl > > > ) > > > [2013-04-25 10:08:55,547] INFO Property fetch.min.bytes is overridden > to > > 1 > > > (kafka.utils.VerifiableProperties) > > > [2013-04-25 10:08:55,562] INFO > > > [console-consumer-70983_YIYIN-MAIN-1366909735562-a3d9410c], Connecting > to > > > zook > > > nce at localhost:2181 (kafka.consumer.ZookeeperConsumerConnector) > > > [2013-04-25 10:08:55,562] INFO Starting ZkClient event thread. > > > (org.I0Itec.zkclient.ZkEventThread) > > > [2013-04-25 10:08:55,578] INFO Client > > > environment:zookeeper.version=3.3.3-1203054, built on 11/17/2011 05:47 > > > ache.zookeeper.ZooKeeper) > > > [2013-04-25 10:08:55,578] INFO Client > > > environment:host.name=YIYIN-MAIN.redmond.corp.microsoft.com(org.apache > > > ZooKeeper) > > > [2013-04-25 10:08:55,578] INFO Client environment:java.version=1.7.0_21 > > > (org.apache.zookeeper.ZooKeeper) > > > [2013-04-25 10:08:55,578] INFO Client environment:java.vendor=Oracle > > > Corporation (org.apache.zookeeper.ZooKee > > > [2013-04-25 10:08:55,578] INFO Client environment:java.home=C:\Program > > > Files > > > (x86)\Java\jdk1.7.0_21\jre (org. > > > eeper.ZooKeeper) > > > [2013-04-25 10:08:55,578] INFO Client > > > environment:java.io.tmpdir=C:\Users\yiyin\AppData\Local\Temp\ (org.apac > > > r.ZooKeeper) > > > [2013-04-25 10:08:55,578] INFO Client environment:java.compiler= > > > (org.apache.zookeeper.ZooKeeper) > > > [2013-04-25 10:08:55,578] INFO Client environment:os.name=Windows 8 > > > (org.apache.zookeeper.ZooKeeper) > > > [2013-04-25 10:08:55,578] INFO Client environment:os.arch=x86 > > > (org.apache.zookeeper.ZooKeeper) > > > [2013-04-25 10:08:55,578] INFO Client environment:os.version=6.2 > > > (org.apache.zookeeper.ZooKeeper) > > > [2013-04-25 10:08:55,578] INFO Client environment:user.name=yiyin > > > (org.apache.zookeeper.ZooKeeper) > > > [2013-04-25 10:08:55,578] INFO Client > > environment:user.home=C:\Users\yiyin > > > (org.apache.zookeeper.ZooKeeper) > > > [2013-04-25 10:08:55,578] INFO Client > > > environment:user.dir=C:\Projects\Kafka\kafka\bin (org.apache.zookeeper. > > > [2013-04-25 10:08:55,578] INFO Initiating client connection, > > > connectString=localhost:2181 sessionTimeout=6000 > > > g.I0Itec.zkclient.ZkClient@1124f52 (org.apache.zookeeper.ZooKeeper) > > > [2013-04-25 10:08:55,594] INFO Opening socket connection to server > > > localhost/127.0.0.1:2181 (org.apache.zooke > > > Cnxn) > > > [2013-04-25 10:08:55,594] INFO Socket connection established to > > > localhost/127.0.0.1:2181, initiating session > > > .zookeeper.ClientCnxn) > > > [2013-04-25 10:08:55,672] INFO Session establishment complete on server > > > localhost/127.0.0.1:2181, sessionid = > > > f620001, negotiated timeout = 6000 (org.apache.zookeeper.ClientCnxn) > > > [2013-04-25 10:08:55,672] INFO zookeeper state changed (SyncConnected) > > > (org.I0Itec.zkclient.ZkClient) > > > [2013-04-25 10:08:55,672] INFO > > > [console-consumer-70983_YIYIN-MAIN-1366909735562-a3d9410c], starting > auto > > > comm > > > 1 ms (kafka.consumer.ZookeeperConsumerConnector) > > > [2013-04-25 10:08:55,687] INFO Initiating client connection, > > > connectString=localhost:2181 sessionTimeout=3000 > > > rg.I0Itec.zkclient.ZkClient@13033a (org.apache.zookeeper.ZooKeeper) > > > [2013-04-25 10:08:55,687] INFO Starting ZkClient event thread. > > > (org.I0Itec.zkclient.ZkEventThread) > > > [2013-04-25 10:08:55,687] INFO Opening socket connection to server > > > localhost/127.0.0.1:2181 (org.apache.zooke > > > Cnxn) > > > [2013-04-25 10:08:55,687] INFO Socket connection established to > > > localhost/127.0.0.1:2181, initiating session > > > .zookeeper
Re: LeaderNotAvailable Exception
t;> > [2013-04-25 10:08:55,547] INFO Property auto.commit.interval.ms is >> > overridden to 1 (kafka.utils.Verifiabl >> > ) >> > [2013-04-25 10:08:55,547] INFO Property fetch.min.bytes is overridden >> to 1 >> > (kafka.utils.VerifiableProperties) >> > [2013-04-25 10:08:55,562] INFO >> > [console-consumer-70983_YIYIN-MAIN-1366909735562-a3d9410c], Connecting >> to >> > zook >> > nce at localhost:2181 (kafka.consumer.ZookeeperConsumerConnector) >> > [2013-04-25 10:08:55,562] INFO Starting ZkClient event thread. >> > (org.I0Itec.zkclient.ZkEventThread) >> > [2013-04-25 10:08:55,578] INFO Client >> > environment:zookeeper.version=3.3.3-1203054, built on 11/17/2011 05:47 >> > ache.zookeeper.ZooKeeper) >> > [2013-04-25 10:08:55,578] INFO Client >> > environment:host.name=YIYIN-MAIN.redmond.corp.microsoft.com (org.apache >> > ZooKeeper) >> > [2013-04-25 10:08:55,578] INFO Client environment:java.version=1.7.0_21 >> > (org.apache.zookeeper.ZooKeeper) >> > [2013-04-25 10:08:55,578] INFO Client environment:java.vendor=Oracle >> > Corporation (org.apache.zookeeper.ZooKee >> > [2013-04-25 10:08:55,578] INFO Client environment:java.home=C:\Program >> > Files >> > (x86)\Java\jdk1.7.0_21\jre (org. >> > eeper.ZooKeeper) >> > [2013-04-25 10:08:55,578] INFO Client >> > environment:java.io.tmpdir=C:\Users\yiyin\AppData\Local\Temp\ (org.apac >> > r.ZooKeeper) >> > [2013-04-25 10:08:55,578] INFO Client environment:java.compiler= >> > (org.apache.zookeeper.ZooKeeper) >> > [2013-04-25 10:08:55,578] INFO Client environment:os.name=Windows 8 >> > (org.apache.zookeeper.ZooKeeper) >> > [2013-04-25 10:08:55,578] INFO Client environment:os.arch=x86 >> > (org.apache.zookeeper.ZooKeeper) >> > [2013-04-25 10:08:55,578] INFO Client environment:os.version=6.2 >> > (org.apache.zookeeper.ZooKeeper) >> > [2013-04-25 10:08:55,578] INFO Client environment:user.name=yiyin >> > (org.apache.zookeeper.ZooKeeper) >> > [2013-04-25 10:08:55,578] INFO Client >> environment:user.home=C:\Users\yiyin >> > (org.apache.zookeeper.ZooKeeper) >> > [2013-04-25 10:08:55,578] INFO Client >> > environment:user.dir=C:\Projects\Kafka\kafka\bin (org.apache.zookeeper. >> > [2013-04-25 10:08:55,578] INFO Initiating client connection, >> > connectString=localhost:2181 sessionTimeout=6000 >> > g.I0Itec.zkclient.ZkClient@1124f52 (org.apache.zookeeper.ZooKeeper) >> > [2013-04-25 10:08:55,594] INFO Opening socket connection to server >> > localhost/127.0.0.1:2181 (org.apache.zooke >> > Cnxn) >> > [2013-04-25 10:08:55,594] INFO Socket connection established to >> > localhost/127.0.0.1:2181, initiating session >> > .zookeeper.ClientCnxn) >> > [2013-04-25 10:08:55,672] INFO Session establishment complete on server >> > localhost/127.0.0.1:2181, sessionid = >> > f620001, negotiated timeout = 6000 (org.apache.zookeeper.ClientCnxn) >> > [2013-04-25 10:08:55,672] INFO zookeeper state changed (SyncConnected) >> > (org.I0Itec.zkclient.ZkClient) >> > [2013-04-25 10:08:55,672] INFO >> > [console-consumer-70983_YIYIN-MAIN-1366909735562-a3d9410c], starting >> auto >> > comm >> > 1 ms (kafka.consumer.ZookeeperConsumerConnector) >> > [2013-04-25 10:08:55,687] INFO Initiating client connection, >> > connectString=localhost:2181 sessionTimeout=3000 >> > rg.I0Itec.zkclient.ZkClient@13033a (org.apache.zookeeper.ZooKeeper) >> > [2013-04-25 10:08:55,687] INFO Starting ZkClient event thread. >> > (org.I0Itec.zkclient.ZkEventThread) >> > [2013-04-25 10:08:55,687] INFO Opening socket connection to server >> > localhost/127.0.0.1:2181 (org.apache.zooke >> > Cnxn) >> > [2013-04-25 10:08:55,687] INFO Socket connection established to >> > localhost/127.0.0.1:2181, initiating session >> > .zookeeper.ClientCnxn) >> > [2013-04-25 10:08:55,687] INFO Session establishment complete on server >> > localhost/127.0.0.1:2181, sessionid = >> > f620002, negotiated timeout = 3 (org.apache.zookeeper.ClientCnxn) >> > [2013-04-25 10:08:55,687] INFO zookeeper state changed (SyncConnected) >> > (org.I0Itec.zkclient.ZkClient) >> > [2013-04-25 10:08:55,703] INFO Terminate ZkClient event thread. >> > (org.I0Itec.zkclient.ZkEventThread) >> > [2013-04-25 10:08:55,703] INFO Session: 0x13e422b2f620002 closed >> > (org.apache.zookeeper.ZooKeeper) >> > [2013-04-25 10:08:55,703] INFO E
Re: LeaderNotAvailable Exception
0 > > g.I0Itec.zkclient.ZkClient@1124f52 (org.apache.zookeeper.ZooKeeper) > > [2013-04-25 10:08:55,594] INFO Opening socket connection to server > > localhost/127.0.0.1:2181 (org.apache.zooke > > Cnxn) > > [2013-04-25 10:08:55,594] INFO Socket connection established to > > localhost/127.0.0.1:2181, initiating session > > .zookeeper.ClientCnxn) > > [2013-04-25 10:08:55,672] INFO Session establishment complete on server > > localhost/127.0.0.1:2181, sessionid = > > f620001, negotiated timeout = 6000 (org.apache.zookeeper.ClientCnxn) > > [2013-04-25 10:08:55,672] INFO zookeeper state changed (SyncConnected) > > (org.I0Itec.zkclient.ZkClient) > > [2013-04-25 10:08:55,672] INFO > > [console-consumer-70983_YIYIN-MAIN-1366909735562-a3d9410c], starting auto > > comm > > 1 ms (kafka.consumer.ZookeeperConsumerConnector) > > [2013-04-25 10:08:55,687] INFO Initiating client connection, > > connectString=localhost:2181 sessionTimeout=3000 > > rg.I0Itec.zkclient.ZkClient@13033a (org.apache.zookeeper.ZooKeeper) > > [2013-04-25 10:08:55,687] INFO Starting ZkClient event thread. > > (org.I0Itec.zkclient.ZkEventThread) > > [2013-04-25 10:08:55,687] INFO Opening socket connection to server > > localhost/127.0.0.1:2181 (org.apache.zooke > > Cnxn) > > [2013-04-25 10:08:55,687] INFO Socket connection established to > > localhost/127.0.0.1:2181, initiating session > > .zookeeper.ClientCnxn) > > [2013-04-25 10:08:55,687] INFO Session establishment complete on server > > localhost/127.0.0.1:2181, sessionid = > > f620002, negotiated timeout = 3 (org.apache.zookeeper.ClientCnxn) > > [2013-04-25 10:08:55,687] INFO zookeeper state changed (SyncConnected) > > (org.I0Itec.zkclient.ZkClient) > > [2013-04-25 10:08:55,703] INFO Terminate ZkClient event thread. > > (org.I0Itec.zkclient.ZkEventThread) > > [2013-04-25 10:08:55,703] INFO Session: 0x13e422b2f620002 closed > > (org.apache.zookeeper.ZooKeeper) > > [2013-04-25 10:08:55,703] INFO EventThread shut down > > (org.apache.zookeeper.ClientCnxn) > > [2013-04-25 10:08:55,734] INFO > > [console-consumer-70983_YIYIN-MAIN-1366909735562-a3d9410c], begin > > registering > > nsole-consumer-70983_YIYIN-MAIN-1366909735562-a3d9410c in ZK > > (kafka.consumer.ZookeeperConsumerConnector) > > [2013-04-25 10:08:55,750] INFO > > [console-consumer-70983_YIYIN-MAIN-1366909735562-a3d9410c], end > registering > > co > > ole-consumer-70983_YIYIN-MAIN-1366909735562-a3d9410c in ZK > > (kafka.consumer.ZookeeperConsumerConnector) > > [2013-04-25 10:08:55,750] INFO > > [console-consumer-70983_YIYIN-MAIN-1366909735562-a3d9410c], starting > > watcher > > e > > ead for consumer console-consumer-70983_YIYIN-MAIN-1366909735562-a3d9410c > > (kafka.consumer.ZookeeperConsumerCo > > [2013-04-25 10:08:55,766] INFO > > [console-consumer-70983_YIYIN-MAIN-1366909735562-a3d9410c], begin > > rebalancing > > nsole-consumer-70983_YIYIN-MAIN-1366909735562-a3d9410c try #0 > > (kafka.consumer.ZookeeperConsumerConnector) > > [2013-04-25 10:08:55,891] INFO Verifying properties > > (kafka.utils.VerifiableProperties) > > [2013-04-25 10:08:55,906] INFO Property broker.list is overridden to > > YIYIN-MAIN.redmond.corp.microsoft.com:90 > > tils.VerifiableProperties) > > [2013-04-25 10:08:55,906] INFO Property request.timeout.ms is overridden > > to > > 3 (kafka.utils.VerifiableProp > > [2013-04-25 10:08:55,906] INFO Property client.id is overridden to > > console-consumer-70983 (kafka.utils.Verifi > > ies) > > [2013-04-25 10:08:55,922] INFO Fetching metadata with correlation id 0 > for > > 0 > > topic(s) Set() (kafka.client.Cli > > [2013-04-25 10:08:55,922] INFO Connected to > > YIYIN-MAIN.redmond.corp.microsoft.com:9092 for producing (kafka.p > > cProducer) > > [2013-04-25 10:08:55,969] INFO Disconnecting from > > YIYIN-MAIN.redmond.corp.microsoft.com:9092 (kafka.producer. > > r) > > [2013-04-25 10:08:55,969] INFO [ConsumerFetcherManager-1366909735672] > > Stopping leader finder thread (kafka.co > > umerFetcherManager) > > [2013-04-25 10:08:55,969] INFO [ConsumerFetcherManager-1366909735672] > > Stopping all fetchers (kafka.consumer.C > > herManager) > > [2013-04-25 10:08:55,969] INFO [ConsumerFetcherManager-1366909735672] All > > connections stopped (kafka.consumer > > tcherManager) > > [2013-04-25 10:08:55,969] INFO > > [console-consumer-70983_YIYIN-MAIN-1366909735562-a3d9410c], Cleared all > > releva > > or this fetcher (kafka.consumer.ZookeeperConsumerConnector) > > [2013-04-25 10:08:55,969] INFO > > [console-consumer-70983_YIYIN-MAIN-1366909735562-a3d9410c], Cleared the > > data > > c > > l the consumer message iterators > > (kafka.consumer.ZookeeperConsumerConnector) > > [2013-04-25 10:08:55,969] INFO > > [console-consumer-70983_YIYIN-MAIN-1366909735562-a3d9410c], Committing > all > > off > > clearing the fetcher queues (kafka.consumer.ZookeeperConsumerConnector) > > [2013-04-25 10:08:55,969] INFO > > [console-consumer-70983_YIYIN-MAIN-1366909735562-a3d9410c], Releasing > > partitio > > (kafka.consumer.ZookeeperConsumerConnector) > > [2013-04-25 10:08:55,984] INFO > > [console-consumer-70983_YIYIN-MAIN-1366909735562-a3d9410c], Updating the > > cache > > sumer.ZookeeperConsumerConnector) > > [2013-04-25 10:08:55,984] INFO > > [console-consumer-70983_YIYIN-MAIN-1366909735562-a3d9410c], Consumer > > console-c > > 83_YIYIN-MAIN-1366909735562-a3d9410c selected partitions : > > (kafka.consumer.ZookeeperConsumerConnector) > > [2013-04-25 10:08:55,984] INFO > > > > > [console-consumer-70983_YIYIN-MAIN-1366909735562-a3d9410c-leader-finder-thre > > ad > > (kafka.consumer.ConsumerFetcherManager$LeaderFinderThread) > > [2013-04-25 10:08:55,984] INFO > > [console-consumer-70983_YIYIN-MAIN-1366909735562-a3d9410c], end > rebalancing > > co > > ole-consumer-70983_YIYIN-MAIN-1366909735562-a3d9410c try #0 > > (kafka.consumer.ZookeeperConsumerConnector) > > [2013-04-25 10:08:55,984] INFO > > [console-consumer-70983_YIYIN-MAIN-1366909735562-a3d9410c], Not creating > > event > > r trivial whitelist test (kafka.consumer.ZookeeperConsumerConnector) > > > > > > > > -Original Message- > > From: Jun Rao [mailto:jun...@gmail.com] > > Sent: Thursday, April 25, 2013 7:21 AM > > To: users@kafka.apache.org > > Subject: Re: LeaderNotAvailable Exception > > > > Hmm, then it's weird. Could you try the latest code in 0.8? If the > problem > > persists, could you file a jira and attach the broker log? > > > > Thanks, > > > > Jun > > > > > > On Wed, Apr 24, 2013 at 11:00 PM, Yin Yin wrote: > > > > > With the option --unavailable-partitions --topic topic1, > > > kafka-list-topic doesn't show anything related to topic1> Date: Wed, > > > 24 Apr 2013 20:58:09 > > > -0700 > > > > Subject: Re: LeaderNotAvailable Exception > > > > From: jun...@gmail.com > > > > To: users@kafka.apache.org > > > > > > > > What output do you get if you add the --unavailable-partitions > > > > option in list topic? > > > > > > > > Thanks, > > > > > > > > Jun > > > > > > > > > > > > On Wed, Apr 24, 2013 at 5:20 PM, Yin Yin > wrote: > > > > > > > > > This exception happens only once. But there is another error for > > > > > each producer request > > > > > [2013-04-24 14:47:39,077] WARN [KafkaApi-0] Produce request: > > > > > Leader > > > not > > > > > local for partition [topic1,0] on broker 0 > > > > > (kafka.server.KafkaApis) > > > Here > > > > > is the information I get from kafka-list-topic, which indicates > > > > > that > > > > > borker0 is the leader for topic1 and partition 0 [2013-04-24 > > > 14:56:03,948] > > > > > INFO zookeeper state changed (SyncConnected) > > > (org.I0Itec.zkclient.ZkClient) > > > > > topic: topic1 partition: 0leader: 0 replicas: 0 > isr: > > 0 > > > > > > > > > From: libo...@citi.com > > > > > > To: users@kafka.apache.org > > > > > > Subject: Re: LeaderNotAvailable Exception > > > > > > Date: Wed, 24 Apr 2013 17:38:23 + > > > > > > > > > > > > Hi Jun, > > > > > > > > > > > > This exception also gave me a hard time. In my case, I didn't > > > > > > create > > > the > > > > > topic > > > > > > before using it for producing. > > > > > > > > > > > > Regards, > > > > > > > > > > > > Libo > > > > > > > > > > > > > > > > > > > > > > > > >
Re: LeaderNotAvailable Exception
eProperties) > [2013-04-25 10:08:55,906] INFO Property broker.list is overridden to > YIYIN-MAIN.redmond.corp.microsoft.com:90 > tils.VerifiableProperties) > [2013-04-25 10:08:55,906] INFO Property request.timeout.ms is overridden > to > 3 (kafka.utils.VerifiableProp > [2013-04-25 10:08:55,906] INFO Property client.id is overridden to > console-consumer-70983 (kafka.utils.Verifi > ies) > [2013-04-25 10:08:55,922] INFO Fetching metadata with correlation id 0 for > 0 > topic(s) Set() (kafka.client.Cli > [2013-04-25 10:08:55,922] INFO Connected to > YIYIN-MAIN.redmond.corp.microsoft.com:9092 for producing (kafka.p > cProducer) > [2013-04-25 10:08:55,969] INFO Disconnecting from > YIYIN-MAIN.redmond.corp.microsoft.com:9092 (kafka.producer. > r) > [2013-04-25 10:08:55,969] INFO [ConsumerFetcherManager-1366909735672] > Stopping leader finder thread (kafka.co > umerFetcherManager) > [2013-04-25 10:08:55,969] INFO [ConsumerFetcherManager-1366909735672] > Stopping all fetchers (kafka.consumer.C > herManager) > [2013-04-25 10:08:55,969] INFO [ConsumerFetcherManager-1366909735672] All > connections stopped (kafka.consumer > tcherManager) > [2013-04-25 10:08:55,969] INFO > [console-consumer-70983_YIYIN-MAIN-1366909735562-a3d9410c], Cleared all > releva > or this fetcher (kafka.consumer.ZookeeperConsumerConnector) > [2013-04-25 10:08:55,969] INFO > [console-consumer-70983_YIYIN-MAIN-1366909735562-a3d9410c], Cleared the > data > c > l the consumer message iterators > (kafka.consumer.ZookeeperConsumerConnector) > [2013-04-25 10:08:55,969] INFO > [console-consumer-70983_YIYIN-MAIN-1366909735562-a3d9410c], Committing all > off > clearing the fetcher queues (kafka.consumer.ZookeeperConsumerConnector) > [2013-04-25 10:08:55,969] INFO > [console-consumer-70983_YIYIN-MAIN-1366909735562-a3d9410c], Releasing > partitio > (kafka.consumer.ZookeeperConsumerConnector) > [2013-04-25 10:08:55,984] INFO > [console-consumer-70983_YIYIN-MAIN-1366909735562-a3d9410c], Updating the > cache > sumer.ZookeeperConsumerConnector) > [2013-04-25 10:08:55,984] INFO > [console-consumer-70983_YIYIN-MAIN-1366909735562-a3d9410c], Consumer > console-c > 83_YIYIN-MAIN-1366909735562-a3d9410c selected partitions : > (kafka.consumer.ZookeeperConsumerConnector) > [2013-04-25 10:08:55,984] INFO > > [console-consumer-70983_YIYIN-MAIN-1366909735562-a3d9410c-leader-finder-thre > ad > (kafka.consumer.ConsumerFetcherManager$LeaderFinderThread) > [2013-04-25 10:08:55,984] INFO > [console-consumer-70983_YIYIN-MAIN-1366909735562-a3d9410c], end rebalancing > co > ole-consumer-70983_YIYIN-MAIN-1366909735562-a3d9410c try #0 > (kafka.consumer.ZookeeperConsumerConnector) > [2013-04-25 10:08:55,984] INFO > [console-consumer-70983_YIYIN-MAIN-1366909735562-a3d9410c], Not creating > event > r trivial whitelist test (kafka.consumer.ZookeeperConsumerConnector) > > > > -Original Message- > From: Jun Rao [mailto:jun...@gmail.com] > Sent: Thursday, April 25, 2013 7:21 AM > To: users@kafka.apache.org > Subject: Re: LeaderNotAvailable Exception > > Hmm, then it's weird. Could you try the latest code in 0.8? If the problem > persists, could you file a jira and attach the broker log? > > Thanks, > > Jun > > > On Wed, Apr 24, 2013 at 11:00 PM, Yin Yin wrote: > > > With the option --unavailable-partitions --topic topic1, > > kafka-list-topic doesn't show anything related to topic1> Date: Wed, > > 24 Apr 2013 20:58:09 > > -0700 > > > Subject: Re: LeaderNotAvailable Exception > > > From: jun...@gmail.com > > > To: users@kafka.apache.org > > > > > > What output do you get if you add the --unavailable-partitions > > > option in list topic? > > > > > > Thanks, > > > > > > Jun > > > > > > > > > On Wed, Apr 24, 2013 at 5:20 PM, Yin Yin wrote: > > > > > > > This exception happens only once. But there is another error for > > > > each producer request > > > > [2013-04-24 14:47:39,077] WARN [KafkaApi-0] Produce request: > > > > Leader > > not > > > > local for partition [topic1,0] on broker 0 > > > > (kafka.server.KafkaApis) > > Here > > > > is the information I get from kafka-list-topic, which indicates > > > > that > > > > borker0 is the leader for topic1 and partition 0 [2013-04-24 > > 14:56:03,948] > > > > INFO zookeeper state changed (SyncConnected) > > (org.I0Itec.zkclient.ZkClient) > > > > topic: topic1 partition: 0leader: 0 replicas: 0 isr: > 0 > > > > > > > From: libo...@citi.com > > > > > To: users@kafka.apache.org > > > > > Subject: Re: LeaderNotAvailable Exception > > > > > Date: Wed, 24 Apr 2013 17:38:23 + > > > > > > > > > > Hi Jun, > > > > > > > > > > This exception also gave me a hard time. In my case, I didn't > > > > > create > > the > > > > topic > > > > > before using it for producing. > > > > > > > > > > Regards, > > > > > > > > > > Libo > > > > > > > > > > > > > > > > > >
RE: LeaderNotAvailable Exception
:08:55,687] INFO Starting ZkClient event thread. (org.I0Itec.zkclient.ZkEventThread) [2013-04-25 10:08:55,687] INFO Opening socket connection to server localhost/127.0.0.1:2181 (org.apache.zooke Cnxn) [2013-04-25 10:08:55,687] INFO Socket connection established to localhost/127.0.0.1:2181, initiating session .zookeeper.ClientCnxn) [2013-04-25 10:08:55,687] INFO Session establishment complete on server localhost/127.0.0.1:2181, sessionid = f620002, negotiated timeout = 3 (org.apache.zookeeper.ClientCnxn) [2013-04-25 10:08:55,687] INFO zookeeper state changed (SyncConnected) (org.I0Itec.zkclient.ZkClient) [2013-04-25 10:08:55,703] INFO Terminate ZkClient event thread. (org.I0Itec.zkclient.ZkEventThread) [2013-04-25 10:08:55,703] INFO Session: 0x13e422b2f620002 closed (org.apache.zookeeper.ZooKeeper) [2013-04-25 10:08:55,703] INFO EventThread shut down (org.apache.zookeeper.ClientCnxn) [2013-04-25 10:08:55,734] INFO [console-consumer-70983_YIYIN-MAIN-1366909735562-a3d9410c], begin registering nsole-consumer-70983_YIYIN-MAIN-1366909735562-a3d9410c in ZK (kafka.consumer.ZookeeperConsumerConnector) [2013-04-25 10:08:55,750] INFO [console-consumer-70983_YIYIN-MAIN-1366909735562-a3d9410c], end registering co ole-consumer-70983_YIYIN-MAIN-1366909735562-a3d9410c in ZK (kafka.consumer.ZookeeperConsumerConnector) [2013-04-25 10:08:55,750] INFO [console-consumer-70983_YIYIN-MAIN-1366909735562-a3d9410c], starting watcher e ead for consumer console-consumer-70983_YIYIN-MAIN-1366909735562-a3d9410c (kafka.consumer.ZookeeperConsumerCo [2013-04-25 10:08:55,766] INFO [console-consumer-70983_YIYIN-MAIN-1366909735562-a3d9410c], begin rebalancing nsole-consumer-70983_YIYIN-MAIN-1366909735562-a3d9410c try #0 (kafka.consumer.ZookeeperConsumerConnector) [2013-04-25 10:08:55,891] INFO Verifying properties (kafka.utils.VerifiableProperties) [2013-04-25 10:08:55,906] INFO Property broker.list is overridden to YIYIN-MAIN.redmond.corp.microsoft.com:90 tils.VerifiableProperties) [2013-04-25 10:08:55,906] INFO Property request.timeout.ms is overridden to 3 (kafka.utils.VerifiableProp [2013-04-25 10:08:55,906] INFO Property client.id is overridden to console-consumer-70983 (kafka.utils.Verifi ies) [2013-04-25 10:08:55,922] INFO Fetching metadata with correlation id 0 for 0 topic(s) Set() (kafka.client.Cli [2013-04-25 10:08:55,922] INFO Connected to YIYIN-MAIN.redmond.corp.microsoft.com:9092 for producing (kafka.p cProducer) [2013-04-25 10:08:55,969] INFO Disconnecting from YIYIN-MAIN.redmond.corp.microsoft.com:9092 (kafka.producer. r) [2013-04-25 10:08:55,969] INFO [ConsumerFetcherManager-1366909735672] Stopping leader finder thread (kafka.co umerFetcherManager) [2013-04-25 10:08:55,969] INFO [ConsumerFetcherManager-1366909735672] Stopping all fetchers (kafka.consumer.C herManager) [2013-04-25 10:08:55,969] INFO [ConsumerFetcherManager-1366909735672] All connections stopped (kafka.consumer tcherManager) [2013-04-25 10:08:55,969] INFO [console-consumer-70983_YIYIN-MAIN-1366909735562-a3d9410c], Cleared all releva or this fetcher (kafka.consumer.ZookeeperConsumerConnector) [2013-04-25 10:08:55,969] INFO [console-consumer-70983_YIYIN-MAIN-1366909735562-a3d9410c], Cleared the data c l the consumer message iterators (kafka.consumer.ZookeeperConsumerConnector) [2013-04-25 10:08:55,969] INFO [console-consumer-70983_YIYIN-MAIN-1366909735562-a3d9410c], Committing all off clearing the fetcher queues (kafka.consumer.ZookeeperConsumerConnector) [2013-04-25 10:08:55,969] INFO [console-consumer-70983_YIYIN-MAIN-1366909735562-a3d9410c], Releasing partitio (kafka.consumer.ZookeeperConsumerConnector) [2013-04-25 10:08:55,984] INFO [console-consumer-70983_YIYIN-MAIN-1366909735562-a3d9410c], Updating the cache sumer.ZookeeperConsumerConnector) [2013-04-25 10:08:55,984] INFO [console-consumer-70983_YIYIN-MAIN-1366909735562-a3d9410c], Consumer console-c 83_YIYIN-MAIN-1366909735562-a3d9410c selected partitions : (kafka.consumer.ZookeeperConsumerConnector) [2013-04-25 10:08:55,984] INFO [console-consumer-70983_YIYIN-MAIN-1366909735562-a3d9410c-leader-finder-thre ad (kafka.consumer.ConsumerFetcherManager$LeaderFinderThread) [2013-04-25 10:08:55,984] INFO [console-consumer-70983_YIYIN-MAIN-1366909735562-a3d9410c], end rebalancing co ole-consumer-70983_YIYIN-MAIN-1366909735562-a3d9410c try #0 (kafka.consumer.ZookeeperConsumerConnector) [2013-04-25 10:08:55,984] INFO [console-consumer-70983_YIYIN-MAIN-1366909735562-a3d9410c], Not creating event r trivial whitelist test (kafka.consumer.ZookeeperConsumerConnector) -Original Message- From: Jun Rao [mailto:jun...@gmail.com] Sent: Thursday, April 25, 2013 7:21 AM To: users@kafka.apache.org Subject: Re: LeaderNotAvailable Exception Hmm, then it's weird. Could you try the latest code in 0.8? If the problem persists, could you file a jira and attach the broker log? Thanks, Jun On Wed, Apr 24, 2013 at 11:00 PM, Yin Yin wrote: > With the option --unavailable-partitions --topic topic1,
Re: LeaderNotAvailable Exception
Hmm, then it's weird. Could you try the latest code in 0.8? If the problem persists, could you file a jira and attach the broker log? Thanks, Jun On Wed, Apr 24, 2013 at 11:00 PM, Yin Yin wrote: > With the option --unavailable-partitions --topic topic1, kafka-list-topic > doesn't show anything related to topic1> Date: Wed, 24 Apr 2013 20:58:09 > -0700 > > Subject: Re: LeaderNotAvailable Exception > > From: jun...@gmail.com > > To: users@kafka.apache.org > > > > What output do you get if you add the --unavailable-partitions option in > > list topic? > > > > Thanks, > > > > Jun > > > > > > On Wed, Apr 24, 2013 at 5:20 PM, Yin Yin wrote: > > > > > This exception happens only once. But there is another error for each > > > producer request > > > [2013-04-24 14:47:39,077] WARN [KafkaApi-0] Produce request: Leader > not > > > local for partition [topic1,0] on broker 0 (kafka.server.KafkaApis) > Here > > > is the information I get from kafka-list-topic, which indicates that > > > borker0 is the leader for topic1 and partition 0 [2013-04-24 > 14:56:03,948] > > > INFO zookeeper state changed (SyncConnected) > (org.I0Itec.zkclient.ZkClient) > > > topic: topic1 partition: 0leader: 0 replicas: 0 isr: 0 > > > > > From: libo...@citi.com > > > > To: users@kafka.apache.org > > > > Subject: Re: LeaderNotAvailable Exception > > > > Date: Wed, 24 Apr 2013 17:38:23 + > > > > > > > > Hi Jun, > > > > > > > > This exception also gave me a hard time. In my case, I didn't create > the > > > topic > > > > before using it for producing. > > > > > > > > Regards, > > > > > > > > Libo > > > > > > > > > > > >
RE: LeaderNotAvailable Exception
With the option --unavailable-partitions --topic topic1, kafka-list-topic doesn't show anything related to topic1> Date: Wed, 24 Apr 2013 20:58:09 -0700 > Subject: Re: LeaderNotAvailable Exception > From: jun...@gmail.com > To: users@kafka.apache.org > > What output do you get if you add the --unavailable-partitions option in > list topic? > > Thanks, > > Jun > > > On Wed, Apr 24, 2013 at 5:20 PM, Yin Yin wrote: > > > This exception happens only once. But there is another error for each > > producer request > > [2013-04-24 14:47:39,077] WARN [KafkaApi-0] Produce request: Leader not > > local for partition [topic1,0] on broker 0 (kafka.server.KafkaApis) Here > > is the information I get from kafka-list-topic, which indicates that > > borker0 is the leader for topic1 and partition 0 [2013-04-24 14:56:03,948] > > INFO zookeeper state changed (SyncConnected) (org.I0Itec.zkclient.ZkClient) > > topic: topic1 partition: 0leader: 0 replicas: 0 isr: 0 > > > From: libo...@citi.com > > > To: users@kafka.apache.org > > > Subject: Re: LeaderNotAvailable Exception > > > Date: Wed, 24 Apr 2013 17:38:23 + > > > > > > Hi Jun, > > > > > > This exception also gave me a hard time. In my case, I didn't create the > > topic > > > before using it for producing. > > > > > > Regards, > > > > > > Libo > > > > > > >
Re: LeaderNotAvailable Exception
What output do you get if you add the --unavailable-partitions option in list topic? Thanks, Jun On Wed, Apr 24, 2013 at 5:20 PM, Yin Yin wrote: > This exception happens only once. But there is another error for each > producer request > [2013-04-24 14:47:39,077] WARN [KafkaApi-0] Produce request: Leader not > local for partition [topic1,0] on broker 0 (kafka.server.KafkaApis) Here > is the information I get from kafka-list-topic, which indicates that > borker0 is the leader for topic1 and partition 0 [2013-04-24 14:56:03,948] > INFO zookeeper state changed (SyncConnected) (org.I0Itec.zkclient.ZkClient) > topic: topic1 partition: 0leader: 0 replicas: 0 isr: 0 > > From: libo...@citi.com > > To: users@kafka.apache.org > > Subject: Re: LeaderNotAvailable Exception > > Date: Wed, 24 Apr 2013 17:38:23 + > > > > Hi Jun, > > > > This exception also gave me a hard time. In my case, I didn't create the > topic > > before using it for producing. > > > > Regards, > > > > Libo > > > >
RE: LeaderNotAvailable Exception
This exception happens only once. But there is another error for each producer request [2013-04-24 14:47:39,077] WARN [KafkaApi-0] Produce request: Leader not local for partition [topic1,0] on broker 0 (kafka.server.KafkaApis) Here is the information I get from kafka-list-topic, which indicates that borker0 is the leader for topic1 and partition 0 [2013-04-24 14:56:03,948] INFO zookeeper state changed (SyncConnected) (org.I0Itec.zkclient.ZkClient) topic: topic1 partition: 0leader: 0 replicas: 0 isr: 0 > From: libo...@citi.com > To: users@kafka.apache.org > Subject: Re: LeaderNotAvailable Exception > Date: Wed, 24 Apr 2013 17:38:23 + > > Hi Jun, > > This exception also gave me a hard time. In my case, I didn't create the topic > before using it for producing. > > Regards, > > Libo >
Re: LeaderNotAvailable Exception
Hi Jun, This exception also gave me a hard time. In my case, I didn't create the topic before using it for producing. Regards, Libo
Re: LeaderNotAvailable Exception
Did you create the topic without a # of partitions then try to delete/recreate it? I've had that happen to me before. Try shutting down everything (including zookeeper) and restarting. On Tue, Apr 23, 2013 at 9:08 PM, Jun Rao wrote: > Does this happen on every message that you type in producer console? > > Thanks, > > Jun > > > On Tue, Apr 23, 2013 at 4:15 PM, Yin Yin wrote: > > > I tried to run the kafka 0.8 version as instructed in Quick Start. The > > kafka server shows the following message when I launch the producer. > ERROR > > Error while fetching metadata for partition [test,0] > > (kafka.admin.AdminUtils$) > > kafka.common.LeaderNotAvailableException: No leader exists for partition > 0 > > at kafka.admin.AdminUtils$$anonfun$3.apply(AdminUtils.scala:219) > > at kafka.admin.AdminUtils$$anonfun$3.apply(AdminUtils.scala:201) > > at > > > scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206) > > at > > > scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206) > > at > > > scala.collection.LinearSeqOptimized$class.foreach(LinearSeqOptimized.scala:61) > > at scala.collection.immutable.List.foreach(List.scala:45) > > at > > scala.collection.TraversableLike$class.map(TraversableLike.scala:206) > > at scala.collection.immutable.List.map(List.scala:45) > > at > > > kafka.admin.AdminUtils$.kafka$admin$AdminUtils$$fetchTopicMetadataFromZk(AdminUtils.scala:201) > > at > > kafka.admin.AdminUtils$.fetchTopicMetadataFromZk(AdminUtils.scala:190) > > at > > > kafka.server.KafkaApis$$anonfun$handleTopicMetadataRequest$1.apply(KafkaApis.scala:479) > > at > > > kafka.server.KafkaApis$$anonfun$handleTopicMetadataRequest$1.apply(KafkaApis.scala:465) > > at scala.collection.immutable.Set$Set1.foreach(Set.scala:81) > > at > > kafka.server.KafkaApis.handleTopicMetadataRequest(KafkaApis.scala:464) > > at kafka.server.KafkaApis.handle(KafkaApis.scala:67) > > at > > kafka.server.KafkaRequestHandler.run(KafkaRequestHandler.scala:41) > > at java.lang.Thread.run(Unknown Source) Then, when I type a > > message in the producer console, the server console pops out WARN > > [KafkaApi-0] Leader not local for topic test partition 0 on broker 0 > > (kafka.server.KafkaApis) Consumer console also didn't get any message. > Any > > help is appreciated. Thanks > > >
Re: LeaderNotAvailable Exception
Does this happen on every message that you type in producer console? Thanks, Jun On Tue, Apr 23, 2013 at 4:15 PM, Yin Yin wrote: > I tried to run the kafka 0.8 version as instructed in Quick Start. The > kafka server shows the following message when I launch the producer. ERROR > Error while fetching metadata for partition [test,0] > (kafka.admin.AdminUtils$) > kafka.common.LeaderNotAvailableException: No leader exists for partition 0 > at kafka.admin.AdminUtils$$anonfun$3.apply(AdminUtils.scala:219) > at kafka.admin.AdminUtils$$anonfun$3.apply(AdminUtils.scala:201) > at > scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206) > at > scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206) > at > scala.collection.LinearSeqOptimized$class.foreach(LinearSeqOptimized.scala:61) > at scala.collection.immutable.List.foreach(List.scala:45) > at > scala.collection.TraversableLike$class.map(TraversableLike.scala:206) > at scala.collection.immutable.List.map(List.scala:45) > at > kafka.admin.AdminUtils$.kafka$admin$AdminUtils$$fetchTopicMetadataFromZk(AdminUtils.scala:201) > at > kafka.admin.AdminUtils$.fetchTopicMetadataFromZk(AdminUtils.scala:190) > at > kafka.server.KafkaApis$$anonfun$handleTopicMetadataRequest$1.apply(KafkaApis.scala:479) > at > kafka.server.KafkaApis$$anonfun$handleTopicMetadataRequest$1.apply(KafkaApis.scala:465) > at scala.collection.immutable.Set$Set1.foreach(Set.scala:81) > at > kafka.server.KafkaApis.handleTopicMetadataRequest(KafkaApis.scala:464) > at kafka.server.KafkaApis.handle(KafkaApis.scala:67) > at > kafka.server.KafkaRequestHandler.run(KafkaRequestHandler.scala:41) > at java.lang.Thread.run(Unknown Source) Then, when I type a > message in the producer console, the server console pops out WARN > [KafkaApi-0] Leader not local for topic test partition 0 on broker 0 > (kafka.server.KafkaApis) Consumer console also didn't get any message. Any > help is appreciated. Thanks >
LeaderNotAvailable Exception
I tried to run the kafka 0.8 version as instructed in Quick Start. The kafka server shows the following message when I launch the producer. ERROR Error while fetching metadata for partition [test,0] (kafka.admin.AdminUtils$) kafka.common.LeaderNotAvailableException: No leader exists for partition 0 at kafka.admin.AdminUtils$$anonfun$3.apply(AdminUtils.scala:219) at kafka.admin.AdminUtils$$anonfun$3.apply(AdminUtils.scala:201) at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206) at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206) at scala.collection.LinearSeqOptimized$class.foreach(LinearSeqOptimized.scala:61) at scala.collection.immutable.List.foreach(List.scala:45) at scala.collection.TraversableLike$class.map(TraversableLike.scala:206) at scala.collection.immutable.List.map(List.scala:45) at kafka.admin.AdminUtils$.kafka$admin$AdminUtils$$fetchTopicMetadataFromZk(AdminUtils.scala:201) at kafka.admin.AdminUtils$.fetchTopicMetadataFromZk(AdminUtils.scala:190) at kafka.server.KafkaApis$$anonfun$handleTopicMetadataRequest$1.apply(KafkaApis.scala:479) at kafka.server.KafkaApis$$anonfun$handleTopicMetadataRequest$1.apply(KafkaApis.scala:465) at scala.collection.immutable.Set$Set1.foreach(Set.scala:81) at kafka.server.KafkaApis.handleTopicMetadataRequest(KafkaApis.scala:464) at kafka.server.KafkaApis.handle(KafkaApis.scala:67) at kafka.server.KafkaRequestHandler.run(KafkaRequestHandler.scala:41) at java.lang.Thread.run(Unknown Source) Then, when I type a message in the producer console, the server console pops out WARN [KafkaApi-0] Leader not local for topic test partition 0 on broker 0 (kafka.server.KafkaApis) Consumer console also didn't get any message. Any help is appreciated. Thanks
Re: LeaderNotAvailable Exception
> I have only one small doubt. Can we set requests to be consumed by only > one consumer, means like a pull operation. Once consumed it shouldn't be > available for other consumers. Is this possible? It seems you want the data in a topic to be consumed by multiple consumers in a mutually exclusive way. Kafka offers this via consumer groups using the zookeeper based consumer. The consumers in a consumer group pull data from the configured topics in a way that, at a time, no two consumers get the same data. Thanks, Neha
Re: LeaderNotAvailable Exception
Hi Neha, Previously I have tried with trunk branch. After I have tried with 0.7 stable version. Now I am able to run some samples. Thanks for your immediate responses. I have only one small doubt. Can we set requests to be consumed by only one consumer, means like a pull operation. Once consumed it shouldn't be available for other consumers. Is this possible? I am very new to kafka, that's why I am asking this. Thanks in advance. Thanks, PrasannaKumar. -Original Message- From: Neha Narkhede Sent: Thursday, January 24, 2013 10:46 AM To: users@kafka.apache.org Subject: Re: LeaderNotAvailable Exception That seems like a bug. Would you mind filing a JIRA and explaining your test there so we can reproduce and fix the issue ? Thanks, Neha On Wed, Jan 23, 2013 at 8:49 PM, Prasanna Kumar Jalakam < prasann...@imimobile.com> wrote: Hi Neha, On zookeeper console it is appearing only once. But in Kafka - server console I am getting the following exception continuously when ever application tries to send some request. kafka.common.**LeaderNotAvailableException: Leader not local for topic test2 partition 0 on broker 0 at kafka.server.ReplicaManager.**getLeaderReplicaIfLocal(** ReplicaManager.scala:168) at kafka.server.KafkaApis$$**anonfun$appendToLocalLog$2.** apply(KafkaApis.scala:271) at kafka.server.KafkaApis$$**anonfun$appendToLocalLog$2.** apply(KafkaApis.scala:266) at scala.collection.**TraversableLike$$anonfun$map$** 1.apply(TraversableLike.scala:**206) at scala.collection.**TraversableLike$$anonfun$map$** 1.apply(TraversableLike.scala:**206) at scala.collection.immutable.**Map$Map1.foreach(Map.scala:**105) Is this related to zookeeper or kafka? I am trying to electing leader manually but I am not able to do it. Any basic thing I am missing? Thanks Prasanna -Original Message- From: Neha Narkhede Sent: Thursday, January 24, 2013 10:10 AM To: users@kafka.apache.org Subject: Re: LeaderNotAvailable Exception Prasanna, This log message is expected to appear once. Do you see it more than once in your logs ? Thanks, Neha On Wed, Jan 23, 2013 at 8:38 PM, Prasanna Kumar Jalakam < prasann...@imimobile.com> wrote: Hi, I am running zookeeper in stand alone mode only. There is only partition in there. So no chance for leader election. I am getting the following error in zookeeper console. Got user-level KeeperException when processing sessionid:0x13c6ace526d type:create cxid:0x2c zxid:0xfffe txntype:unknown reqpath:n/a Error Path:/brokers/topics/test1/partitions/0 Error:KeeperErrorCode = NoNode for /brokers/topics/test1/partitions/0 (org.apache.zookeeper.server.PrepRequestProcessor) Please help me to sort this out. Thanks, Prasanna -Original Message- From: Neha Narkhede Sent: Wednesday, January 23, 2013 10:07 PM To: users@kafka.apache.org Subject: Re: LeaderNotAvailable Exception That means the leader for partition [test, 0] is currently unavailable and ideally should be under another leader election. Do you see a lot of these errors ? Thanks, Neha On Wed, Jan 23, 2013 at 3:52 AM, Prasanna Kumar Jalakam < prasann...@imimobile.com> wrote: Hi All, I am new to Apache Kafka. I am facing an issue while starting the producer. kafka.common.LeaderNotAvailableException: Leader not local for topic test partition 0 on broker 0 at kafka.server.ReplicaManager.getLeaderReplicaIfLocal(** ReplicaManager.scala:168) at kafka.server.KafkaApis$$anonfun$22.apply(KafkaApis.** scala:423) at kafka.server.KafkaApis$$anonfun$22.apply(KafkaApis.** scala:418) at scala.collection.TraversableLike$$anonfun$map$ 1.apply(TraversableLike.scala:206) I have tried hard to find out. But I am unable to find the solution. So, Please help me to out. Thanks in advance. Regards J. Prasanna Kumar
Re: LeaderNotAvailable Exception
That seems like a bug. Would you mind filing a JIRA and explaining your test there so we can reproduce and fix the issue ? Thanks, Neha On Wed, Jan 23, 2013 at 8:49 PM, Prasanna Kumar Jalakam < prasann...@imimobile.com> wrote: > Hi Neha, > > On zookeeper console it is appearing only once. But in Kafka - server > console I am getting the following exception continuously when ever > application tries to send some request. > > kafka.common.**LeaderNotAvailableException: Leader not local for topic > test2 partition 0 on broker 0 >at kafka.server.ReplicaManager.**getLeaderReplicaIfLocal(** > ReplicaManager.scala:168) >at kafka.server.KafkaApis$$**anonfun$appendToLocalLog$2.** > apply(KafkaApis.scala:271) >at kafka.server.KafkaApis$$**anonfun$appendToLocalLog$2.** > apply(KafkaApis.scala:266) >at scala.collection.**TraversableLike$$anonfun$map$** > 1.apply(TraversableLike.scala:**206) >at scala.collection.**TraversableLike$$anonfun$map$** > 1.apply(TraversableLike.scala:**206) >at scala.collection.immutable.**Map$Map1.foreach(Map.scala:**105) > > Is this related to zookeeper or kafka? I am trying to electing leader > manually but I am not able to do it. > > Any basic thing I am missing? > > Thanks > > Prasanna > > > -Original Message- From: Neha Narkhede > Sent: Thursday, January 24, 2013 10:10 AM > > To: users@kafka.apache.org > Subject: Re: LeaderNotAvailable Exception > > Prasanna, > > This log message is expected to appear once. Do you see it more than once > in your logs ? > > Thanks, > Neha > > > On Wed, Jan 23, 2013 at 8:38 PM, Prasanna Kumar Jalakam < > prasann...@imimobile.com> wrote: > > Hi, >> >> I am running zookeeper in stand alone mode only. There is only partition >> in there. So no chance for leader election. I am getting the following >> error in zookeeper console. >> >> Got user-level KeeperException when processing sessionid:0x13c6ace526d >> type:create cxid:0x2c zxid:0xfffe txntype:unknown reqpath:n/a >> Error Path:/brokers/topics/test1/partitions/0 Error:KeeperErrorCode = >> NoNode for /brokers/topics/test1/partitions/0 >> (org.apache.zookeeper.server.PrepRequestProcessor) >> >> >> Please help me to sort this out. >> >> Thanks, >> Prasanna >> >> -Original Message- From: Neha Narkhede >> Sent: Wednesday, January 23, 2013 10:07 PM >> To: users@kafka.apache.org >> Subject: Re: LeaderNotAvailable Exception >> >> >> That means the leader for partition [test, 0] is currently unavailable and >> ideally should be under another leader election. Do you see a lot of these >> errors ? >> >> Thanks, >> Neha >> >> >> On Wed, Jan 23, 2013 at 3:52 AM, Prasanna Kumar Jalakam < >> prasann...@imimobile.com> wrote: >> >> Hi All, >> >>> >>> I am new to Apache Kafka. I am facing an issue while starting the >>> producer. >>> >>> kafka.common.LeaderNotAvailableException: Leader not local for topic >>> >>> test >>> partition 0 on broker 0 >>> >>> at >>> kafka.server.ReplicaManager.getLeaderReplicaIfLocal(** >>> ReplicaManager.scala:168) >>> at kafka.server.KafkaApis$$anonfun$22.apply(KafkaApis.** >>> scala:423) >>> at kafka.server.KafkaApis$$anonfun$22.apply(KafkaApis.** >>> scala:418) >>> at >>> scala.collection.TraversableLike$$anonfun$map$ >>> 1.apply(TraversableLike.scala:206) >>> >>> >>> I have tried hard to find out. But I am unable to find the solution. >>> >>> So, Please help me to out. >>> >>> Thanks in advance. >>> >>> Regards >>> J. Prasanna Kumar >>> >>> >> >> >> > >
Re: LeaderNotAvailable Exception
Hi Neha, On zookeeper console it is appearing only once. But in Kafka - server console I am getting the following exception continuously when ever application tries to send some request. kafka.common.LeaderNotAvailableException: Leader not local for topic test2 partition 0 on broker 0 at kafka.server.ReplicaManager.getLeaderReplicaIfLocal(ReplicaManager.scala:168) at kafka.server.KafkaApis$$anonfun$appendToLocalLog$2.apply(KafkaApis.scala:271) at kafka.server.KafkaApis$$anonfun$appendToLocalLog$2.apply(KafkaApis.scala:266) at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206) at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206) at scala.collection.immutable.Map$Map1.foreach(Map.scala:105) Is this related to zookeeper or kafka? I am trying to electing leader manually but I am not able to do it. Any basic thing I am missing? Thanks Prasanna -Original Message- From: Neha Narkhede Sent: Thursday, January 24, 2013 10:10 AM To: users@kafka.apache.org Subject: Re: LeaderNotAvailable Exception Prasanna, This log message is expected to appear once. Do you see it more than once in your logs ? Thanks, Neha On Wed, Jan 23, 2013 at 8:38 PM, Prasanna Kumar Jalakam < prasann...@imimobile.com> wrote: Hi, I am running zookeeper in stand alone mode only. There is only partition in there. So no chance for leader election. I am getting the following error in zookeeper console. Got user-level KeeperException when processing sessionid:0x13c6ace526d type:create cxid:0x2c zxid:0xfffe txntype:unknown reqpath:n/a Error Path:/brokers/topics/test1/**partitions/0 Error:KeeperErrorCode = NoNode for /brokers/topics/test1/**partitions/0 (org.apache.zookeeper.server.**PrepRequestProcessor) Please help me to sort this out. Thanks, Prasanna -Original Message- From: Neha Narkhede Sent: Wednesday, January 23, 2013 10:07 PM To: users@kafka.apache.org Subject: Re: LeaderNotAvailable Exception That means the leader for partition [test, 0] is currently unavailable and ideally should be under another leader election. Do you see a lot of these errors ? Thanks, Neha On Wed, Jan 23, 2013 at 3:52 AM, Prasanna Kumar Jalakam < prasann...@imimobile.com> wrote: Hi All, I am new to Apache Kafka. I am facing an issue while starting the producer. kafka.common.**LeaderNotAvailableException: Leader not local for topic test partition 0 on broker 0 at kafka.server.ReplicaManager.**getLeaderReplicaIfLocal(** ReplicaManager.scala:168) at kafka.server.KafkaApis$$**anonfun$22.apply(KafkaApis.** scala:423) at kafka.server.KafkaApis$$**anonfun$22.apply(KafkaApis.** scala:418) at scala.collection.**TraversableLike$$anonfun$map$** 1.apply(TraversableLike.scala:**206) I have tried hard to find out. But I am unable to find the solution. So, Please help me to out. Thanks in advance. Regards J. Prasanna Kumar
Re: LeaderNotAvailable Exception
Prasanna, This log message is expected to appear once. Do you see it more than once in your logs ? Thanks, Neha On Wed, Jan 23, 2013 at 8:38 PM, Prasanna Kumar Jalakam < prasann...@imimobile.com> wrote: > Hi, > > I am running zookeeper in stand alone mode only. There is only partition > in there. So no chance for leader election. I am getting the following > error in zookeeper console. > > Got user-level KeeperException when processing sessionid:0x13c6ace526d > type:create cxid:0x2c zxid:0xfffe txntype:unknown reqpath:n/a > Error Path:/brokers/topics/test1/**partitions/0 Error:KeeperErrorCode = > NoNode for /brokers/topics/test1/**partitions/0 > (org.apache.zookeeper.server.**PrepRequestProcessor) > > Please help me to sort this out. > > Thanks, > Prasanna > > -Original Message- From: Neha Narkhede > Sent: Wednesday, January 23, 2013 10:07 PM > To: users@kafka.apache.org > Subject: Re: LeaderNotAvailable Exception > > > That means the leader for partition [test, 0] is currently unavailable and > ideally should be under another leader election. Do you see a lot of these > errors ? > > Thanks, > Neha > > > On Wed, Jan 23, 2013 at 3:52 AM, Prasanna Kumar Jalakam < > prasann...@imimobile.com> wrote: > > Hi All, >> >> I am new to Apache Kafka. I am facing an issue while starting the >> producer. >> >> kafka.common.**LeaderNotAvailableException: Leader not local for topic >> test >> partition 0 on broker 0 >> >> at >> kafka.server.ReplicaManager.**getLeaderReplicaIfLocal(** >> ReplicaManager.scala:168) >> at kafka.server.KafkaApis$$**anonfun$22.apply(KafkaApis.** >> scala:423) >> at kafka.server.KafkaApis$$**anonfun$22.apply(KafkaApis.** >> scala:418) >> at >> scala.collection.**TraversableLike$$anonfun$map$** >> 1.apply(TraversableLike.scala:**206) >> >> I have tried hard to find out. But I am unable to find the solution. >> >> So, Please help me to out. >> >> Thanks in advance. >> >> Regards >> J. Prasanna Kumar >> > > >
Re: LeaderNotAvailable Exception
Hi, I am running zookeeper in stand alone mode only. There is only partition in there. So no chance for leader election. I am getting the following error in zookeeper console. Got user-level KeeperException when processing sessionid:0x13c6ace526d type:create cxid:0x2c zxid:0xfffe txntype:unknown reqpath:n/a Error Path:/brokers/topics/test1/partitions/0 Error:KeeperErrorCode = NoNode for /brokers/topics/test1/partitions/0 (org.apache.zookeeper.server.PrepRequestProcessor) Please help me to sort this out. Thanks, Prasanna -Original Message- From: Neha Narkhede Sent: Wednesday, January 23, 2013 10:07 PM To: users@kafka.apache.org Subject: Re: LeaderNotAvailable Exception That means the leader for partition [test, 0] is currently unavailable and ideally should be under another leader election. Do you see a lot of these errors ? Thanks, Neha On Wed, Jan 23, 2013 at 3:52 AM, Prasanna Kumar Jalakam < prasann...@imimobile.com> wrote: Hi All, I am new to Apache Kafka. I am facing an issue while starting the producer. kafka.common.LeaderNotAvailableException: Leader not local for topic test partition 0 on broker 0 at kafka.server.ReplicaManager.getLeaderReplicaIfLocal(ReplicaManager.scala:168) at kafka.server.KafkaApis$$anonfun$22.apply(KafkaApis.scala:423) at kafka.server.KafkaApis$$anonfun$22.apply(KafkaApis.scala:418) at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206) I have tried hard to find out. But I am unable to find the solution. So, Please help me to out. Thanks in advance. Regards J. Prasanna Kumar
Re: LeaderNotAvailable Exception
That means the leader for partition [test, 0] is currently unavailable and ideally should be under another leader election. Do you see a lot of these errors ? Thanks, Neha On Wed, Jan 23, 2013 at 3:52 AM, Prasanna Kumar Jalakam < prasann...@imimobile.com> wrote: > Hi All, > > I am new to Apache Kafka. I am facing an issue while starting the producer. > > kafka.common.LeaderNotAvailableException: Leader not local for topic test > partition 0 on broker 0 > > at > kafka.server.ReplicaManager.getLeaderReplicaIfLocal(ReplicaManager.scala:168) > at kafka.server.KafkaApis$$anonfun$22.apply(KafkaApis.scala:423) > at kafka.server.KafkaApis$$anonfun$22.apply(KafkaApis.scala:418) > at > scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206) > > I have tried hard to find out. But I am unable to find the solution. > > So, Please help me to out. > > Thanks in advance. > > Regards > J. Prasanna Kumar
LeaderNotAvailable Exception
Hi All, I am new to Apache Kafka. I am facing an issue while starting the producer. kafka.common.LeaderNotAvailableException: Leader not local for topic test partition 0 on broker 0 at kafka.server.ReplicaManager.getLeaderReplicaIfLocal(ReplicaManager.scala:168) at kafka.server.KafkaApis$$anonfun$22.apply(KafkaApis.scala:423) at kafka.server.KafkaApis$$anonfun$22.apply(KafkaApis.scala:418) at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206) I have tried hard to find out. But I am unable to find the solution. So, Please help me to out. Thanks in advance. Regards J. Prasanna Kumar
