[jira] [Commented] (KAFKA-853) Allow OffsetFetchRequest to initialize offsets
[ https://issues.apache.org/jira/browse/KAFKA-853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14285163#comment-14285163 ] Balaji Seshadri commented on KAFKA-853: --- [~mgharat] i need to analyze more before i answer your question,i just now took this JIRA. > Allow OffsetFetchRequest to initialize offsets > -- > > Key: KAFKA-853 > URL: https://issues.apache.org/jira/browse/KAFKA-853 > Project: Kafka > Issue Type: Improvement > Components: core >Affects Versions: 0.8.1 >Reporter: David Arthur >Assignee: Balaji Seshadri > Fix For: 0.9.0 > > Original Estimate: 24h > Remaining Estimate: 24h > > It would be nice for the OffsetFetchRequest API to have the option to > initialize offsets instead of returning unknown_topic_or_partition. It could > mimic the Offsets API by adding the "time" field and then follow the same > code path on the server as the Offset API. > In this case, the response would need to a boolean to indicate if the > returned offset was initialized or fetched from ZK. > This would simplify the client logic when dealing with new topics. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Assigned] (KAFKA-853) Allow OffsetFetchRequest to initialize offsets
[ https://issues.apache.org/jira/browse/KAFKA-853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Balaji Seshadri reassigned KAFKA-853: - Assignee: Balaji Seshadri > Allow OffsetFetchRequest to initialize offsets > -- > > Key: KAFKA-853 > URL: https://issues.apache.org/jira/browse/KAFKA-853 > Project: Kafka > Issue Type: Improvement > Components: core >Affects Versions: 0.8.1 >Reporter: David Arthur >Assignee: Balaji Seshadri > Fix For: 0.9.0 > > Original Estimate: 24h > Remaining Estimate: 24h > > It would be nice for the OffsetFetchRequest API to have the option to > initialize offsets instead of returning unknown_topic_or_partition. It could > mimic the Offsets API by adding the "time" field and then follow the same > code path on the server as the Offset API. > In this case, the response would need to a boolean to indicate if the > returned offset was initialized or fetched from ZK. > This would simplify the client logic when dealing with new topics. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
Re: Review Request 27693: Patch for KAFKA-1476
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/27693/ --- (Updated Dec. 5, 2014, 7:03 p.m.) Review request for kafka. Bugs: KAFKA-1476 https://issues.apache.org/jira/browse/KAFKA-1476 Repository: kafka Description --- KAFKA-1476 Implemented review comments from Neha and Ashish Diffs (updated) - core/src/main/scala/kafka/tools/ConsumerCommand.scala PRE-CREATION core/src/main/scala/kafka/utils/ZkUtils.scala 56e3e88e0cc6d917b0ffd1254e173295c1c4aabd Diff: https://reviews.apache.org/r/27693/diff/ Testing --- Thanks, Balaji Seshadri
Re: Review Request 27693: Patch for KAFKA-1476
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/27693/ --- (Updated Dec. 5, 2014, 7 p.m.) Review request for kafka. Bugs: KAFKA-1476 https://issues.apache.org/jira/browse/KAFKA-1476 Repository: kafka Description (updated) --- KAFKA-1476 Implemented review comments from Neha and Ashish Diffs (updated) - core/src/main/scala/kafka/tools/ConsumerCommand.scala PRE-CREATION core/src/main/scala/kafka/utils/ZkUtils.scala 56e3e88e0cc6d917b0ffd1254e173295c1c4aabd Diff: https://reviews.apache.org/r/27693/diff/ Testing --- Thanks, Balaji Seshadri
Re: Review Request 27818: Patch for KAFKA-328
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/27818/ --- (Updated Nov. 29, 2014, 7:07 a.m.) Review request for kafka. Bugs: KAFKA-328 https://issues.apache.org/jira/browse/KAFKA-328 Repository: kafka Description --- KAFKA-328 Write unit test for kafka server startup and shutdown API - Review Comments Diffs (updated) - core/src/test/scala/unit/kafka/server/ServerShutdownTest.scala 1bfb501b2f29c50f3fc5f930fdaad02e03b91e4f core/src/test/scala/unit/kafka/server/ServerStartupTest.scala a0ed4855f2550a0eb2e363dd2fccd8377a9ac172 Diff: https://reviews.apache.org/r/27818/diff/ Testing --- Thanks, Balaji Seshadri
Re: Review Request 27693: Patch for KAFKA-1476
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/27693/ --- (Updated Nov. 10, 2014, 7:06 p.m.) Review request for kafka. Bugs: KAFKA-1476 https://issues.apache.org/jira/browse/KAFKA-1476 Repository: kafka Description --- KAFKA-1476 Get list of consumer groups - Review Comments Diffs (updated) - core/src/main/scala/kafka/tools/ConsumerCommand.scala PRE-CREATION core/src/main/scala/kafka/utils/ZkUtils.scala 56e3e88e0cc6d917b0ffd1254e173295c1c4aabd Diff: https://reviews.apache.org/r/27693/diff/ Testing --- Thanks, Balaji Seshadri
Re: Review Request 27693: Patch for KAFKA-1476
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/27693/ --- (Updated Nov. 10, 2014, 7:04 p.m.) Review request for kafka. Bugs: KAFKA-1476 https://issues.apache.org/jira/browse/KAFKA-1476 Repository: kafka Description (updated) --- KAFKA-1476 Get list of consumer groups - Review Comments Diffs (updated) - core/src/main/scala/kafka/tools/ConsumerCommand.scala PRE-CREATION Diff: https://reviews.apache.org/r/27693/diff/ Testing --- Thanks, Balaji Seshadri
Re: Review Request 27693: Patch for KAFKA-1476
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/27693/ --- (Updated Nov. 10, 2014, 6:58 p.m.) Review request for kafka. Bugs: KAFKA-1476 https://issues.apache.org/jira/browse/KAFKA-1476 Repository: kafka Description (updated) --- KAFKA-328 Write unit test for kafka server startup and shutdown API KAFKA-328 Write unit test for kafka server startup and shutdown API - Review Comments KAFKA-1476 Get list of consumer groups with review comments Diffs (updated) - core/src/main/scala/kafka/tools/ConsumerCommand.scala PRE-CREATION core/src/main/scala/kafka/utils/ZkUtils.scala 56e3e88e0cc6d917b0ffd1254e173295c1c4aabd core/src/test/scala/unit/kafka/server/ServerShutdownTest.scala 1bfb501b2f29c50f3fc5f930fdaad02e03b91e4f core/src/test/scala/unit/kafka/server/ServerStartupTest.scala a0ed4855f2550a0eb2e363dd2fccd8377a9ac172 Diff: https://reviews.apache.org/r/27693/diff/ Testing --- Thanks, Balaji Seshadri
Re: Review Request 27818: Patch for KAFKA-328
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/27818/ --- (Updated Nov. 10, 2014, 6:05 p.m.) Review request for kafka. Bugs: KAFKA-328 https://issues.apache.org/jira/browse/KAFKA-328 Repository: kafka Description (updated) --- KAFKA-328 Write unit test for kafka server startup and shutdown API - Review Comments Diffs (updated) - core/src/test/scala/unit/kafka/server/ServerShutdownTest.scala 1bfb501b2f29c50f3fc5f930fdaad02e03b91e4f core/src/test/scala/unit/kafka/server/ServerStartupTest.scala a0ed4855f2550a0eb2e363dd2fccd8377a9ac172 Diff: https://reviews.apache.org/r/27818/diff/ Testing --- Thanks, Balaji Seshadri
Review Request 27818: Patch for KAFKA-328
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/27818/ --- Review request for kafka. Bugs: KAFKA-328 https://issues.apache.org/jira/browse/KAFKA-328 Repository: kafka Description --- KAFKA-328 Write unit test for kafka server startup and shutdown API KAFKA-328 Write unit test for kafka server startup and shutdown API - Review Comments Diffs - core/src/main/scala/kafka/tools/ConsumerCommand.scala PRE-CREATION core/src/main/scala/kafka/utils/ZkUtils.scala 56e3e88e0cc6d917b0ffd1254e173295c1c4aabd core/src/test/scala/unit/kafka/server/ServerShutdownTest.scala 1bfb501b2f29c50f3fc5f930fdaad02e03b91e4f core/src/test/scala/unit/kafka/server/ServerStartupTest.scala a0ed4855f2550a0eb2e363dd2fccd8377a9ac172 Diff: https://reviews.apache.org/r/27818/diff/ Testing --- Thanks, Balaji Seshadri
Review Request 27693: Patch for KAFKA-1476
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/27693/ --- Review request for kafka. Bugs: KAFKA-1476 https://issues.apache.org/jira/browse/KAFKA-1476 Repository: kafka Description --- KAFKA-1476 Get list of consumer groups Diffs - core/src/main/scala/kafka/tools/ConsumerCommand.scala PRE-CREATION core/src/main/scala/kafka/utils/ZkUtils.scala 56e3e88e0cc6d917b0ffd1254e173295c1c4aabd Diff: https://reviews.apache.org/r/27693/diff/ Testing --- Thanks, Balaji Seshadri
Review Request 27691: Patch for KAFKA-1476
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/27691/ --- Review request for kafka. Bugs: KAFKA-1476 https://issues.apache.org/jira/browse/KAFKA-1476 Repository: kafka Description --- KAFKA-328 Write unit test for kafka server startup and shutdown API Diffs - core/src/main/scala/kafka/tools/ConsumerCommand.scala PRE-CREATION core/src/main/scala/kafka/utils/ZkUtils.scala 56e3e88e0cc6d917b0ffd1254e173295c1c4aabd core/src/test/scala/unit/kafka/server/ServerShutdownTest.scala 1bfb501b2f29c50f3fc5f930fdaad02e03b91e4f core/src/test/scala/unit/kafka/server/ServerStartupTest.scala a0ed4855f2550a0eb2e363dd2fccd8377a9ac172 Diff: https://reviews.apache.org/r/27691/diff/ Testing --- Thanks, Balaji Seshadri
[jira] [Assigned] (KAFKA-328) Write unit test for kafka server startup and shutdown API
[ https://issues.apache.org/jira/browse/KAFKA-328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Balaji Seshadri reassigned KAFKA-328: - Assignee: Balaji Seshadri (was: BalajiSeshadri) > Write unit test for kafka server startup and shutdown API > -- > > Key: KAFKA-328 > URL: https://issues.apache.org/jira/browse/KAFKA-328 > Project: Kafka > Issue Type: Bug >Reporter: Neha Narkhede > Assignee: Balaji Seshadri > Labels: newbie > > Background discussion in KAFKA-320 > People often try to embed KafkaServer in an application that ends up calling > startup() and shutdown() repeatedly and sometimes in odd ways. To ensure this > works correctly we have to be very careful about cleaning up resources. This > is a good practice for making unit tests reliable anyway. > A good first step would be to add some unit tests on startup and shutdown to > cover various cases: > 1. A Kafka server can startup if it is not already starting up, if it is not > currently being shutdown, or if it hasn't been already started > 2. A Kafka server can shutdown if it is not already shutting down, if it is > not currently starting up, or if it hasn't been already shutdown. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Assigned] (KAFKA-1476) Get a list of consumer groups
[ https://issues.apache.org/jira/browse/KAFKA-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Balaji Seshadri reassigned KAFKA-1476: -- Assignee: Balaji Seshadri (was: BalajiSeshadri) > Get a list of consumer groups > - > > Key: KAFKA-1476 > URL: https://issues.apache.org/jira/browse/KAFKA-1476 > Project: Kafka > Issue Type: Wish > Components: tools >Affects Versions: 0.8.1.1 >Reporter: Ryan Williams >Assignee: Balaji Seshadri > Labels: newbie > Fix For: 0.9.0 > > Attachments: KAFKA-1476-RENAME.patch, KAFKA-1476.patch > > > It would be useful to have a way to get a list of consumer groups currently > active via some tool/script that ships with kafka. This would be helpful so > that the system tools can be explored more easily. > For example, when running the ConsumerOffsetChecker, it requires a group > option > bin/kafka-run-class.sh kafka.tools.ConsumerOffsetChecker --topic test --group > ? > But, when just getting started with kafka, using the console producer and > consumer, it is not clear what value to use for the group option. If a list > of consumer groups could be listed, then it would be clear what value to use. > Background: > http://mail-archives.apache.org/mod_mbox/kafka-users/201405.mbox/%3cCAOq_b1w=slze5jrnakxvak0gu9ctdkpazak1g4dygvqzbsg...@mail.gmail.com%3e -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Assigned] (KAFKA-1618) Exception thrown when running console producer with no port number for the broker
[ https://issues.apache.org/jira/browse/KAFKA-1618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Balaji Seshadri reassigned KAFKA-1618: -- Assignee: Balaji Seshadri (was: BalajiSeshadri) > Exception thrown when running console producer with no port number for the > broker > - > > Key: KAFKA-1618 > URL: https://issues.apache.org/jira/browse/KAFKA-1618 > Project: Kafka > Issue Type: Improvement >Affects Versions: 0.8.1.1 >Reporter: Gwen Shapira >Assignee: Balaji Seshadri > Labels: newbie > Fix For: 0.8.2 > > Attachments: KAFKA-1618-ALL.patch, KAFKA-1618.patch > > > When running console producer with just "localhost" as the broker list, I get > ArrayIndexOutOfBounds exception. > I expect either a clearer error about arguments or for the producer to > "guess" a default port. > [root@shapira-1 bin]# ./kafka-console-producer.sh --topic rufus1 > --broker-list localhost > java.lang.ArrayIndexOutOfBoundsException: 1 > at > kafka.client.ClientUtils$$anonfun$parseBrokerList$1.apply(ClientUtils.scala:102) > at > kafka.client.ClientUtils$$anonfun$parseBrokerList$1.apply(ClientUtils.scala:97) > at > scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:244) > at > scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:244) > at > scala.collection.mutable.ResizableArray$class.foreach(ResizableArray.scala:59) > at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:47) > at scala.collection.TraversableLike$class.map(TraversableLike.scala:244) > at scala.collection.AbstractTraversable.map(Traversable.scala:105) > at kafka.client.ClientUtils$.parseBrokerList(ClientUtils.scala:97) > at > kafka.producer.BrokerPartitionInfo.(BrokerPartitionInfo.scala:32) > at > kafka.producer.async.DefaultEventHandler.(DefaultEventHandler.scala:41) > at kafka.producer.Producer.(Producer.scala:59) > at kafka.producer.ConsoleProducer$.main(ConsoleProducer.scala:158) > at kafka.producer.ConsoleProducer.main(ConsoleProducer.scala) -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KAFKA-1618) Exception thrown when running console producer with no port number for the broker
[ https://issues.apache.org/jira/browse/KAFKA-1618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14137540#comment-14137540 ] Balaji Seshadri commented on KAFKA-1618: [~nehanarkhede] Please let me know your decision. > Exception thrown when running console producer with no port number for the > broker > - > > Key: KAFKA-1618 > URL: https://issues.apache.org/jira/browse/KAFKA-1618 > Project: Kafka > Issue Type: Improvement >Affects Versions: 0.8.1.1 >Reporter: Gwen Shapira >Assignee: BalajiSeshadri > Labels: newbie > Fix For: 0.8.2 > > Attachments: KAFKA-1618-ALL.patch, KAFKA-1618.patch > > > When running console producer with just "localhost" as the broker list, I get > ArrayIndexOutOfBounds exception. > I expect either a clearer error about arguments or for the producer to > "guess" a default port. > [root@shapira-1 bin]# ./kafka-console-producer.sh --topic rufus1 > --broker-list localhost > java.lang.ArrayIndexOutOfBoundsException: 1 > at > kafka.client.ClientUtils$$anonfun$parseBrokerList$1.apply(ClientUtils.scala:102) > at > kafka.client.ClientUtils$$anonfun$parseBrokerList$1.apply(ClientUtils.scala:97) > at > scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:244) > at > scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:244) > at > scala.collection.mutable.ResizableArray$class.foreach(ResizableArray.scala:59) > at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:47) > at scala.collection.TraversableLike$class.map(TraversableLike.scala:244) > at scala.collection.AbstractTraversable.map(Traversable.scala:105) > at kafka.client.ClientUtils$.parseBrokerList(ClientUtils.scala:97) > at > kafka.producer.BrokerPartitionInfo.(BrokerPartitionInfo.scala:32) > at > kafka.producer.async.DefaultEventHandler.(DefaultEventHandler.scala:41) > at kafka.producer.Producer.(Producer.scala:59) > at kafka.producer.ConsoleProducer$.main(ConsoleProducer.scala:158) > at kafka.producer.ConsoleProducer.main(ConsoleProducer.scala) -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KAFKA-1618) Exception thrown when running console producer with no port number for the broker
[ https://issues.apache.org/jira/browse/KAFKA-1618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14136220#comment-14136220 ] Balaji Seshadri commented on KAFKA-1618: I agree with you [~jkreps] and [~nehanarkhede],its just ceremonial to have deafult one like Tomcat or any App server. Most of the cases it will be custom port. > Exception thrown when running console producer with no port number for the > broker > - > > Key: KAFKA-1618 > URL: https://issues.apache.org/jira/browse/KAFKA-1618 > Project: Kafka > Issue Type: Improvement >Affects Versions: 0.8.1.1 >Reporter: Gwen Shapira >Assignee: BalajiSeshadri > Labels: newbie > Fix For: 0.8.2 > > Attachments: KAFKA-1618-ALL.patch, KAFKA-1618.patch > > > When running console producer with just "localhost" as the broker list, I get > ArrayIndexOutOfBounds exception. > I expect either a clearer error about arguments or for the producer to > "guess" a default port. > [root@shapira-1 bin]# ./kafka-console-producer.sh --topic rufus1 > --broker-list localhost > java.lang.ArrayIndexOutOfBoundsException: 1 > at > kafka.client.ClientUtils$$anonfun$parseBrokerList$1.apply(ClientUtils.scala:102) > at > kafka.client.ClientUtils$$anonfun$parseBrokerList$1.apply(ClientUtils.scala:97) > at > scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:244) > at > scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:244) > at > scala.collection.mutable.ResizableArray$class.foreach(ResizableArray.scala:59) > at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:47) > at scala.collection.TraversableLike$class.map(TraversableLike.scala:244) > at scala.collection.AbstractTraversable.map(Traversable.scala:105) > at kafka.client.ClientUtils$.parseBrokerList(ClientUtils.scala:97) > at > kafka.producer.BrokerPartitionInfo.(BrokerPartitionInfo.scala:32) > at > kafka.producer.async.DefaultEventHandler.(DefaultEventHandler.scala:41) > at kafka.producer.Producer.(Producer.scala:59) > at kafka.producer.ConsoleProducer$.main(ConsoleProducer.scala:158) > at kafka.producer.ConsoleProducer.main(ConsoleProducer.scala) -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KAFKA-1618) Exception thrown when running console producer with no port number for the broker
[ https://issues.apache.org/jira/browse/KAFKA-1618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14135588#comment-14135588 ] Balaji Seshadri commented on KAFKA-1618: ok if user doesn't give any port i will default to 9092,if he/she does i will go ahead and use it. Is that ok ?. [~nehanarkhede] and [~gwenshap] > Exception thrown when running console producer with no port number for the > broker > - > > Key: KAFKA-1618 > URL: https://issues.apache.org/jira/browse/KAFKA-1618 > Project: Kafka > Issue Type: Improvement >Affects Versions: 0.8.1.1 >Reporter: Gwen Shapira >Assignee: BalajiSeshadri > Labels: newbie > Fix For: 0.8.2 > > Attachments: KAFKA-1618-ALL.patch, KAFKA-1618.patch > > > When running console producer with just "localhost" as the broker list, I get > ArrayIndexOutOfBounds exception. > I expect either a clearer error about arguments or for the producer to > "guess" a default port. > [root@shapira-1 bin]# ./kafka-console-producer.sh --topic rufus1 > --broker-list localhost > java.lang.ArrayIndexOutOfBoundsException: 1 > at > kafka.client.ClientUtils$$anonfun$parseBrokerList$1.apply(ClientUtils.scala:102) > at > kafka.client.ClientUtils$$anonfun$parseBrokerList$1.apply(ClientUtils.scala:97) > at > scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:244) > at > scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:244) > at > scala.collection.mutable.ResizableArray$class.foreach(ResizableArray.scala:59) > at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:47) > at scala.collection.TraversableLike$class.map(TraversableLike.scala:244) > at scala.collection.AbstractTraversable.map(Traversable.scala:105) > at kafka.client.ClientUtils$.parseBrokerList(ClientUtils.scala:97) > at > kafka.producer.BrokerPartitionInfo.(BrokerPartitionInfo.scala:32) > at > kafka.producer.async.DefaultEventHandler.(DefaultEventHandler.scala:41) > at kafka.producer.Producer.(Producer.scala:59) > at kafka.producer.ConsoleProducer$.main(ConsoleProducer.scala:158) > at kafka.producer.ConsoleProducer.main(ConsoleProducer.scala) -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (KAFKA-1618) Exception thrown when running console producer with no port number for the broker
[ https://issues.apache.org/jira/browse/KAFKA-1618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Balaji Seshadri updated KAFKA-1618: --- Assignee: BalajiSeshadri (was: Balaji Seshadri) > Exception thrown when running console producer with no port number for the > broker > - > > Key: KAFKA-1618 > URL: https://issues.apache.org/jira/browse/KAFKA-1618 > Project: Kafka > Issue Type: Improvement >Affects Versions: 0.8.1.1 >Reporter: Gwen Shapira >Assignee: BalajiSeshadri > Labels: newbie > Fix For: 0.8.2 > > Attachments: KAFKA-1618-ALL.patch, KAFKA-1618.patch > > > When running console producer with just "localhost" as the broker list, I get > ArrayIndexOutOfBounds exception. > I expect either a clearer error about arguments or for the producer to > "guess" a default port. > [root@shapira-1 bin]# ./kafka-console-producer.sh --topic rufus1 > --broker-list localhost > java.lang.ArrayIndexOutOfBoundsException: 1 > at > kafka.client.ClientUtils$$anonfun$parseBrokerList$1.apply(ClientUtils.scala:102) > at > kafka.client.ClientUtils$$anonfun$parseBrokerList$1.apply(ClientUtils.scala:97) > at > scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:244) > at > scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:244) > at > scala.collection.mutable.ResizableArray$class.foreach(ResizableArray.scala:59) > at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:47) > at scala.collection.TraversableLike$class.map(TraversableLike.scala:244) > at scala.collection.AbstractTraversable.map(Traversable.scala:105) > at kafka.client.ClientUtils$.parseBrokerList(ClientUtils.scala:97) > at > kafka.producer.BrokerPartitionInfo.(BrokerPartitionInfo.scala:32) > at > kafka.producer.async.DefaultEventHandler.(DefaultEventHandler.scala:41) > at kafka.producer.Producer.(Producer.scala:59) > at kafka.producer.ConsoleProducer$.main(ConsoleProducer.scala:158) > at kafka.producer.ConsoleProducer.main(ConsoleProducer.scala) -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Assigned] (KAFKA-1618) Exception thrown when running console producer with no port number for the broker
[ https://issues.apache.org/jira/browse/KAFKA-1618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Balaji Seshadri reassigned KAFKA-1618: -- Assignee: Balaji Seshadri (was: Gwen Shapira) > Exception thrown when running console producer with no port number for the > broker > - > > Key: KAFKA-1618 > URL: https://issues.apache.org/jira/browse/KAFKA-1618 > Project: Kafka > Issue Type: Improvement >Affects Versions: 0.8.1.1 >Reporter: Gwen Shapira >Assignee: Balaji Seshadri > Labels: newbie > Fix For: 0.8.2 > > Attachments: KAFKA-1618-ALL.patch, KAFKA-1618.patch > > > When running console producer with just "localhost" as the broker list, I get > ArrayIndexOutOfBounds exception. > I expect either a clearer error about arguments or for the producer to > "guess" a default port. > [root@shapira-1 bin]# ./kafka-console-producer.sh --topic rufus1 > --broker-list localhost > java.lang.ArrayIndexOutOfBoundsException: 1 > at > kafka.client.ClientUtils$$anonfun$parseBrokerList$1.apply(ClientUtils.scala:102) > at > kafka.client.ClientUtils$$anonfun$parseBrokerList$1.apply(ClientUtils.scala:97) > at > scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:244) > at > scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:244) > at > scala.collection.mutable.ResizableArray$class.foreach(ResizableArray.scala:59) > at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:47) > at scala.collection.TraversableLike$class.map(TraversableLike.scala:244) > at scala.collection.AbstractTraversable.map(Traversable.scala:105) > at kafka.client.ClientUtils$.parseBrokerList(ClientUtils.scala:97) > at > kafka.producer.BrokerPartitionInfo.(BrokerPartitionInfo.scala:32) > at > kafka.producer.async.DefaultEventHandler.(DefaultEventHandler.scala:41) > at kafka.producer.Producer.(Producer.scala:59) > at kafka.producer.ConsoleProducer$.main(ConsoleProducer.scala:158) > at kafka.producer.ConsoleProducer.main(ConsoleProducer.scala) -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Comment Edited] (KAFKA-1618) Exception thrown when running console producer with no port number for the broker
[ https://issues.apache.org/jira/browse/KAFKA-1618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14134322#comment-14134322 ] Balaji Seshadri edited comment on KAFKA-1618 at 9/15/14 6:58 PM: - Hi [~nehanarkhede] There could be issue in code formatting of my patch.Please let me know the code formatter i should use. Is this formatter ok ?. http://svn.apache.org/viewvc/nutch/branches/2.x/eclipse-codeformat.xml?view=markup was (Author: balaji.seshadri): There could be issue in code formatting of my patch.Please let me know the code formatter i should use. Is this formatter ok ?. http://svn.apache.org/viewvc/nutch/branches/2.x/eclipse-codeformat.xml?view=markup > Exception thrown when running console producer with no port number for the > broker > - > > Key: KAFKA-1618 > URL: https://issues.apache.org/jira/browse/KAFKA-1618 > Project: Kafka > Issue Type: Improvement >Affects Versions: 0.8.1.1 >Reporter: Gwen Shapira >Assignee: Gwen Shapira > Labels: newbie > Fix For: 0.8.2 > > Attachments: KAFKA-1618-ALL.patch, KAFKA-1618.patch > > > When running console producer with just "localhost" as the broker list, I get > ArrayIndexOutOfBounds exception. > I expect either a clearer error about arguments or for the producer to > "guess" a default port. > [root@shapira-1 bin]# ./kafka-console-producer.sh --topic rufus1 > --broker-list localhost > java.lang.ArrayIndexOutOfBoundsException: 1 > at > kafka.client.ClientUtils$$anonfun$parseBrokerList$1.apply(ClientUtils.scala:102) > at > kafka.client.ClientUtils$$anonfun$parseBrokerList$1.apply(ClientUtils.scala:97) > at > scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:244) > at > scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:244) > at > scala.collection.mutable.ResizableArray$class.foreach(ResizableArray.scala:59) > at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:47) > at scala.collection.TraversableLike$class.map(TraversableLike.scala:244) > at scala.collection.AbstractTraversable.map(Traversable.scala:105) > at kafka.client.ClientUtils$.parseBrokerList(ClientUtils.scala:97) > at > kafka.producer.BrokerPartitionInfo.(BrokerPartitionInfo.scala:32) > at > kafka.producer.async.DefaultEventHandler.(DefaultEventHandler.scala:41) > at kafka.producer.Producer.(Producer.scala:59) > at kafka.producer.ConsoleProducer$.main(ConsoleProducer.scala:158) > at kafka.producer.ConsoleProducer.main(ConsoleProducer.scala) -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (KAFKA-1618) Exception thrown when running console producer with no port number for the broker
[ https://issues.apache.org/jira/browse/KAFKA-1618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Balaji Seshadri updated KAFKA-1618: --- Attachment: KAFKA-1618-ALL.patch There could be issue in code formatting of my patch.Please let me know the code formatter i should use. Is this formatter ok ?. http://svn.apache.org/viewvc/nutch/branches/2.x/eclipse-codeformat.xml?view=markup > Exception thrown when running console producer with no port number for the > broker > - > > Key: KAFKA-1618 > URL: https://issues.apache.org/jira/browse/KAFKA-1618 > Project: Kafka > Issue Type: Improvement >Affects Versions: 0.8.1.1 >Reporter: Gwen Shapira >Assignee: Gwen Shapira > Labels: newbie > Fix For: 0.8.2 > > Attachments: KAFKA-1618-ALL.patch, KAFKA-1618.patch > > > When running console producer with just "localhost" as the broker list, I get > ArrayIndexOutOfBounds exception. > I expect either a clearer error about arguments or for the producer to > "guess" a default port. > [root@shapira-1 bin]# ./kafka-console-producer.sh --topic rufus1 > --broker-list localhost > java.lang.ArrayIndexOutOfBoundsException: 1 > at > kafka.client.ClientUtils$$anonfun$parseBrokerList$1.apply(ClientUtils.scala:102) > at > kafka.client.ClientUtils$$anonfun$parseBrokerList$1.apply(ClientUtils.scala:97) > at > scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:244) > at > scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:244) > at > scala.collection.mutable.ResizableArray$class.foreach(ResizableArray.scala:59) > at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:47) > at scala.collection.TraversableLike$class.map(TraversableLike.scala:244) > at scala.collection.AbstractTraversable.map(Traversable.scala:105) > at kafka.client.ClientUtils$.parseBrokerList(ClientUtils.scala:97) > at > kafka.producer.BrokerPartitionInfo.(BrokerPartitionInfo.scala:32) > at > kafka.producer.async.DefaultEventHandler.(DefaultEventHandler.scala:41) > at kafka.producer.Producer.(Producer.scala:59) > at kafka.producer.ConsoleProducer$.main(ConsoleProducer.scala:158) > at kafka.producer.ConsoleProducer.main(ConsoleProducer.scala) -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KAFKA-328) Write unit test for kafka server startup and shutdown API
[ https://issues.apache.org/jira/browse/KAFKA-328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14073400#comment-14073400 ] Balaji Seshadri commented on KAFKA-328: --- [~nehanarkhede] i didnot see any such unit tests i have mentioned in my comment in current codebase. > Write unit test for kafka server startup and shutdown API > -- > > Key: KAFKA-328 > URL: https://issues.apache.org/jira/browse/KAFKA-328 > Project: Kafka > Issue Type: Bug >Reporter: Neha Narkhede >Assignee: BalajiSeshadri > Labels: newbie > > Background discussion in KAFKA-320 > People often try to embed KafkaServer in an application that ends up calling > startup() and shutdown() repeatedly and sometimes in odd ways. To ensure this > works correctly we have to be very careful about cleaning up resources. This > is a good practice for making unit tests reliable anyway. > A good first step would be to add some unit tests on startup and shutdown to > cover various cases: > 1. A Kafka server can startup if it is not already starting up, if it is not > currently being shutdown, or if it hasn't been already started > 2. A Kafka server can shutdown if it is not already shutting down, if it is > not currently starting up, or if it hasn't been already shutdown. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (KAFKA-328) Write unit test for kafka server startup and shutdown API
[ https://issues.apache.org/jira/browse/KAFKA-328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14073391#comment-14073391 ] Balaji Seshadri commented on KAFKA-328: --- [~nehanarkhede] can you please advise on my comments on this unit test ?. > Write unit test for kafka server startup and shutdown API > -- > > Key: KAFKA-328 > URL: https://issues.apache.org/jira/browse/KAFKA-328 > Project: Kafka > Issue Type: Bug >Reporter: Neha Narkhede >Assignee: BalajiSeshadri > Labels: newbie > > Background discussion in KAFKA-320 > People often try to embed KafkaServer in an application that ends up calling > startup() and shutdown() repeatedly and sometimes in odd ways. To ensure this > works correctly we have to be very careful about cleaning up resources. This > is a good practice for making unit tests reliable anyway. > A good first step would be to add some unit tests on startup and shutdown to > cover various cases: > 1. A Kafka server can startup if it is not already starting up, if it is not > currently being shutdown, or if it hasn't been already started > 2. A Kafka server can shutdown if it is not already shutting down, if it is > not currently starting up, or if it hasn't been already shutdown. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (KAFKA-1476) Get a list of consumer groups
[ https://issues.apache.org/jira/browse/KAFKA-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14073374#comment-14073374 ] Balaji Seshadri commented on KAFKA-1476: Hi [~neha.narkh...@gmail.com], Looks like we are in design mode before going into implementation.Removing offset checker and making ConsumerCommand for handling all management related to consumers is definitely good idea. This would add below tasks 1) --list -> will list all consumer groups 2) --describeGroup -> describes about this group,who are all the consumers of the group whats the lag on it. 3) --resetOffset --group --groupName -> this might reset the offset. This would be good list to add as usage would be easy.Also it would be better expose these as management API's instead of just main program,so anybody can build UI on top it. I added the list all already for remaining ones i need more inputs on where can i get the data. Please advise. > Get a list of consumer groups > - > > Key: KAFKA-1476 > URL: https://issues.apache.org/jira/browse/KAFKA-1476 > Project: Kafka > Issue Type: Wish > Components: tools >Affects Versions: 0.8.1.1 >Reporter: Ryan Williams >Assignee: BalajiSeshadri > Labels: newbie > Fix For: 0.9.0 > > Attachments: KAFKA-1476-RENAME.patch, KAFKA-1476.patch > > > It would be useful to have a way to get a list of consumer groups currently > active via some tool/script that ships with kafka. This would be helpful so > that the system tools can be explored more easily. > For example, when running the ConsumerOffsetChecker, it requires a group > option > bin/kafka-run-class.sh kafka.tools.ConsumerOffsetChecker --topic test --group > ? > But, when just getting started with kafka, using the console producer and > consumer, it is not clear what value to use for the group option. If a list > of consumer groups could be listed, then it would be clear what value to use. > Background: > http://mail-archives.apache.org/mod_mbox/kafka-users/201405.mbox/%3cCAOq_b1w=slze5jrnakxvak0gu9ctdkpazak1g4dygvqzbsg...@mail.gmail.com%3e -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Comment Edited] (KAFKA-1476) Get a list of consumer groups
[ https://issues.apache.org/jira/browse/KAFKA-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14073374#comment-14073374 ] Balaji Seshadri edited comment on KAFKA-1476 at 7/24/14 4:50 PM: - Hi [~nehanarkhede], Looks like we are in design mode before going into implementation.Removing offset checker and making ConsumerCommand for handling all management related to consumers is definitely good idea. This would add below tasks 1) --list -> will list all consumer groups 2) --describeGroup -> describes about this group,who are all the consumers of the group whats the lag on it. 3) --resetOffset --group --groupName -> this might reset the offset. This would be good list to add as usage would be easy.Also it would be better expose these as management API's instead of just main program,so anybody can build UI on top it. I added the list all already for remaining ones i need more inputs on where can i get the data. Please advise. was (Author: balaji.seshadri): Hi [~neha.narkh...@gmail.com], Looks like we are in design mode before going into implementation.Removing offset checker and making ConsumerCommand for handling all management related to consumers is definitely good idea. This would add below tasks 1) --list -> will list all consumer groups 2) --describeGroup -> describes about this group,who are all the consumers of the group whats the lag on it. 3) --resetOffset --group --groupName -> this might reset the offset. This would be good list to add as usage would be easy.Also it would be better expose these as management API's instead of just main program,so anybody can build UI on top it. I added the list all already for remaining ones i need more inputs on where can i get the data. Please advise. > Get a list of consumer groups > - > > Key: KAFKA-1476 > URL: https://issues.apache.org/jira/browse/KAFKA-1476 > Project: Kafka > Issue Type: Wish > Components: tools >Affects Versions: 0.8.1.1 >Reporter: Ryan Williams >Assignee: BalajiSeshadri > Labels: newbie > Fix For: 0.9.0 > > Attachments: KAFKA-1476-RENAME.patch, KAFKA-1476.patch > > > It would be useful to have a way to get a list of consumer groups currently > active via some tool/script that ships with kafka. This would be helpful so > that the system tools can be explored more easily. > For example, when running the ConsumerOffsetChecker, it requires a group > option > bin/kafka-run-class.sh kafka.tools.ConsumerOffsetChecker --topic test --group > ? > But, when just getting started with kafka, using the console producer and > consumer, it is not clear what value to use for the group option. If a list > of consumer groups could be listed, then it would be clear what value to use. > Background: > http://mail-archives.apache.org/mod_mbox/kafka-users/201405.mbox/%3cCAOq_b1w=slze5jrnakxvak0gu9ctdkpazak1g4dygvqzbsg...@mail.gmail.com%3e -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (KAFKA-1476) Get a list of consumer groups
[ https://issues.apache.org/jira/browse/KAFKA-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14066720#comment-14066720 ] Balaji Seshadri commented on KAFKA-1476: Which shell script should i change,i wrote only the class which i can change ?. > Get a list of consumer groups > - > > Key: KAFKA-1476 > URL: https://issues.apache.org/jira/browse/KAFKA-1476 > Project: Kafka > Issue Type: Wish > Components: tools >Affects Versions: 0.8.1.1 >Reporter: Ryan Williams > Labels: newbie > Fix For: 0.9.0 > > Attachments: KAFKA-1476.patch > > > It would be useful to have a way to get a list of consumer groups currently > active via some tool/script that ships with kafka. This would be helpful so > that the system tools can be explored more easily. > For example, when running the ConsumerOffsetChecker, it requires a group > option > bin/kafka-run-class.sh kafka.tools.ConsumerOffsetChecker --topic test --group > ? > But, when just getting started with kafka, using the console producer and > consumer, it is not clear what value to use for the group option. If a list > of consumer groups could be listed, then it would be clear what value to use. > Background: > http://mail-archives.apache.org/mod_mbox/kafka-users/201405.mbox/%3cCAOq_b1w=slze5jrnakxvak0gu9ctdkpazak1g4dygvqzbsg...@mail.gmail.com%3e -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (KAFKA-1476) Get a list of consumer groups
[ https://issues.apache.org/jira/browse/KAFKA-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14066698#comment-14066698 ] Balaji Seshadri commented on KAFKA-1476: ~jay.kreps > Get a list of consumer groups > - > > Key: KAFKA-1476 > URL: https://issues.apache.org/jira/browse/KAFKA-1476 > Project: Kafka > Issue Type: Wish > Components: tools >Affects Versions: 0.8.1.1 >Reporter: Ryan Williams > Labels: newbie > Fix For: 0.9.0 > > Attachments: KAFKA-1476.patch > > > It would be useful to have a way to get a list of consumer groups currently > active via some tool/script that ships with kafka. This would be helpful so > that the system tools can be explored more easily. > For example, when running the ConsumerOffsetChecker, it requires a group > option > bin/kafka-run-class.sh kafka.tools.ConsumerOffsetChecker --topic test --group > ? > But, when just getting started with kafka, using the console producer and > consumer, it is not clear what value to use for the group option. If a list > of consumer groups could be listed, then it would be clear what value to use. > Background: > http://mail-archives.apache.org/mod_mbox/kafka-users/201405.mbox/%3cCAOq_b1w=slze5jrnakxvak0gu9ctdkpazak1g4dygvqzbsg...@mail.gmail.com%3e -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Issue Comment Deleted] (KAFKA-1476) Get a list of consumer groups
[ https://issues.apache.org/jira/browse/KAFKA-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Balaji Seshadri updated KAFKA-1476: --- Comment: was deleted (was: ~jay.kreps ) > Get a list of consumer groups > - > > Key: KAFKA-1476 > URL: https://issues.apache.org/jira/browse/KAFKA-1476 > Project: Kafka > Issue Type: Wish > Components: tools >Affects Versions: 0.8.1.1 >Reporter: Ryan Williams > Labels: newbie > Fix For: 0.9.0 > > Attachments: KAFKA-1476.patch > > > It would be useful to have a way to get a list of consumer groups currently > active via some tool/script that ships with kafka. This would be helpful so > that the system tools can be explored more easily. > For example, when running the ConsumerOffsetChecker, it requires a group > option > bin/kafka-run-class.sh kafka.tools.ConsumerOffsetChecker --topic test --group > ? > But, when just getting started with kafka, using the console producer and > consumer, it is not clear what value to use for the group option. If a list > of consumer groups could be listed, then it would be clear what value to use. > Background: > http://mail-archives.apache.org/mod_mbox/kafka-users/201405.mbox/%3cCAOq_b1w=slze5jrnakxvak0gu9ctdkpazak1g4dygvqzbsg...@mail.gmail.com%3e -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (KAFKA-1476) Get a list of consumer groups
[ https://issues.apache.org/jira/browse/KAFKA-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14066695#comment-14066695 ] Balaji Seshadri commented on KAFKA-1476: I have completed 1 and 2,will work on 3/4.Can you guys give me some pointers on how to query coordinator. May i should add print Usage for 1 and 2. > Get a list of consumer groups > - > > Key: KAFKA-1476 > URL: https://issues.apache.org/jira/browse/KAFKA-1476 > Project: Kafka > Issue Type: Wish > Components: tools >Affects Versions: 0.8.1.1 >Reporter: Ryan Williams > Labels: newbie > Fix For: 0.9.0 > > Attachments: KAFKA-1476.patch > > > It would be useful to have a way to get a list of consumer groups currently > active via some tool/script that ships with kafka. This would be helpful so > that the system tools can be explored more easily. > For example, when running the ConsumerOffsetChecker, it requires a group > option > bin/kafka-run-class.sh kafka.tools.ConsumerOffsetChecker --topic test --group > ? > But, when just getting started with kafka, using the console producer and > consumer, it is not clear what value to use for the group option. If a list > of consumer groups could be listed, then it would be clear what value to use. > Background: > http://mail-archives.apache.org/mod_mbox/kafka-users/201405.mbox/%3cCAOq_b1w=slze5jrnakxvak0gu9ctdkpazak1g4dygvqzbsg...@mail.gmail.com%3e -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Comment Edited] (KAFKA-1365) Second Manual preferred replica leader election command always fails
[
https://issues.apache.org/jira/browse/KAFKA-1365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13969911#comment-13969911
]
Balaji Seshadri edited comment on KAFKA-1365 at 4/15/14 7:02 PM:
-
I can help fix this as its happening for us in DISH Upgrade,please direct me
accordingly.
Please see email from Bob.
-Original Message-
From: Bello, Bob [mailto:bob.be...@dish.com]
Sent: Tuesday, April 15, 2014 10:00 AM
To: us...@kafka.apache.org
Cc: Bello, Bob
Subject: RE: Kafka upgrade 0.8.0 to 0.8.1 - kafka-preferred-replica-election
failure
I performed another test. I build a single Kafka 0.8.1 Broker with a single ZK
instance. Brand new, no topics.
Upon start up of the Kafka broker, the zookeeper /admin node only contains
"/admin/delete_topics".
Even without creating a topic, I run a perfered replica election, and it's
successful. After the run, I check the node for
/admin/preferred_replica_election and it exists.
[zk: tm1mwwm001:2181(CONNECTED) 0] get /admin/preferred_replica_election
{"version":1,"partitions":[]} cZxid = 0x19 ctime = Tue Apr 15 09:53:22 MDT 2014
mZxid = 0x19 mtime = Tue Apr 15 09:53:22 MDT 2014 pZxid = 0x19 cversion = 0
dataVersion = 0 aclVersion = 0 ephemeralOwner = 0x0 dataLength = 29 numChildren
= 0
If I run the election again, I get the following error (the same error as my
original post).
Failed to start preferred replica election
kafka.common.AdminCommandFailedException: Admin command failed
at
kafka.admin.PreferredReplicaLeaderElectionCommand.moveLeaderToPreferredReplica(PreferredReplicaLeaderElectionCommand.scala:115)
at
kafka.admin.PreferredReplicaLeaderElectionCommand$.main(PreferredReplicaLeaderElectionCommand.scala:60)
at
kafka.admin.PreferredReplicaLeaderElectionCommand.main(PreferredReplicaLeaderElectionCommand.scala)
Caused by: kafka.admin.AdminOperationException: Preferred replica leader
election currently in progress for Set(). Aborting operation
at
kafka.admin.PreferredReplicaLeaderElectionCommand$.writePreferredReplicaElectionData(PreferredReplicaLeaderElectionCommand.scala:101)
at
kafka.admin.PreferredReplicaLeaderElectionCommand.moveLeaderToPreferredReplica(PreferredReplicaLeaderElectionCommand.scala:113)
... 2 more
The zookeeper log shows the following:
2014-04-15 09:53:44 INFO server.PrepRequestProcessor - Got user-level
KeeperException when processing sessionid:0x1456615e7770006 type:create
cxid:0x2 zxid:0x1e txntype:-1 reqpath:n/a Error
Path:/admin/preferred_replica_election Error:KeeperErrorCode = NodeExists for
/admin/preferred_replica_election
It looks like the preferred election process is not removing the node after
completion.
Bob Bello
Middleware Applications Administrator
Direct: 720-514-6605
email: bob.be...@dish.com
was (Author: balaji.seshadri):
I can help fix this as its happening for us in DISH Upgrade,please direct me
accordingly.
> Second Manual preferred replica leader election command always fails
>
>
> Key: KAFKA-1365
> URL: https://issues.apache.org/jira/browse/KAFKA-1365
> Project: Kafka
> Issue Type: Bug
> Components: controller, tools
>Affects Versions: 0.8.1
>Reporter: Ryan Berdeen
>Assignee: Neha Narkhede
>Priority: Critical
> Fix For: 0.8.2
>
>
> After running kafka-preferred-replica-election.sh once, a second run will
> fail with "Preferred replica leader election currently in progress for ...".
> The /admin/preferred_replica_election key is never deleted from ZooKeeper,
> because the "isTriggeredByAutoRebalance" parameter to
> onPreferredReplicaElection
> (https://github.com/apache/kafka/blob/0ffec142a991849833d9767be07e895428ccaea1/core/src/main/scala/kafka/controller/KafkaController.scala#L614)
> is used incorrectly. In the automatic case
> (https://github.com/apache/kafka/blob/0ffec142a991849833d9767be07e895428ccaea1/core/src/main/scala/kafka/controller/KafkaController.scala#L1119),
> it is set to false. In the manual case
> (https://github.com/apache/kafka/blob/0ffec142a991849833d9767be07e895428ccaea1/core/src/main/scala/kafka/controller/KafkaController.scala#L1266)
> the parameter is not passed, so it defaults to true.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (KAFKA-1365) Second Manual preferred replica leader election command always fails
[ https://issues.apache.org/jira/browse/KAFKA-1365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13969911#comment-13969911 ] Balaji Seshadri commented on KAFKA-1365: I can help fix this as its happening for us in DISH Upgrade,please direct me accordingly. > Second Manual preferred replica leader election command always fails > > > Key: KAFKA-1365 > URL: https://issues.apache.org/jira/browse/KAFKA-1365 > Project: Kafka > Issue Type: Bug > Components: controller, tools >Affects Versions: 0.8.1 >Reporter: Ryan Berdeen >Assignee: Neha Narkhede >Priority: Critical > Fix For: 0.8.2 > > > After running kafka-preferred-replica-election.sh once, a second run will > fail with "Preferred replica leader election currently in progress for ...". > The /admin/preferred_replica_election key is never deleted from ZooKeeper, > because the "isTriggeredByAutoRebalance" parameter to > onPreferredReplicaElection > (https://github.com/apache/kafka/blob/0ffec142a991849833d9767be07e895428ccaea1/core/src/main/scala/kafka/controller/KafkaController.scala#L614) > is used incorrectly. In the automatic case > (https://github.com/apache/kafka/blob/0ffec142a991849833d9767be07e895428ccaea1/core/src/main/scala/kafka/controller/KafkaController.scala#L1119), > it is set to false. In the manual case > (https://github.com/apache/kafka/blob/0ffec142a991849833d9767be07e895428ccaea1/core/src/main/scala/kafka/controller/KafkaController.scala#L1266) > the parameter is not passed, so it defaults to true. -- This message was sent by Atlassian JIRA (v6.2#6252)
