Re: REST API

2013-07-19 Thread Jay Kreps
Makes sense. -Jay On Fri, Jul 19, 2013 at 5:25 PM, David Arthur wrote: > I think there would be many advantages to having a REST API in Kafka, as a > core component. Not just for data services (producing/consuming messages), > but also for admin. I could imagine a Kafka web console that showed

Re: SimpleConsumer metadata request hangs

2013-07-19 Thread Benjamin Black
Solution: this is caused by mixing Scala 2.8.0 Kafka with some 2.9.1 client code. Rebuilding Kafka with 2.9.2 solved the problem. On Jul 19, 2013 11:30 AM, "Benjamin Black" wrote: > Looks fine on the broker. The data is just not being returned from the > call to SimpleConsumer. > > [2013-07-19 11

Re: REST API

2013-07-19 Thread David Arthur
I think there would be many advantages to having a REST API in Kafka, as a core component. Not just for data services (producing/consuming messages), but also for admin. I could imagine a Kafka web console that showed various stats, allowed for maintenance operations, showed pretty viz of the c

[jira] [Commented] (KAFKA-347) change number of partitions of a topic online

2013-07-19 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13714259#comment-13714259 ] Joel Koshy commented on KAFKA-347: -- Thanks for patch v2. I'm +1 on this as is, but if you

Re: REST API

2013-07-19 Thread Jay Kreps
I think this is really cool and would be useful for a lot of people. David, do you think it would really benefit from being a contrib package in kafka versus a separately hosted github project? Here was our experience: contrib packages tend to get added but the authors and don't necessarily want i

Re: SimpleConsumer metadata request hangs

2013-07-19 Thread Benjamin Black
Looks fine on the broker. The data is just not being returned from the call to SimpleConsumer. [2013-07-19 11:22:09,426] DEBUG Processor 0 listening to new connection from /127.0.0.1:58809 (kafka.network.Processor) [2013-07-19 11:22:09,426] DEBUG Processor 1 listening to new connection from /127.0

[jira] [Commented] (KAFKA-347) change number of partitions of a topic online

2013-07-19 Thread Sriram Subramanian (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13713901#comment-13713901 ] Sriram Subramanian commented on KAFKA-347: -- Joel - I did not see a big difference

[jira] [Updated] (KAFKA-347) change number of partitions of a topic online

2013-07-19 Thread Sriram Subramanian (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sriram Subramanian updated KAFKA-347: - Attachment: kafka-347-v2.patch > change number of partitions of a topic online > -

[jira] [Commented] (KAFKA-347) change number of partitions of a topic online

2013-07-19 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13713864#comment-13713864 ] Neha Narkhede commented on KAFKA-347: - Overall, this looks great and sorry for not comi

Re: SimpleConsumer metadata request hangs

2013-07-19 Thread Jay Kreps
Interesting. Could you try turning on trace level logging on the broker and reproduce? Or, if you have a reproducible test case I can take a look. We haven't hit this yet in our production usage. -Jay On Thu, Jul 18, 2013 at 10:00 PM, Benjamin Black wrote: > Using Kafka 0.8 (current as of a f