[jira] [Updated] (KAFKA-637) Separate log4j environment variable from KAFKA_OPTS in kafka-run-class.sh

2012-11-28 Thread David Arthur (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Arthur updated KAFKA-637: --- Attachment: KAFKA-637.patch Something like this? I can now invoke the bin script like: {code} LOG4J_

[jira] [Comment Edited] (KAFKA-637) Separate log4j environment variable from KAFKA_OPTS in kafka-run-class.sh

2012-11-28 Thread David Arthur (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13506190#comment-13506190 ] David Arthur edited comment on KAFKA-637 at 11/29/12 3:48 AM: --

[jira] [Commented] (KAFKA-521) Refactor Log subsystem

2012-11-28 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13506155#comment-13506155 ] Neha Narkhede commented on KAFKA-521: - 1.2 Tried that, looks like none of those approac

[jira] [Closed] (KAFKA-622) Create mbeans per client

2012-11-28 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede closed KAFKA-622. --- > Create mbeans per client > - > > Key: KAFKA-622 >

[jira] [Resolved] (KAFKA-622) Create mbeans per client

2012-11-28 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede resolved KAFKA-622. - Resolution: Fixed Committed patch v6 after making the following minor changes- 1. Changed the conf

[jira] [Commented] (KAFKA-622) Create mbeans per client

2012-11-28 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13506119#comment-13506119 ] Neha Narkhede commented on KAFKA-622: - 9. Sounds good. 14. That's a good suggestion but

[jira] [Updated] (KAFKA-622) Create mbeans per client

2012-11-28 Thread Swapnil Ghike (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Swapnil Ghike updated KAFKA-622: Attachment: kafka-622-v6.patch Oops, another quick fix. Didn't realize that syncproducer was not get

Re: new mailing lists

2012-11-28 Thread Neha Narkhede
Thanks for the note, Owen ! Filed a ticket for Kafka's website - https://issues.apache.org/jira/browse/INFRA-5577 -Neha On Wed, Nov 28, 2012 at 4:43 PM, Owen O'Malley wrote: > You need to file an INFRA jira. For the list of infra tickets that we used > in Giraph, look at: https://issues.apache.o

Re: Kafka REST interface

2012-11-28 Thread David Arthur
I've opened KAFKA-639 to track this feature On Nov 28, 2012, at 3:32 PM, David Arthur wrote: > Are you referring to the HTTP side of things? If not, I'm not sure exactly > what you mean by threaded I/O in this context > > -David > > On Nov 21, 2012, at 10:54 AM, Taylor Gautier wrote: > >> It

Re: Kafka REST interface

2012-11-28 Thread David Arthur
I've opened KAFKA-639 to track this feature On Nov 28, 2012, at 3:32 PM, David Arthur wrote: > Are you referring to the HTTP side of things? If not, I'm not sure exactly > what you mean by threaded I/O in this context > > -David > > On Nov 21, 2012, at 10:54 AM, Taylor Gautier wrote: > >> It

[jira] [Comment Edited] (KAFKA-639) RESTful proxy

2012-11-28 Thread David Arthur (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13506117#comment-13506117 ] David Arthur edited comment on KAFKA-639 at 11/29/12 1:17 AM: --

[jira] [Commented] (KAFKA-639) RESTful proxy

2012-11-28 Thread David Arthur (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13506117#comment-13506117 ] David Arthur commented on KAFKA-639: I've committed some work on this to a personal for

[jira] [Updated] (KAFKA-622) Create mbeans per client

2012-11-28 Thread Swapnil Ghike (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Swapnil Ghike updated KAFKA-622: Attachment: kafka-622-v5.patch Quick fix to interchange the order of constructor arguments of Client

[jira] [Created] (KAFKA-639) RESTful proxy

2012-11-28 Thread David Arthur (JIRA)
David Arthur created KAFKA-639: -- Summary: RESTful proxy Key: KAFKA-639 URL: https://issues.apache.org/jira/browse/KAFKA-639 Project: Kafka Issue Type: New Feature Components: contrib

[jira] [Commented] (KAFKA-521) Refactor Log subsystem

2012-11-28 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13506098#comment-13506098 ] Jay Kreps commented on KAFKA-521: - 1.1 Good catch 1.2 According to my reading of the scalad

Re: new mailing lists

2012-11-28 Thread Owen O'Malley
You need to file an INFRA jira. For the list of infra tickets that we used in Giraph, look at: https://issues.apache.org/jira/browse/INFRA-4810. -- Owen On Wed, Nov 28, 2012 at 4:18 PM, Jay Kreps wrote: > Ah, good point. Anyone know how we get that? > > -Jay > > > On Wed, Nov 28, 2012 at 2:57

[jira] [Updated] (KAFKA-622) Create mbeans per client

2012-11-28 Thread Swapnil Ghike (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Swapnil Ghike updated KAFKA-622: Attachment: kafka-622-v4.patch 9 - I am not convinced that "ClientIdAndTopicPartition" is the right

Re: Kafka svn repo removed from incubator

2012-11-28 Thread Neha Narkhede
Gavin, Thanks for moving the repository. Any idea what needs to be done to get the website moved ? -Neha On Wed, Nov 28, 2012 at 4:08 PM, Gavin McDonald wrote: > Yep > > > > http://svn.apache.org/repos/asf/kafka/ > > > > Your project was guinea pig for a new incubator to tlp workflow. > > > > K

[jira] [Commented] (KAFKA-521) Refactor Log subsystem

2012-11-28 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13506083#comment-13506083 ] Neha Narkhede commented on KAFKA-521: - Thanks for v5, few things (mostly minor, except

Re: new mailing lists

2012-11-28 Thread Jay Kreps
Ah, good point. Anyone know how we get that? -Jay On Wed, Nov 28, 2012 at 2:57 PM, Neha Narkhede wrote: > Sure, it seems like we should have http://kafka.apache.org (by > convention), but maybe Infra hasn't created one for us yet. > > Thanks, > Neha > > On Wed, Nov 28, 2012 at 2:54 PM, Jay Krep

[jira] [Commented] (KAFKA-614) DumpLogSegment offset verification is incorrect for compressed messages

2012-11-28 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13506070#comment-13506070 ] Jun Rao commented on KAFKA-614: --- Thanks for the second patch. Committed to 0.8.

RE: Kafka svn repo removed from incubator

2012-11-28 Thread Gavin McDonald
Yep http://svn.apache.org/repos/asf/kafka/ Your project was guinea pig for a new incubator to tlp workflow. Kafkas move to TLP is complete , svn, mailing lists all done. We still need to move your website but that's about it I think. Apologies that you were not notified in advan

[jira] [Assigned] (KAFKA-638) remove ProducerShell

2012-11-28 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao reassigned KAFKA-638: - Assignee: Jun Rao > remove ProducerShell > > > Key: KAFKA-638 >

[jira] [Updated] (KAFKA-638) remove ProducerShell

2012-11-28 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-638: -- Resolution: Fixed Fix Version/s: 0.8 Status: Resolved (was: Patch Available) Thanks for the r

[jira] [Closed] (KAFKA-638) remove ProducerShell

2012-11-28 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao closed KAFKA-638. - > remove ProducerShell > > > Key: KAFKA-638 > URL: https://is

Re: new mailing lists

2012-11-28 Thread Neha Narkhede
Sure, it seems like we should have http://kafka.apache.org (by convention), but maybe Infra hasn't created one for us yet. Thanks, Neha On Wed, Nov 28, 2012 at 2:54 PM, Jay Kreps wrote: > Should I update the site? > > -Jay > > > On Wed, Nov 28, 2012 at 1:12 PM, Jun Rao wrote: > >> We now have t

Re: new mailing lists

2012-11-28 Thread Jay Kreps
Should I update the site? -Jay On Wed, Nov 28, 2012 at 1:12 PM, Jun Rao wrote: > We now have the following new mailing list. Existing subscribers should > already be moved automatically. > > dev@kafka.apache.org > us...@kafka.apache.org > > Thanks, > > Jun >

[jira] [Updated] (KAFKA-604) Add missing metrics in 0.8

2012-11-28 Thread Yang Ye (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Ye updated KAFKA-604: -- Attachment: kafka_604_v2.patch rebased patch > Add missing metrics in 0.8 > ---

[jira] [Updated] (KAFKA-614) DumpLogSegment offset verification is incorrect for compressed messages

2012-11-28 Thread Yang Ye (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Ye updated KAFKA-614: -- Attachment: dump_fix.diff Dump Log segment too continue patch > DumpLogSegment offset verifica

[jira] [Commented] (KAFKA-638) remove ProducerShell

2012-11-28 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13505994#comment-13505994 ] Neha Narkhede commented on KAFKA-638: - +1 > remove ProducerShell > ---

[jira] [Updated] (KAFKA-638) remove ProducerShell

2012-11-28 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-638: -- Attachment: kafka-638.patch Attach a patch. > remove ProducerShell > > >

[jira] [Updated] (KAFKA-638) remove ProducerShell

2012-11-28 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-638: -- Status: Patch Available (was: Open) > remove ProducerShell > > > Key:

[jira] [Created] (KAFKA-638) remove ProducerShell

2012-11-28 Thread Jun Rao (JIRA)
Jun Rao created KAFKA-638: - Summary: remove ProducerShell Key: KAFKA-638 URL: https://issues.apache.org/jira/browse/KAFKA-638 Project: Kafka Issue Type: Improvement Components: core Aff

[jira] [Commented] (KAFKA-622) Create mbeans per client

2012-11-28 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13505934#comment-13505934 ] Neha Narkhede commented on KAFKA-622: - v3 looks much better and almost ready for check

[jira] [Updated] (KAFKA-632) ProducerRequest should take ByteBufferMessageSet instead of MessageSet

2012-11-28 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-632: -- Resolution: Fixed Status: Resolved (was: Patch Available) Thanks for the review. Committed to 0.8.

[jira] [Closed] (KAFKA-632) ProducerRequest should take ByteBufferMessageSet instead of MessageSet

2012-11-28 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao closed KAFKA-632. - > ProducerRequest should take ByteBufferMessageSet instead of MessageSet > ---

[jira] [Assigned] (KAFKA-632) ProducerRequest should take ByteBufferMessageSet instead of MessageSet

2012-11-28 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao reassigned KAFKA-632: - Assignee: Jun Rao > ProducerRequest should take ByteBufferMessageSet instead of MessageSet > -

Re: git wip incubator-kafka.git

2012-11-28 Thread Chris Burroughs
Not sure what infra prefers, new ticket makes sense to me. By move the svn location, you mean move git as part of graduation, right? On 11/28/2012 01:28 AM, Jun Rao wrote: > Chris, > > I plan to submit an infra ticket for the post graduation items. One of the > subtasks will be to move our svn r

Re: Kafka REST interface

2012-11-28 Thread David Arthur
Are you referring to the HTTP side of things? If not, I'm not sure exactly what you mean by threaded I/O in this context -David On Nov 21, 2012, at 10:54 AM, Taylor Gautier wrote: > It would make sense to use nio rather than threaded io. > > > > On Nov 20, 2012, at 2:06 PM, David Arthur wr

Re: Kafka 0.8 trial version

2012-11-28 Thread Jay Kreps
I added a section at the beginning that says what features are in 0.8 and set some context for people not following the mailing list. Check it out if you get a chance and see if I got everything right: -Jay On Mon, Nov 26, 2012 at 9:23 AM, Jun Rao wrote: > Hi, Everyone, > > Thanks to people w

[jira] [Created] (KAFKA-637) Separate log4j environment variable from KAFKA_OPTS in kafka-run-class.sh

2012-11-28 Thread Chris Curtin (JIRA)
Chris Curtin created KAFKA-637: -- Summary: Separate log4j environment variable from KAFKA_OPTS in kafka-run-class.sh Key: KAFKA-637 URL: https://issues.apache.org/jira/browse/KAFKA-637 Project: Kafka

[jira] [Commented] (KAFKA-632) ProducerRequest should take ByteBufferMessageSet instead of MessageSet

2012-11-28 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13505781#comment-13505781 ] Neha Narkhede commented on KAFKA-632: - +1 > ProducerRequest should tak

[jira] [Updated] (KAFKA-632) ProducerRequest should take ByteBufferMessageSet instead of MessageSet

2012-11-28 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-632: -- Fix Version/s: 0.8 Status: Patch Available (was: Open) > ProducerRequest should take ByteBufferM

[jira] [Updated] (KAFKA-632) ProducerRequest should take ByteBufferMessageSet instead of MessageSet

2012-11-28 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-632: -- Attachment: kafka-632.patch Attach a patch. > ProducerRequest should take ByteBufferMessageSet

new location of Kafka repo

2012-11-28 Thread Jun Rao
It seems that Apache infra already moved Kafka repo to the top level. The following is the new svn location for the 0.8 branch. https://svn.apache.org/repos/asf/kafka/branches/0.8 Thanks, Jun

Kafka svn repo removed from incubator

2012-11-28 Thread Jun Rao
Hi, It seems that Kafka svn repository suddenly disappeared today. We officially graduated from incubator last week, but haven't filed infra tickets to move our repository yet. Is our repository automatically moved to somewhere? svn ls https://svn.apache.org/repos/asf/incubator/kafka svn: URL 'ht

[jira] [Commented] (KAFKA-635) Producer error when trying to send not displayed unless in DEBUG logging level

2012-11-28 Thread Chris Curtin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13505437#comment-13505437 ] Chris Curtin commented on KAFKA-635: Probably not DEBUG but that is where I started whe