[jira] [Commented] (KAFKA-835) Update 0.8 configs on the website

[ https://issues.apache.org/jira/browse/KAFKA-835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13698668#comment-13698668 ] Swapnil Ghike commented on KAFKA-835: - This was committed http://kafka.apache.org/08/co

Re: criteria for fixes on 0.8 beta

My vote is that a patch can go into 0.8 if (1) it fixes a critical issue or (2) the change is trivial and it makes the 0.8 experience better (e.g., improving log4j readability). kafka-946 may fall into (2). Thanks, Jun On Tue, Jul 2, 2013 at 7:34 PM, Joe Stein wrote: > << How about for now: b

[jira] [Created] (KAFKA-957) MirrorMaker needs to preserve the key in the source cluster

Jun Rao created KAFKA-957: - Summary: MirrorMaker needs to preserve the key in the source cluster Key: KAFKA-957 URL: https://issues.apache.org/jira/browse/KAFKA-957 Project: Kafka Issue Type: Bug

[jira] [Commented] (KAFKA-718) kafka-run-class.sh should use reasonable gc settings

[ https://issues.apache.org/jira/browse/KAFKA-718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13698576#comment-13698576 ] Jay Kreps commented on KAFKA-718: - That would be great. > kafka-run-class.

[jira] [Commented] (KAFKA-718) kafka-run-class.sh should use reasonable gc settings

[ https://issues.apache.org/jira/browse/KAFKA-718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13698560#comment-13698560 ] Ashwanth Fernando commented on KAFKA-718: - Hi, This bug seems to be open for a long

[jira] [Resolved] (KAFKA-616) Implement acks=0

[ https://issues.apache.org/jira/browse/KAFKA-616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Kreps resolved KAFKA-616. - Resolution: Fixed Assignee: Neha Narkhede Neha did it :-) > Implement acks=0 >

[jira] [Resolved] (KAFKA-555) Add a key-based log retention strategy

[ https://issues.apache.org/jira/browse/KAFKA-555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Kreps resolved KAFKA-555. - Resolution: Duplicate Assignee: Jay Kreps Did it. > Add a key-based log retention s

[jira] [Resolved] (KAFKA-739) Handle null values in Message payload

[ https://issues.apache.org/jira/browse/KAFKA-739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Kreps resolved KAFKA-739. - Resolution: Fixed > Handle null values in Message payload > - > >

[jira] [Commented] (KAFKA-835) Update 0.8 configs on the website

[ https://issues.apache.org/jira/browse/KAFKA-835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13698548#comment-13698548 ] Jay Kreps commented on KAFKA-835: - Also if you could "rebase" off current site html...

[jira] [Commented] (KAFKA-835) Update 0.8 configs on the website

[ https://issues.apache.org/jira/browse/KAFKA-835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13698547#comment-13698547 ] Jay Kreps commented on KAFKA-835: - Swapnil, is this still outstanding? If so I can apply...

[jira] [Commented] (KAFKA-893) Unable to access kafka via Tomcat

[ https://issues.apache.org/jira/browse/KAFKA-893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13698545#comment-13698545 ] Jay Kreps commented on KAFKA-893: - I think this happens if you have the wrong version of sc

[jira] [Commented] (KAFKA-918) Change log.retention.hours to be log.retention.mins

[ https://issues.apache.org/jira/browse/KAFKA-918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13698541#comment-13698541 ] Jay Kreps commented on KAFKA-918: - This make sense, should be a pretty easy fix. We would d

Re: Helping out

I actually don't think quotas really needs to do cross-broker communication. I think we can just enforce it at the topic-partition level and have the leader do the check (even if the user expresses the quota at the topic level we will just turn it into a per-partition limit by dividing by the numbe

Re: Helping out

Actually the intern ended up working on offset storage (https://cwiki.apache.org/confluence/display/KAFKA/Offset+Management) in case any one is still interested in quotas. -Jay On Tue, Jun 25, 2013 at 8:54 PM, Jun Rao wrote: > As for offset management, we have a summer intern starting this week

Re: criteria for fixes on 0.8 beta

<< How about for now: by default we will not incorporate fixes into 0.8 unless there is a compelling argument (e.g., regression/clear bug with no good workaround) to do so. +1 On Tue, Jul 2, 2013 at 8:48 PM, Joel Koshy wrote: > Good question. Some fixes are clearly critical (e.g., consumer > d

Re: criteria for fixes on 0.8 beta

Good question. Some fixes are clearly critical (e.g., consumer deadlocks) that would impact everyone and need to go into 0.8. Unfortunately the criticality of most other fixes is subjective and I'm not sure how feasible it is to develop a global criteria. It probably needs to be determined through

criteria for fixes on 0.8 beta

What should the criteria for fixes on 0.8 be? This seems like a reasonable candidate but I don't think we discussed what we would be taking so I thought I would ask... https://issues.apache.org/jira/browse/KAFKA-946 -Jay

[jira] [Commented] (KAFKA-946) Kafka Hadoop Consumer fails when verifying message checksum

[ https://issues.apache.org/jira/browse/KAFKA-946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13698427#comment-13698427 ] Jay Kreps commented on KAFKA-946: - Ack, well that's broken. Richard--is this a reasonable

Kafka/Hadoop consumers and producers

We currently have a contrib package for consuming and producing messages from mapreduce ( https://git-wip-us.apache.org/repos/asf?p=kafka.git;a=tree;f=contrib;h=e53e1fb34893e733b10ff27e79e6a1dcbb8d7ab0;hb=HEAD ). We keep running into problems (e.g. KAFKA-946) that are basically due to the fact tha

[jira] [Commented] (KAFKA-943) Move all configuration key string to constants

[ https://issues.apache.org/jira/browse/KAFKA-943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13698401#comment-13698401 ] Jay Kreps commented on KAFKA-943: - Hey Sam, thanks for the patch it is great to get clean-u

[jira] [Commented] (KAFKA-559) Garbage collect old consumer metadata entries

[ https://issues.apache.org/jira/browse/KAFKA-559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13698307#comment-13698307 ] Joel Koshy commented on KAFKA-559: -- One additional recommendation: support a --dry-run opt

[jira] [Assigned] (KAFKA-559) Garbage collect old consumer metadata entries

[ https://issues.apache.org/jira/browse/KAFKA-559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joel Koshy reassigned KAFKA-559: Assignee: Tejas Patil Assigning to Tejas, since he has done some work on this recently.

Re: Kafka User Group Meeting Jun. 27

Erp, actually I don't see a way to get the recording there, nm. -Jay On Tue, Jul 2, 2013 at 12:47 PM, Jay Kreps wrote: > The recording for the user group talks is available here: > http://www.ustream.tv/linkedin-events > > -Jay > > > On Wed, Jun 26, 2013 at 8:22 AM, Jun Rao wrote: > >> Hi, Ev

Re: Kafka User Group Meeting Jun. 27

The recording for the user group talks is available here: http://www.ustream.tv/linkedin-events -Jay On Wed, Jun 26, 2013 at 8:22 AM, Jun Rao wrote: > Hi, Everyone, > > We have finalized our agenda of the meetup Thursday evening, with Speakers > from LinkedIn, RichRelevance, Netflix and Square

[jira] [Commented] (KAFKA-883) System Test - update migration tool testsuite after 0.7 ProducerPerformance sends seq MessageID

[ https://issues.apache.org/jira/browse/KAFKA-883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13698140#comment-13698140 ] John Fung commented on KAFKA-883: - This patch is OK to check in ONLY after the following :

[jira] [Updated] (KAFKA-883) System Test - update migration tool testsuite after 0.7 ProducerPerformance sends seq MessageID

[ https://issues.apache.org/jira/browse/KAFKA-883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Fung updated KAFKA-883: Status: Patch Available (was: Open) > System Test - update migration tool testsuite after 0.7 ProducerP

[jira] [Commented] (KAFKA-882) Enhance 0.7 ProducerPerformance to send sequential MessageID as in 0.8

[ https://issues.apache.org/jira/browse/KAFKA-882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13698128#comment-13698128 ] John Fung commented on KAFKA-882: - ProducerPerformance in 0.7 has quite a few nested if-els

[jira] [Updated] (KAFKA-883) System Test - update migration tool testsuite after 0.7 ProducerPerformance sends seq MessageID

[ https://issues.apache.org/jira/browse/KAFKA-883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Fung updated KAFKA-883: Attachment: kafka-883-v1.patch uploaded kafka-883-v1.patch > System Test - update migration

[jira] [Updated] (KAFKA-882) Enhance 0.7 ProducerPerformance to send sequential MessageID as in 0.8

[ https://issues.apache.org/jira/browse/KAFKA-882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Fung updated KAFKA-882: Status: Patch Available (was: Open) > Enhance 0.7 ProducerPerformance to send sequential MessageID as i

Re: site updates

The introduction and quickstart are all as of 0.8. The design document has not yet been updated (working on it). -Jay On Tue, Jul 2, 2013 at 11:22 AM, S Ahmed wrote: > On the main page http://kafka.apache.org/< > http://kafka.apache.org/design.html>, > is the introduction/quickstart/design ref

[jira] [Work stopped] (KAFKA-882) Enhance 0.7 ProducerPerformance to send sequential MessageID as in 0.8

[ https://issues.apache.org/jira/browse/KAFKA-882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on KAFKA-882 stopped by John Fung. > Enhance 0.7 ProducerPerformance to send sequential MessageID as in 0.8 >

[jira] [Updated] (KAFKA-882) Enhance 0.7 ProducerPerformance to send sequential MessageID as in 0.8

[ https://issues.apache.org/jira/browse/KAFKA-882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Fung updated KAFKA-882: Attachment: kafka-882-v1.patch uploaded kafka-882-v1.patch > Enhance 0.7 ProducerPerformanc

Re: site updates

On the main page http://kafka.apache.org/, is the introduction/quickstart/design reflecting 0.8? On Mon, Jul 1, 2013 at 3:04 PM, Jay Kreps wrote: > 1. I think it is fine to do a one-off since it won't impact the APIs. It > would be *awesome* to get this work

client rewrite in 0.9?

Hey guys, We have had a bunch of prior discussions and some prototyping on generalizing and improving the jvm clients. I have tried to consolidate all these thoughts into one larger plan: https://cwiki.apache.org/confluence/display/KAFKA/Client+Rewrite It's not nearly baked right now, but I thou

[jira] [Work started] (KAFKA-882) Enhance 0.7 ProducerPerformance to send sequential MessageID as in 0.8

[ https://issues.apache.org/jira/browse/KAFKA-882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on KAFKA-882 started by John Fung. > Enhance 0.7 ProducerPerformance to send sequential MessageID as in 0.8 >