[jira] [Resolved] (KAFKA-2679) Mirror Maker produces duplicated data

2016-01-30 Thread He Tianyi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Tianyi resolved KAFKA-2679. -- Resolution: Not A Problem > Mirror Maker produces duplicated data >

[jira] [Commented] (KAFKA-3174) Re-evaluate the CRC32 class performance.

2016-01-30 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15124813#comment-15124813 ] Ismael Juma commented on KAFKA-3174: Great, left a comment in the PR. > Re-evaluate the CRC32 class

Re: [DISCUSS] KIP-42: Add Producer and Consumer Interceptors

2016-01-30 Thread Neha Narkhede
Nice finding on the CRC class. It will be great to switch to that at some point. On exposing the CRC - I think we are overthinking the problem. CRC over the entire record makes sense for the durability check and having multiple CRCs is a bad idea. On Fri, Jan 29, 2016 at 4:47 PM, Jay Kreps

[jira] [Commented] (KAFKA-3169) Kafka broker throws OutOfMemory error with invalid SASL packet

2016-01-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15124854#comment-15124854 ] ASF GitHub Bot commented on KAFKA-3169: --- Github user asfgit closed the pull request at:

[GitHub] kafka pull request: KAFKA-3169: Limit receive buffer size for SASL...

2016-01-30 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/831 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (KAFKA-1696) Kafka should be able to generate Hadoop delegation tokens

2016-01-30 Thread Ashish K Singh (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15125002#comment-15125002 ] Ashish K Singh commented on KAFKA-1696: --- [~parth.brahmbhatt] just curious if you have the KIP draft

Re: [DISCUSS] KIP-43: Kafka SASL enhancements

2016-01-30 Thread Harsha
Rajini, Whats the need for server returning acceptable mechs as network package. Why not drive it through the JAAS file itself. I don't see handshake any different than what it is now and only login will change and it can be configured based on the

Build failed in Jenkins: kafka-trunk-jdk8 #331

2016-01-30 Thread Apache Jenkins Server
See Changes: [harsha] KAFKA-3169; Limit receive buffer size for SASL packets in broker -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on H11

Build failed in Jenkins: kafka-trunk-jdk7 #1004

2016-01-30 Thread Apache Jenkins Server
See Changes: [harsha] KAFKA-3169; Limit receive buffer size for SASL packets in broker -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on H11

[jira] [Commented] (KAFKA-2986) Consumer group doesn't lend itself well for slow consumers with varying message size

2016-01-30 Thread Jens Rantil (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15124913#comment-15124913 ] Jens Rantil commented on KAFKA-2986: KIP 41 has since last week been passed in on the dev mailing

[jira] [Commented] (KAFKA-3164) Document client and mirrormaker upgrade procedure/requirements

2016-01-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15125159#comment-15125159 ] ASF GitHub Bot commented on KAFKA-3164: --- Github user asfgit closed the pull request at:

[jira] [Created] (KAFKA-3177) Kafka consumer can hang when position() is called on a non-existing partition.

2016-01-30 Thread Jiangjie Qin (JIRA)
Jiangjie Qin created KAFKA-3177: --- Summary: Kafka consumer can hang when position() is called on a non-existing partition. Key: KAFKA-3177 URL: https://issues.apache.org/jira/browse/KAFKA-3177 Project:

[jira] [Updated] (KAFKA-3164) Document client and mirrormaker upgrade procedure/requirements

2016-01-30 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira updated KAFKA-3164: Resolution: Fixed Reviewer: Gwen Shapira Fix Version/s: 0.9.1.0

[jira] [Commented] (KAFKA-3174) Re-evaluate the CRC32 class performance.

2016-01-30 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15125169#comment-15125169 ] Ismael Juma commented on KAFKA-3174: That's good to know Gwen. Still, we were recommending Java 7 in

Build failed in Jenkins: kafka_0.9.0_jdk7 #107

2016-01-30 Thread Apache Jenkins Server
See Changes: [cshapi] KAFKA-3164: Document client and mirrormaker upgrade procedure/require… -- [...truncated 1502 lines...] kafka.integration.SaslSslTopicMetadataTest >

[GitHub] kafka pull request: KAFKA-3164: Document client and mirrormaker up...

2016-01-30 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/838 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (KAFKA-3174) Re-evaluate the CRC32 class performance.

2016-01-30 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15125158#comment-15125158 ] Gwen Shapira commented on KAFKA-3174: - As anecdotal evidence, 100% of the customers I worked with in

[jira] [Commented] (KAFKA-3174) Re-evaluate the CRC32 class performance.

2016-01-30 Thread Jiangjie Qin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15125186#comment-15125186 ] Jiangjie Qin commented on KAFKA-3174: - Thanks for the info [~gwenshap]. We have also been using Java

Re: Contributor List

2016-01-30 Thread Gwen Shapira
Added. Looking forward to your contributions :) On Fri, Jan 29, 2016 at 2:10 PM, Abraham Fine wrote: > Would it be possible to add me to the contributor list? My apache jira > username is: abrahamfine > > Thanks, > Abe

[jira] [Created] (KAFKA-3176) Allow console consumer to consume from particular partitions when new consumer is used.

2016-01-30 Thread Jiangjie Qin (JIRA)
Jiangjie Qin created KAFKA-3176: --- Summary: Allow console consumer to consume from particular partitions when new consumer is used. Key: KAFKA-3176 URL: https://issues.apache.org/jira/browse/KAFKA-3176

[jira] [Commented] (KAFKA-3177) Kafka consumer can hang when position() is called on a non-existing partition.

2016-01-30 Thread Jiangjie Qin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15125180#comment-15125180 ] Jiangjie Qin commented on KAFKA-3177: - [~hachikuji] [~guozhang] Not sure what is the correct solution

Re: [DISCUSS] KIP-43: Kafka SASL enhancements

2016-01-30 Thread Gwen Shapira
I want to second Harsha's approach. Configuration is usually much easier to configure and troubleshoot than protocol-negotiation-protocols, which we've been doing our best to generally avoid in Kafka due to operational complexity. Gwen On Sat, Jan 30, 2016 at 3:32 AM, Harsha

Build failed in Jenkins: kafka-trunk-jdk7 #1005

2016-01-30 Thread Apache Jenkins Server
See Changes: [cshapi] KAFKA-3164: Document client and mirrormaker upgrade procedure/require… -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely

[jira] [Commented] (KAFKA-1696) Kafka should be able to generate Hadoop delegation tokens

2016-01-30 Thread Sriharsha Chintalapani (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15125212#comment-15125212 ] Sriharsha Chintalapani commented on KAFKA-1696: --- [~singhashish] We are working on it.Will

Re: Pluggable Log Compaction Policy

2016-01-30 Thread Bill Warshaw
Hello again, Is there anyone on this thread who has admin access to the Kafka Confluence wiki? I want to create a KIP but I don't have permissions to actually create a page. Bill On Fri, Jan 22, 2016 at 3:29 PM, Guozhang Wang wrote: > Bill, > > Sounds good. If you want to