[GitHub] kafka pull request: KAFKA-3330; Truncate log cleaner offset checkp...

2016-03-18 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1009 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Updated] (KAFKA-3412) Multiple commitAsync() calls causes SendFailedException in commit callback

2016-03-18 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira updated KAFKA-3412: Fix Version/s: 0.10.0.0 > Multiple commitAsync() calls causes SendFailedException in commit callback

Jenkins build is back to normal : kafka-trunk-jdk8 #449

2016-03-18 Thread Apache Jenkins Server
See

Re: [VOTE] KIP-35: Retrieving protocol version

2016-03-18 Thread Dana Powers
+1 On Thu, Mar 17, 2016 at 4:09 PM, Ashish Singh wrote: > As the KIP has been modified since we started this vote, the vote is > restarted from now. > > The updated KIP is available at > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-35+-+Retrieving+protocol+version > . > > On Mon, Mar

[GitHub] kafka pull request: KAFKA-3006: standardize KafkaConsumer API to u...

2016-03-18 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1098 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Commented] (KAFKA-3306) Change metdata response to include required additional fields

2016-03-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15201766#comment-15201766 ] ASF GitHub Bot commented on KAFKA-3306: --- GitHub user granthenke opened a pull reques

[jira] [Commented] (KAFKA-3392) ConsumerRecords iterator throws NoSuchElementException when a TopicPartition is empty

2016-03-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15200037#comment-15200037 ] ASF GitHub Bot commented on KAFKA-3392: --- Github user asfgit closed the pull request

Build failed in Jenkins: kafka-trunk-jdk7 #1122

2016-03-18 Thread Apache Jenkins Server
See Changes: [cshapi] KAFKA-2832: Add a consumer config option to exclude internal topics [cshapi] KAFKA-3188: Compatibility test for old and new clients with 0.10 broker [me] KAFKA-3315: Add REST and Connector API to expose connecto

[jira] [Commented] (KAFKA-3417) Invalid characters in config properties not being validated?

2016-03-18 Thread Byron Ruth (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15201387#comment-15201387 ] Byron Ruth commented on KAFKA-3417: --- Looking at the source a bit more, the `group.id` ap

kafka-streams: Using custom partitioner with higher level DSL constructs?

2016-03-18 Thread Ben Osheroff
(lemme know if this belongs on the users email list, I'm not sure where API questions fall) Hi, I'm Ben Osheroff, I wrote Maxwell (http://github.com/zendesk/maxwell) and have been prototyping an engine to do arbitrary denormalizations of Maxwell's CDC events based on the kafka-streams library; th

[jira] [Commented] (KAFKA-2982) Mark the old Scala producer and related classes as deprecated

2016-03-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15200721#comment-15200721 ] ASF GitHub Bot commented on KAFKA-2982: --- GitHub user ijuma opened a pull request:

Re: [VOTE] KIP-45: Standardize KafkaConsumer API to use Collection

2016-03-18 Thread Guozhang Wang
+1. And we also need to do a better job educating users about our annotations, since such things are likely to happen in KC / KS in the future. On Wed, Mar 16, 2016 at 2:20 PM, Ashish Singh wrote: > +1 (non-binding) > > On Wed, Mar 16, 2016 at 1:40 PM, Ismael Juma wrote: > > > +1 (non-binding)

Re: [DISCUSS] KIP-35 - Retrieve protocol version

2016-03-18 Thread Dana Powers
On Thu, Mar 17, 2016 at 2:07 PM, Jason Gustafson wrote: > It would also be nice to discuss the way the current client > versioning works and why it is inadequate for third-party clients. > My understanding of the java client versioning is that it is not backwards-compatible. Instructions are to

[GitHub] kafka pull request: KAFKA-3400: Fix describe topic in case there a...

2016-03-18 Thread SinghAsDev
GitHub user SinghAsDev opened a pull request: https://github.com/apache/kafka/pull/1086 KAFKA-3400: Fix describe topic in case there are zero partitions. You can merge this pull request into a Git repository by running: $ git pull https://github.com/SinghAsDev/kafka KAFKA-3400

[jira] [Commented] (KAFKA-3409) Mirror maker hangs indefinitely due to commit

2016-03-18 Thread Ashish K Singh (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15197729#comment-15197729 ] Ashish K Singh commented on KAFKA-3409: --- This can happen if consumer rebalance is in

Re: [DISCUSS] KIP-35 - Retrieve protocol version

2016-03-18 Thread Jason Gustafson
My point was only that the way people would probably end up using the request for all versions as a proxy for determining the broker version. For example, if the JoinGroup v0 is present, then it must be 0.9. Or if you do it in terms of features, then you need to check 5 or 6 different request types

[jira] [Assigned] (KAFKA-3400) Topic stop working / can't describe topic

2016-03-18 Thread Ashish K Singh (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashish K Singh reassigned KAFKA-3400: - Assignee: Ashish K Singh > Topic stop working / can't describe topic > --

[jira] [Updated] (KAFKA-3422) Add overloading functions for each operator not requiring serialization

2016-03-18 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-3422: - Status: Patch Available (was: In Progress) Submitted PR: https://github.com/apache/kafka/pull/109

[jira] [Updated] (KAFKA-3418) Add section on detecting consumer failures in new consumer javadoc

2016-03-18 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson updated KAFKA-3418: --- Fix Version/s: 0.10.0.0 > Add section on detecting consumer failures in new consumer javadoc >

[jira] [Commented] (KAFKA-3409) Mirror maker hangs indefinitely due to commit

2016-03-18 Thread Jiangjie Qin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15198710#comment-15198710 ] Jiangjie Qin commented on KAFKA-3409: - That makes sense. So it seems that if users s

[jira] [Updated] (KAFKA-3415) AdminOperationException when altering Topic with same number of partitions

2016-03-18 Thread JIRA
[ https://issues.apache.org/jira/browse/KAFKA-3415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] GĂ©rald Quintana updated KAFKA-3415: --- Description: To automate topic creation/modification, we sometimes run kafka-topics.sh script

[jira] [Updated] (KAFKA-3378) Client blocks forever if SocketChannel connects instantly

2016-03-18 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira updated KAFKA-3378: Status: Patch Available (was: Open) > Client blocks forever if SocketChannel connects instantly > -

[jira] [Updated] (KAFKA-3328) SimpleAclAuthorizer can lose ACLs with frequent add/remove calls

2016-03-18 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira updated KAFKA-3328: Reviewer: Flavio Junqueira > SimpleAclAuthorizer can lose ACLs with frequent add/remove calls >

[jira] [Commented] (KAFKA-3383) Producer should not remove an in flight request before successfully parsing the response.

2016-03-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15200964#comment-15200964 ] ASF GitHub Bot commented on KAFKA-3383: --- Github user zhuchen1018 closed the pull req

Re: [VOTE] KIP-35: Retrieving protocol version

2016-03-18 Thread Ashish Singh
Hey Jay, Answers inline. On Fri, Mar 18, 2016 at 10:45 AM, Jay Kreps wrote: Hey Ashish, > > Couple quick things: > > 1. You list as a rejected alternative "making the documentation the > source of truth for the protocol", but I think what you actually > describe in that section is global versio

[jira] [Commented] (KAFKA-3205) Error in I/O with host (java.io.EOFException) raised in producer

2016-03-18 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15197424#comment-15197424 ] Jun Rao commented on KAFKA-3205: [~Mart Haitjema], after the broker closed the idle socket

[jira] [Commented] (KAFKA-3135) Unexpected delay before fetch response transmission

2016-03-18 Thread Raghu Angadi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15199004#comment-15199004 ] Raghu Angadi commented on KAFKA-3135: - {quote} {code} tcp4 0 0 10.191.0.30

Build failed in Jenkins: kafka-trunk-jdk7 #1126

2016-03-18 Thread Apache Jenkins Server
See Changes: [cshapi] KAFKA-3006: standardize KafkaConsumer API to use Collection [cshapi] KAFKA-3378; Client blocks forever if SocketChannel connects instantly -- [...truncated 1543 lines...]

[jira] [Updated] (KAFKA-3425) Add KIP-45 note to upgrade docs

2016-03-18 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson updated KAFKA-3425: --- Fix Version/s: 0.10.0.0 > Add KIP-45 note to upgrade docs > --- >

[jira] [Commented] (KAFKA-1215) Rack-Aware replica assignment option

2016-03-18 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15202369#comment-15202369 ] Jun Rao commented on KAFKA-1215: Great, thanks Allen. > Rack-Aware replica assignment opt

[GitHub] kafka pull request: KAFKA-3427: broker can return incorrect versio...

2016-03-18 Thread junrao
GitHub user junrao opened a pull request: https://github.com/apache/kafka/pull/1101 KAFKA-3427: broker can return incorrect version of fetch response when the broker hits an unknown exception You can merge this pull request into a Git repository by running: $ git pull https:/

Jenkins build is back to normal : kafka-trunk-jdk7 #1125

2016-03-18 Thread Apache Jenkins Server
See

[jira] [Updated] (KAFKA-3425) Add KIP-45 note to upgrade docs

2016-03-18 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira updated KAFKA-3425: Priority: Blocker (was: Major) > Add KIP-45 note to upgrade docs > ---

[jira] [Resolved] (KAFKA-3397) use -1(latest) as time default value for tools.GetOffsetShell

2016-03-18 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-3397. -- Resolution: Fixed Fix Version/s: 0.10.0.0 Issue resolved by pull request 1068 [https://gi

[jira] [Commented] (KAFKA-3153) Serializer/Deserializer Registration and Type inference

2016-03-18 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15201799#comment-15201799 ] Guozhang Wang commented on KAFKA-3153: -- Closing now. > Serializer/Deserializer Regis

[GitHub] kafka pull request: KAFKA-3378; Client blocks forever if SocketCha...

2016-03-18 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1094 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Updated] (KAFKA-3426) Improve protocol type errors when invalid sizes are received

2016-03-18 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-3426: --- Status: Patch Available (was: Open) > Improve protocol type errors when invalid sizes are received >

[jira] [Commented] (KAFKA-3378) Client blocks forever if SocketChannel connects instantly

2016-03-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15202343#comment-15202343 ] ASF GitHub Bot commented on KAFKA-3378: --- Github user asfgit closed the pull request

[jira] [Updated] (KAFKA-3378) Client blocks forever if SocketChannel connects instantly

2016-03-18 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira updated KAFKA-3378: Resolution: Fixed Status: Resolved (was: Patch Available) Issue resolved by pull request 10

[jira] [Commented] (KAFKA-3410) Unclean leader election and "Halting because log truncation is not allowed"

2016-03-18 Thread James Cheng (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15198318#comment-15198318 ] James Cheng commented on KAFKA-3410: 1. I would have thought that broker1 node would c

[jira] [Created] (KAFKA-3419) New consumer javadoc unclear on topic subscription vs partition assignment

2016-03-18 Thread Jason Gustafson (JIRA)
Jason Gustafson created KAFKA-3419: -- Summary: New consumer javadoc unclear on topic subscription vs partition assignment Key: KAFKA-3419 URL: https://issues.apache.org/jira/browse/KAFKA-3419 Project:

[jira] [Commented] (KAFKA-3303) Pass partial record metadata to Interceptor onAcknowledgement in case of errors

2016-03-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15198480#comment-15198480 ] ASF GitHub Bot commented on KAFKA-3303: --- Github user asfgit closed the pull request

[jira] [Commented] (KAFKA-2832) support exclude.internal.topics in new consumer

2016-03-18 Thread Edoardo Comar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15197454#comment-15197454 ] Edoardo Comar commented on KAFKA-2832: -- Hi all, Vahid is on vacation so I am creating

[jira] [Commented] (KAFKA-3400) Topic stop working / can't describe topic

2016-03-18 Thread Ashish K Singh (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15197911#comment-15197911 ] Ashish K Singh commented on KAFKA-3400: --- [~tobad357] what is the topic's replication

[jira] [Commented] (KAFKA-3394) Broker fails to parse Null Metadata in OffsetCommit requests

2016-03-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15202108#comment-15202108 ] ASF GitHub Bot commented on KAFKA-3394: --- Github user asfgit closed the pull request

[jira] [Created] (KAFKA-3424) Add CORS support to Connect REST API

2016-03-18 Thread Ewen Cheslack-Postava (JIRA)
Ewen Cheslack-Postava created KAFKA-3424: Summary: Add CORS support to Connect REST API Key: KAFKA-3424 URL: https://issues.apache.org/jira/browse/KAFKA-3424 Project: Kafka Issue Type

[jira] [Resolved] (KAFKA-3423) can't start kafka connect with former configs in distributed mode

2016-03-18 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava resolved KAFKA-3423. -- Resolution: Duplicate Reviewer: Ewen Cheslack-Postava Thanks for the repor

[jira] [Created] (KAFKA-3425) Add KIP-45 note to upgrade docs

2016-03-18 Thread Jason Gustafson (JIRA)
Jason Gustafson created KAFKA-3425: -- Summary: Add KIP-45 note to upgrade docs Key: KAFKA-3425 URL: https://issues.apache.org/jira/browse/KAFKA-3425 Project: Kafka Issue Type: Improvement

[jira] [Commented] (KAFKA-1215) Rack-Aware replica assignment option

2016-03-18 Thread Allen Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15202362#comment-15202362 ] Allen Wang commented on KAFKA-1215: --- [~junrao] Updated. > Rack-Aware replica assignmen

[jira] [Commented] (KAFKA-3006) Make collection default container type for sequences in the consumer API

2016-03-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15202265#comment-15202265 ] ASF GitHub Bot commented on KAFKA-3006: --- GitHub user hachikuji opened a pull request

[GitHub] kafka pull request: KAFKA-3006: standardize KafkaConsumer API to u...

2016-03-18 Thread hachikuji
GitHub user hachikuji opened a pull request: https://github.com/apache/kafka/pull/1098 KAFKA-3006: standardize KafkaConsumer API to use Collection You can merge this pull request into a Git repository by running: $ git pull https://github.com/hachikuji/kafka KAFKA-3006 Altern

[jira] [Updated] (KAFKA-3006) Make collection default container type for sequences in the consumer API

2016-03-18 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira updated KAFKA-3006: Resolution: Fixed Status: Resolved (was: Patch Available) Issue resolved by pull request 10

Build failed in Jenkins: kafka-trunk-jdk8 #455

2016-03-18 Thread Apache Jenkins Server
See Changes: [cshapi] KAFKA-3006: standardize KafkaConsumer API to use Collection [cshapi] KAFKA-3378; Client blocks forever if SocketChannel connects instantly -- [...truncated 3165 lines...]

[GitHub] kafka pull request: KAFKA-3422: Add overloading functions without ...

2016-03-18 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1093 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Commented] (KAFKA-3426) Improve protocol type errors when invalid sizes are received

2016-03-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15202408#comment-15202408 ] ASF GitHub Bot commented on KAFKA-3426: --- GitHub user ijuma opened a pull request:

[GitHub] kafka pull request: HOTFIX: Renamed tests to match expected suffix

2016-03-18 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1096 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab