Re: [VOTE] KIP-55: Secure quotas for authenticated users

+1 Thanks for working through this, Rajini. On Thu, Jul 7, 2016 at 7:12 AM, Rajini Sivaram wrote: > I would like to initiate voting for KIP-55 ( > https://cwiki.apache.org/confluence/display/KAFKA/KIP-55%3A+Secure+Quotas+for+Authenticated+Users). > Since the KIP

Re: [DISCUSS] KIP-4 ACL Admin Schema

Thank you, Grant. This is lovely :) Few comments / requests for clarifications below: >> ListAcls Request (Version: 0) => principal resource >> principal => NULLABLE_STRING >> resource => resource_type resource_name >> resource_type => INT8 >> resource_name => STRING I am a bit

Re: [DISCUSS] KIP-66 Kafka Connect Transformers for messages

I used to work on Apache Flume, where we used to allow users to filter messages completely in the transformation and then we got rid of it, because we spent too much time trying to help users who had "message loss", where the loss was actually a bug in the filter... What we couldn't do in Flume,

[jira] [Commented] (KAFKA-3960) Committed offset not set after first assign

[ https://issues.apache.org/jira/browse/KAFKA-3960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15378874#comment-15378874 ] Alexey Romanchuk commented on KAFKA-3960: - Anyone? > Committed offset not set after first assign

Re: [DISCUSS] KIP-66 Kafka Connect Transformers for messages

Thank you for your inputs Gwen and Michael. The original reason why I suggested a set based processing is because of the flexibility is provides. The JIRA had a comment by a user requesting a feature that could be achieved with this. After reading Gwen and Michael's points, (I went through the

[jira] [Commented] (KAFKA-2431) Test SSL/TLS impact on performance

[ https://issues.apache.org/jira/browse/KAFKA-2431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15378759#comment-15378759 ] Jiangjie Qin commented on KAFKA-2431: - [~benstopford] It seems I am not able to access the Google doc

[jira] [Commented] (KAFKA-3729) Auto-configure non-default SerDes passed alongside the topology builder

[ https://issues.apache.org/jira/browse/KAFKA-3729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15378617#comment-15378617 ] Bharat Viswanadham commented on KAFKA-3729: --- [~thoughtp...@gmail.com][~guozhang] Can you provide

[jira] [Resolved] (KAFKA-3948) Invalid broker port in Zookeeper when SSL is enabled

[ https://issues.apache.org/jira/browse/KAFKA-3948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham resolved KAFKA-3948. --- Resolution: Not A Problem > Invalid broker port in Zookeeper when SSL is enabled >

[jira] [Commented] (KAFKA-3948) Invalid broker port in Zookeeper when SSL is enabled

[ https://issues.apache.org/jira/browse/KAFKA-3948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15378604#comment-15378604 ] Bharat Viswanadham commented on KAFKA-3948: --- yes got that point. Thank you for info.

[jira] [Commented] (KAFKA-3948) Invalid broker port in Zookeeper when SSL is enabled

[ https://issues.apache.org/jira/browse/KAFKA-3948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15378603#comment-15378603 ] Sriharsha Chintalapani commented on KAFKA-3948: --- [~bharatviswa] [~gquintana] host and port

[jira] [Updated] (KAFKA-3173) Error while moving some partitions to OnlinePartition state

[ https://issues.apache.org/jira/browse/KAFKA-3173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-3173: --- Fix Version/s: (was: 0.10.0.1) 0.10.1.0 > Error while moving some partitions

[jira] [Commented] (KAFKA-1194) The kafka broker cannot delete the old log files after the configured time

[ https://issues.apache.org/jira/browse/KAFKA-1194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15378237#comment-15378237 ] ASF GitHub Bot commented on KAFKA-1194: --- GitHub user rperi opened a pull request:

[GitHub] kafka pull request #1624: KAFKA-1194: New config to specific memory mapped f...

GitHub user rperi opened a pull request: https://github.com/apache/kafka/pull/1624 KAFKA-1194: New config to specific memory mapped file update capability of underlying OS A new configuration value that can be used to indicate if the underlying OS (and environment) supports

[jira] [Updated] (KAFKA-3966) KafkaConsumer briefly ignores partitions on backlogs

[ https://issues.apache.org/jira/browse/KAFKA-3966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kanak Biscuitwala updated KAFKA-3966: - Summary: KafkaConsumer briefly ignores partitions on backlogs (was: Consumer briefly

[jira] [Updated] (KAFKA-3966) Consumer briefly ignores partitions on backlogs

[ https://issues.apache.org/jira/browse/KAFKA-3966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kanak Biscuitwala updated KAFKA-3966: - Affects Version/s: 0.10.0.0 > Consumer briefly ignores partitions on backlogs >

[jira] [Updated] (KAFKA-3966) Consumer briefly ignores partitions on backlogs

[ https://issues.apache.org/jira/browse/KAFKA-3966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kanak Biscuitwala updated KAFKA-3966: - Component/s: consumer > Consumer briefly ignores partitions on backlogs >

[jira] [Updated] (KAFKA-3966) Consumer briefly ignores partitions on backlogs

[ https://issues.apache.org/jira/browse/KAFKA-3966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kanak Biscuitwala updated KAFKA-3966: - Attachment: screenshot-1.png > Consumer briefly ignores partitions on backlogs >

[jira] [Created] (KAFKA-3966) Consumer briefly ignores partitions on backlogs

Kanak Biscuitwala created KAFKA-3966: Summary: Consumer briefly ignores partitions on backlogs Key: KAFKA-3966 URL: https://issues.apache.org/jira/browse/KAFKA-3966 Project: Kafka Issue

[jira] [Commented] (KAFKA-3940) Log should check the return value of dir.mkdirs()

[ https://issues.apache.org/jira/browse/KAFKA-3940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15378180#comment-15378180 ] Jim Jagielski commented on KAFKA-3940: -- In some places we do a dir.mkdirs() and check the return, and

[jira] [Commented] (KAFKA-3940) Log should check the return value of dir.mkdirs()

[ https://issues.apache.org/jira/browse/KAFKA-3940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15378157#comment-15378157 ] ASF GitHub Bot commented on KAFKA-3940: --- Github user jimjag closed the pull request at:

[GitHub] kafka pull request #1620: KAFKA-3940: Log should check the return value of d...

Github user jimjag closed the pull request at: https://github.com/apache/kafka/pull/1620 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (KAFKA-3940) Log should check the return value of dir.mkdirs()

[ https://issues.apache.org/jira/browse/KAFKA-3940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15378153#comment-15378153 ] Jim Jagielski commented on KAFKA-3940: -- I'm fine w/ working w/ Ishita... What I was planning is

[jira] [Commented] (KAFKA-3948) Invalid broker port in Zookeeper when SSL is enabled

[ https://issues.apache.org/jira/browse/KAFKA-3948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15378099#comment-15378099 ] Bharat Viswanadham commented on KAFKA-3948: --- You can also refer the code for confirmation

[jira] [Updated] (KAFKA-3948) Invalid broker port in Zookeeper when SSL is enabled

[ https://issues.apache.org/jira/browse/KAFKA-3948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated KAFKA-3948: -- Component/s: core > Invalid broker port in Zookeeper when SSL is enabled >

[jira] [Commented] (KAFKA-3948) Invalid broker port in Zookeeper when SSL is enabled

[ https://issues.apache.org/jira/browse/KAFKA-3948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15377908#comment-15377908 ] Bharat Viswanadham commented on KAFKA-3948: --- Pls let me know your comments on my inputs. >

[jira] [Comment Edited] (KAFKA-3948) Invalid broker port in Zookeeper when SSL is enabled

[ https://issues.apache.org/jira/browse/KAFKA-3948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15377904#comment-15377904 ] Bharat Viswanadham edited comment on KAFKA-3948 at 7/14/16 6:16 PM:

[jira] [Commented] (KAFKA-3948) Invalid broker port in Zookeeper when SSL is enabled

[ https://issues.apache.org/jira/browse/KAFKA-3948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15377904#comment-15377904 ] Bharat Viswanadham commented on KAFKA-3948: --- Hi, The behavior you are observing is correct.

[jira] [Updated] (KAFKA-3859) Consumer group is stuck in rebalancing status

[ https://issues.apache.org/jira/browse/KAFKA-3859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vahid Hashemian updated KAFKA-3859: --- Status: Patch Available (was: In Progress) > Consumer group is stuck in rebalancing status >

[DISCUSS] KIP-4 ACL Admin Schema

The KIP-4 Delete Topic Schema vote has passed and the patch is available for review. Now I would like to start the discussion for the Acls request/response and server side implementations. This includes the ListAclsRequest/Response and the

[jira] [Commented] (KAFKA-1194) The kafka broker cannot delete the old log files after the configured time

[ https://issues.apache.org/jira/browse/KAFKA-1194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15377110#comment-15377110 ] Ravi Peri commented on KAFKA-1194: -- The patch is ready. I am working on few failing unit tests. Once I

[jira] [Commented] (KAFKA-1194) The kafka broker cannot delete the old log files after the configured time

[ https://issues.apache.org/jira/browse/KAFKA-1194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15377023#comment-15377023 ] Harald Kirsch commented on KAFKA-1194: -- Having a very similar problem I would hope that the fix fixes

[jira] [Commented] (KAFKA-3894) Log Cleaner thread crashes and never restarts

[ https://issues.apache.org/jira/browse/KAFKA-3894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15376858#comment-15376858 ] Tom Crayford commented on KAFKA-3894: - Jun: #4 seems potentially very complex to me. It also doesn't

Build failed in Jenkins: kafka-trunk-jdk8 #752

See Changes: [ismael] KAFKA-3905: Handling null/empty topics and collections, patterns when -- [...truncated 4744 lines...] kafka.utils.ZkUtilsTest > testSuccessfulConditionalDeletePath PASSED

[jira] [Resolved] (KAFKA-3905) Check for null in KafkaConsumer#{subscribe, assign}

[ https://issues.apache.org/jira/browse/KAFKA-3905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma resolved KAFKA-3905. Resolution: Fixed Reviewer: Ismael Juma Fix Version/s: 0.10.1.0 > Check for null in

[jira] [Updated] (KAFKA-3905) Check for null in KafkaConsumer#{subscribe, assign}

[ https://issues.apache.org/jira/browse/KAFKA-3905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-3905: --- Summary: Check for null in KafkaConsumer#{subscribe, assign} (was: remove null from subscribed

[jira] [Commented] (KAFKA-3905) remove null from subscribed topics in KafkaConsumer#subscribe

[ https://issues.apache.org/jira/browse/KAFKA-3905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15376692#comment-15376692 ] ASF GitHub Bot commented on KAFKA-3905: --- Github user asfgit closed the pull request at:

[GitHub] kafka pull request #1601: KAFKA-3905; Handle invalid collection of topics, p...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1601 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Created] (KAFKA-3965) Mirror maker sync send fails will lose messages

NieWang created KAFKA-3965: -- Summary: Mirror maker sync send fails will lose messages Key: KAFKA-3965 URL: https://issues.apache.org/jira/browse/KAFKA-3965 Project: Kafka Issue Type: Bug

Re: Kafka Streams question

Also, in the next version of Kafka / Kafka Streams such "intermediate" topics will automatically be created for you when you do joins or aggregations: https://issues.apache.org/jira/browse/KAFKA-3561 So my previous message explained your options today when using the current release of Kafka

[GitHub] kafka pull request #1623: MINOR: Fix zk inconsistent security settings check

GitHub user ijuma opened a pull request: https://github.com/apache/kafka/pull/1623 MINOR: Fix zk inconsistent security settings check Also include a few minor clean-ups. You can merge this pull request into a Git repository by running: $ git pull https://github.com/ijuma/kafka

Re: Kafka Streams question

Poul, to add to what Matthias said: If you are wondering how to manually create a topic, you have basically two options. A. Use Kafka's CLI tools to create the topic "from the outside". # Example $ kafka-topics.sh --create --topic my-custom-toipc --zookeeper localhost:2181 --partitions

Re: Kafka Streams question

Hi, you can manually create a topic with the number of partitions you want to have and use this topic via through() KStream input = ... input.map().through("manually-created-topic").join(...) However, both KStream and KTable need to have the same number of partitions for perform the join.