Build failed in Jenkins: kafka-trunk-jdk8 #3812

2019-07-26 Thread Apache Jenkins Server
See Changes: [jason] KAFKA-8715; Fix buggy reliance on state timestamp in static member.id -- [...truncated 6.45 MB...]

Re: [VOTE] KIP-467: Augment ProduceResponse error messaging

2019-07-26 Thread Jun Rao
Hi, Guozhang, Thanks for the KIP. +1 Jun On Fri, Jul 26, 2019 at 4:40 PM Jason Gustafson wrote: > Hi Guozhang, > > I agree it is misleading to suggest corruption in these cases. Have you > considered alternative error codes? I think INVALID_REQUEST may be more > suggestive that the server has

Re: [VOTE] KIP-480 : Sticky Partitioner

2019-07-26 Thread Jun Rao
Hi, Justine, Thanks for the updated KIP. The new interface seems cleaner to me. +1 Jun On Fri, Jul 26, 2019 at 4:14 PM Justine Olshan wrote: > Hello all, > I've just added the proposed changes to the KIP page > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-480%3A+Sticky+Partitioner

[jira] [Created] (KAFKA-8721) Metrics library upgrade

2019-07-26 Thread Mario Molina (JIRA)
Mario Molina created KAFKA-8721: --- Summary: Metrics library upgrade Key: KAFKA-8721 URL: https://issues.apache.org/jira/browse/KAFKA-8721 Project: Kafka Issue Type: Improvement

Re: [VOTE] KIP-467: Augment ProduceResponse error messaging

2019-07-26 Thread Jason Gustafson
Hi Guozhang, I agree it is misleading to suggest corruption in these cases. Have you considered alternative error codes? I think INVALID_REQUEST may be more suggestive that the server has rejected the request for some reason. In any case, it's a small point that need not block the KIP. I'm +1

[jira] [Resolved] (KAFKA-6836) Upgrade metrics library

2019-07-26 Thread Mario Molina (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mario Molina resolved KAFKA-6836. - Resolution: Won't Fix > Upgrade metrics library > --- > >

Re: [VOTE] KIP-467: Augment ProduceResponse error messaging

2019-07-26 Thread Guozhang Wang
Hi Jason, thanks for the comments. 1. Yes that's a good point. Will move it to `errors`. 2. The point is that when broker returning the new error code INVALID_RECORD to the old versioned clients who do not recognize the code, it would be translated to a UnknownServerException, whereas today

Re: [VOTE] KIP-480 : Sticky Partitioner

2019-07-26 Thread Justine Olshan
Hello all, I've just added the proposed changes to the KIP page https://cwiki.apache.org/confluence/display/KAFKA/KIP-480%3A+Sticky+Partitioner . The PR has been updated as well. https://github.com/apache/kafka/pull/6997. The idea is that there will just be a separate void method to change the

Re: [DISCUSS] KIP-405: Kafka Tiered Storage

2019-07-26 Thread Habib Nahas
Thanks for the reply, Harsha and Satish. I have a follow up, I'm fairly new to this space so forgive me if there is an obvious answer. AIUI the current design proposal requires explicit support for integrating new remote filesystems, such as GCP Cloud Storage or S3. If Kafka offers a solution

Re: [DISCUSS] KIP-495: Dynamically Adjust Log Levels in Connect

2019-07-26 Thread Chris Egerton
Hi Arjun, This looks great. The changes to public interface are pretty small and moving the Log4jController class into the clients package seems like the right way to go. One question I have--it looks like the purpose of this KIP is to enable dynamic setting of log levels in the Connect

[jira] [Created] (KAFKA-8720) Flakey test AdminClientIntegrationTest #testElectUncleanLeadersForManyPartitions

2019-07-26 Thread Boyang Chen (JIRA)
Boyang Chen created KAFKA-8720: -- Summary: Flakey test AdminClientIntegrationTest #testElectUncleanLeadersForManyPartitions Key: KAFKA-8720 URL: https://issues.apache.org/jira/browse/KAFKA-8720 Project:

Re: Fwd: [DISCUSS] KIP-492 Add java security providers in Kafka Security config

2019-07-26 Thread Sandeep Mopuri
Hi Rajini, updated the KIP to reflect the ordering of the providers passed and added information about the configured providers taking precedence over the login module providers in case of SASL. Also updated the config name. Please take a look and if everything looks good, I can start a vote. On

[DISCUSS] KIP-497: Add inter-broker API to alter ISR

2019-07-26 Thread Jason Gustafson
Hi All, I have written a proposal to change the way leaders make ISR modifications: https://cwiki.apache.org/confluence/display/KAFKA/KIP-497%3A+Add+inter-broker+API+to+alter+ISR. Have a look and let me know what you think. Thanks, Jason

Re: [VOTE] KIP-480 : Sticky Partitioner

2019-07-26 Thread Justine Olshan
Hi Jun, I agree that it is confusing. I think there might be a way to not deprecate the partition method after all, and instead create a separate method to perform the necessary actions on new batches. I will try to update the KIP with the details as soon as I can. Thank you, Justine On Fri, Jul

Re: [VOTE] KIP-480 : Sticky Partitioner

2019-07-26 Thread Jun Rao
Hi, Justine, Thanks for the KIP. It looks good overall. Just a followup comment. Should we mark Partitioner.partition() as deprecated? If someone tries to implement a new Partitioner on the new interface. They will see both partition() and computePartition(). It's not clear to them which one

[jira] [Created] (KAFKA-8719) kafka-console-consumer bypassing sentry evaluations while specifying --partition option

2019-07-26 Thread Sathish (JIRA)
Sathish created KAFKA-8719: -- Summary: kafka-console-consumer bypassing sentry evaluations while specifying --partition option Key: KAFKA-8719 URL: https://issues.apache.org/jira/browse/KAFKA-8719 Project:

[jira] [Created] (KAFKA-8718) Not authorized to access topics: [__consumer_offsets] with Apache Kafka 2.3.0

2019-07-26 Thread Bala Bharath Reddy Resapu (JIRA)
Bala Bharath Reddy Resapu created KAFKA-8718: Summary: Not authorized to access topics: [__consumer_offsets] with Apache Kafka 2.3.0 Key: KAFKA-8718 URL:

Re: Fwd: [DISCUSS] KIP-492 Add java security providers in Kafka Security config

2019-07-26 Thread Rajini Sivaram
Hi Harsha, Since one provider can implement multiple things, excluding SASL may mean not adding providers which implement any SASL mechanism even though you are actually interested only in one SSL algorithm that also happens to be in the provider. Perhaps it would be simpler to allow SASL as

Re: [DISCUSS] KIP-221: Repartition Topic Hints in Streams

2019-07-26 Thread Levani Kokhreidze
Hi all, Here’s voting thread for this KIP: https://www.mail-archive.com/dev@kafka.apache.org/msg99680.html Regards, Levani > On Jul 24, 2019, at 11:15 PM, Levani Kokhreidze > wrote: > > Hi Matthias, > > Thanks for the