Re: [DISCUSS] KIP-501 Avoid out-of-sync or offline partitions when follower fetch requests not processed in time

Hi Harsha, Is the problem you'd like addressed the following? Assume 3 replicas, L and F1 and F2. 1. F1 and F2 are alive and sending fetch requests to L. 2. L starts encountering disk issues, any requests being processed by the request handler threads become blocked. 3. L's zookeeper connection

Build failed in Jenkins: kafka-2.4-jdk8 #138

See Changes: [vvcephei] KAFKA-9517: Fix default serdes with FK join (#8061) -- [...truncated 5.50 MB...] org.apache.kafka.streams.test.OutputVerifierTest >

Re: [DISCUSS] KIP-501 Avoid out-of-sync or offline partitions when follower fetch requests not processed in time

Hi Jason & Jun,                  Do you have any feedback on the KIP or is it ok take it to voting?. Its good to have this config in Kafka to address disk failure scenarios as described in the KIP. Thanks, Harsha On Mon, Feb 10, 2020 at 5:10 PM, Brian Sang < bais...@yelp.com.invalid > wrote:

[VOTE] KIP-568: Explicit rebalance triggering on the Consumer

Hey all, I'd like to start the voting on KIP-568. It proposes the new Consumer#enforceRebalance API to facilitate triggering efficient rebalances. For reference, here is the KIP link again: https://cwiki.apache.org/confluence/display/KAFKA/KIP-568%3A+Explicit+rebalance+triggering+on+the+Consumer

Build failed in Jenkins: kafka-trunk-jdk8 #4221

See Changes: [github] KAFKA-9423: Refine layout of configuration options on website and make [github] KAFKA-9487: Follow-up PR of Kafka-9445 (#8033) [manikumar] MINOR: Update schema field names in DescribeAcls

Build failed in Jenkins: kafka-trunk-jdk11 #1146

See Changes: [github] KAFKA-9505: Only loop over topics-to-validate in retries (#8039) [github] KAFKA-9480: Fix bug that prevented to measure task-level process-rate [github] KAFKA-9523: Migrate

Re: [DISCUSS] KIP-568: Explicit rebalance triggering on the Consumer

Thanks John. I took out the KafkaConsumer method and moved the javadocs to the Consumer#enforceRebalance in the KIP -- hope you're happy :P Also, I wanted to point out one minor change to the current proposal: make this a blocking call, which accepts a timeout and returns whether the rebalance

Build failed in Jenkins: kafka-trunk-jdk8 #4220

See Changes: [github] KAFKA-8904: Improve producer's topic metadata fetching. (#7781) -- [...truncated 2.40 MB...] org.apache.kafka.streams.TopologyTest >

Re: [DISCUSS] KIP-501 Avoid out-of-sync or offline partitions when follower fetch requests not processed in time

Hi, Just wanted to bump this discussion, since it happened to us again at Yelp  It's particularly nasty since it can happen right before a disk failure, so right as the leader for the partition becomes the only ISR, the leader becomes unrecoverable right after, forcing us to do an unclean

[jira] [Created] (KAFKA-9536) Integration tests for KIP-558

Konstantine Karantasis created KAFKA-9536: - Summary: Integration tests for KIP-558 Key: KAFKA-9536 URL: https://issues.apache.org/jira/browse/KAFKA-9536 Project: Kafka Issue Type:

Jenkins build is back to normal : kafka-trunk-jdk11 #1145

See

Build failed in Jenkins: kafka-2.5-jdk8 #12

See Changes: [manikumar] MINOR: Update schema field names in DescribeAcls Request/Response -- [...truncated 2.85 MB...] org.apache.kafka.streams.TopologyTestDriverTest >

[jira] [Created] (KAFKA-9535) Metadata not updated when consumer encounters leader epoch related failures

Boyang Chen created KAFKA-9535: -- Summary: Metadata not updated when consumer encounters leader epoch related failures Key: KAFKA-9535 URL: https://issues.apache.org/jira/browse/KAFKA-9535 Project: Kafka

Re: [VOTE] KIP-523 Add KStream#toTable to the Streams DSL

Hello All I added scala API to KIP Please check. Thank you! On 2019/10/24 13:19:40, aishwarya kumar wrote: > Hello All, > > After concluding discussions for this KIP, I would like to go forward with > the voting process. > > Jira Ticket: https://issues.apache.org/jira/browse/KAFKA-7658 >

[jira] [Resolved] (KAFKA-9523) Reduce flakiness of BranchedMultiLevelRepartitionConnectedTopologyTest

[ https://issues.apache.org/jira/browse/KAFKA-9523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-9523. -- Fix Version/s: 2.5.0 Resolution: Fixed > Reduce flakiness of

[jira] [Resolved] (KAFKA-9505) InternalTopicManager may falls into infinite loop with partially created topics

[ https://issues.apache.org/jira/browse/KAFKA-9505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-9505. -- Fix Version/s: 2.5.0 Resolution: Fixed > InternalTopicManager may falls into infinite

Re: [DISCUSS] KIP-568: Explicit rebalance triggering on the Consumer

Thanks Sophie, Sorry I didn't respond. I think your new method name sounds good. Regarding the interface vs implementation, I agree it's confusing. It's always bothered me that the interface redirects you to an implementation JavaDocs, but never enough for me to stop what I'm doing to fix it.

Re: [DISCUSS] KIP-568: Explicit rebalance triggering on the Consumer

Since this doesn't seem too controversial, I'll probably call for a vote by end of day. If there any further comments/questions/concerns, please let me know! Thanks, Sophie On Sat, Feb 8, 2020 at 12:19 AM Sophie Blee-Goldman wrote: > Thanks for the feedback! That's a good point about trying to

Build failed in Jenkins: kafka-2.5-jdk8 #11

See Changes: -- [...truncated 2.86 MB...] org.apache.kafka.streams.TopologyTestDriverTest > shouldThrowForUnknownTopic[Eos enabled = false] STARTED

[jira] [Created] (KAFKA-9534) Potential inconsistent result for listTopic talking to older brokers

Boyang Chen created KAFKA-9534: -- Summary: Potential inconsistent result for listTopic talking to older brokers Key: KAFKA-9534 URL: https://issues.apache.org/jira/browse/KAFKA-9534 Project: Kafka

Build failed in Jenkins: kafka-trunk-jdk11 #1144

See Changes: [github] KAFKA-9423: Refine layout of configuration options on website and make [github] KAFKA-9487: Follow-up PR of Kafka-9445 (#8033) -- [...truncated

[jira] [Resolved] (KAFKA-9423) Refine layout of configuration options on website and make individual settings directly linkable

[ https://issues.apache.org/jira/browse/KAFKA-9423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mickael Maison resolved KAFKA-9423. --- Fix Version/s: 2.6.0 Resolution: Fixed > Refine layout of configuration options on

[jira] [Created] (KAFKA-9533) ValueTransform forwards `null` values

Michael Viamari created KAFKA-9533: -- Summary: ValueTransform forwards `null` values Key: KAFKA-9533 URL: https://issues.apache.org/jira/browse/KAFKA-9533 Project: Kafka Issue Type: Bug

Re: [DISCUSS] Apache Kafka 2.5.0 release

Just a friendly reminder that this Wednesday, February 12th, is the code freeze for the 2.5.0 release. After this time we will only accept blocker bugs onto the release branch. Thanks! David On Fri, Jan 31, 2020 at 5:13 PM David Arthur wrote: > Thanks! I've updated the list. > > On Thu, Jan

[jira] [Resolved] (KAFKA-8623) KafkaProducer possible deadlock when sending to different topics

[ https://issues.apache.org/jira/browse/KAFKA-8623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Byrne resolved KAFKA-8623. Fix Version/s: 2.3.0 Resolution: Fixed This appears to be due to an issue concerning the

Build failed in Jenkins: kafka-trunk-jdk11 #1143

See Changes: [github] KAFKA-8904: Improve producer's topic metadata fetching. (#7781) -- [...truncated 2.85 MB...]

Re: [DISCUSS] KIP-566: Add rebalance callbacks to ConsumerInterceptor

Bumping this again for visibility. If no one has any comments, maybe I'll just start the VOTE thread? On Wed, 2020-01-29 at 22:24 +, Thomas Becker wrote: [EXTERNAL EMAIL] Attention: This email was sent from outside TiVo. DO NOT CLICK any links or attachments unless you expected them.

[jira] [Created] (KAFKA-9532) Deleting the consumer group programatically using RESTFul API

Rakshith Mamidala created KAFKA-9532: - Summary: Deleting the consumer group programatically using RESTFul API Key: KAFKA-9532 URL: https://issues.apache.org/jira/browse/KAFKA-9532 Project: Kafka

[jira] [Created] (KAFKA-9531) java.net.UnknownHostException loop on VM rolling update using CNAME

Rui Abreu created KAFKA-9531: Summary: java.net.UnknownHostException loop on VM rolling update using CNAME Key: KAFKA-9531 URL: https://issues.apache.org/jira/browse/KAFKA-9531 Project: Kafka

Re: [DISCUSS] KIP-518: Allow listing consumer groups per state

Hi Michael, Thank you for the updated KIP. I have few comments/questions: 1. We already have the "--state" option in the command line tool which can be used with "--describe" and we will have "--states" which can be used with "--list". I feel this is going to be confusing for users. I wonder if

Re: [DISCUSS] KIP-552: Add interface to handle unused config

Hi John Starting an empty streams instance final String bootstrapServers = "broker0:9092"; Properties streamsConfiguration = new Properties(); streamsConfiguration.put(StreamsConfig.APPLICATION_ID_CONFIG, "configDemo"); streamsConfiguration.put(StreamsConfig.BOOTSTRAP_SERVERS_CONFIG,