Fwd: Recover partitions from a failed broker leader which is the only replica in isr.

2020-11-09 Thread JD Zheng
Hi, everyone, Not sure if this is the right place to ask this question. I sent it to the user mailing list and didn't get any response. Where should I ask such questions? We configure the producer write Ack=ALL and broker min.insync.replica = 2. The replication factor is 3. In this case, if the

Build failed in Jenkins: Kafka » kafka-trunk-jdk15 #242

2020-11-09 Thread Apache Jenkins Server
See Changes: [github] KAFKA-10661; Add new resigned state for graceful shutdown/initialization (#9531) -- [...truncated 6.92 MB...]

Build failed in Jenkins: Kafka » kafka-2.4-jdk8 #17

2020-11-09 Thread Apache Jenkins Server
See Changes: [Manikumar Reddy] MINOR: Update jetty to 9.4.33 -- [...truncated 5.86 MB...] org.apache.kafka.streams.test.OutputVerifierTest >

[jira] [Created] (KAFKA-10703) Document that default configs are not supported for TOPIC entities

2020-11-09 Thread Colin McCabe (Jira)
Colin McCabe created KAFKA-10703: Summary: Document that default configs are not supported for TOPIC entities Key: KAFKA-10703 URL: https://issues.apache.org/jira/browse/KAFKA-10703 Project: Kafka

Build failed in Jenkins: Kafka » kafka-trunk-jdk11 #218

2020-11-09 Thread Apache Jenkins Server
See Changes: [github] KAFKA-10661; Add new resigned state for graceful shutdown/initialization (#9531) -- [...truncated 3.46 MB...]

Jenkins build is back to normal : Kafka » kafka-trunk-jdk11 #217

2020-11-09 Thread Apache Jenkins Server
See

[jira] [Resolved] (KAFKA-10661) Add resigned state to raft state machine to preserve leader/epoch information

2020-11-09 Thread Jason Gustafson (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-10661. - Resolution: Fixed > Add resigned state to raft state machine to preserve leader/epoch

Jenkins build is back to normal : Kafka » kafka-2.7-jdk8 #56

2020-11-09 Thread Apache Jenkins Server
See

Build failed in Jenkins: Kafka » kafka-2.6-jdk8 #48

2020-11-09 Thread Apache Jenkins Server
See Changes: [Manikumar Reddy] MINOR: Update jetty to 9.4.33 -- [...truncated 3.16 MB...] org.apache.kafka.streams.TopologyTestDriverTest >

[jira] [Created] (KAFKA-10702) Slow replication of empty transactions

2020-11-09 Thread Jason Gustafson (Jira)
Jason Gustafson created KAFKA-10702: --- Summary: Slow replication of empty transactions Key: KAFKA-10702 URL: https://issues.apache.org/jira/browse/KAFKA-10702 Project: Kafka Issue Type: Bug

[GitHub] [kafka-site] mjsax merged pull request #308: [MINOR] fixing previous version banner for 2.5 docs

2020-11-09 Thread GitBox
mjsax merged pull request #308: URL: https://github.com/apache/kafka-site/pull/308 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

Support of virtual threads by Kafka

2020-11-09 Thread Leonid Mesnik
Hi Currently, I am working on Loom project which enables virtual threads for Java. https://wiki.openjdk.java.net/display/loom/Main As one of real-life tests it would be interesting to run Kafka using virtual threads. However it might require some support in Kafka for this. It is needed to

[GitHub] [kafka-site] scott-confluent opened a new pull request #308: fixing previous version banner for 2.5 docs

2020-11-09 Thread GitBox
scott-confluent opened a new pull request #308: URL: https://github.com/apache/kafka-site/pull/308 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [kafka-site] mjsax commented on pull request #307: [MINOR] fixing docs banner so it appears correctly on older versions

2020-11-09 Thread GitBox
mjsax commented on pull request #307: URL: https://github.com/apache/kafka-site/pull/307#issuecomment-724171811 We also don't have the banner in `2.5` atm -- can we do a parallel PR to get it back in `2.5` right away? This

Re: Kafka release dates for 2.5.2 and 2.6.1

2020-11-09 Thread Mickael Maison
Hi Rahul, You can see releases in progress in the Apache wiki: https://cwiki.apache.org/confluence/display/KAFKA/Future+release+plan 2.6.1 is in progress and should release in the next few weeks There are currently no plans to release 2.5.2. Thanks On Mon, Nov 9, 2020 at 4:00 PM Rahul Agarwal

Re: [DISCUSS] KIP-684 - Support mutual TLS authentication on SASL_SSL listeners

2020-11-09 Thread Rajini Sivaram
Hi Ron & Ismael, Thanks for reviewing the KIP! I have updated the KIP to include Ismael's suggestion on printing a warning for unprefixed `ssl.client.auth` so that we can make the configs consistent in a future major release. Regards, Rajini On Mon, Nov 9, 2020 at 3:58 PM Ismael Juma wrote:

Re: Preview blog post for the Apache 2.7.0 release

2020-11-09 Thread Bill Bejeck
Hi David, Thanks for taking a look at the draft, I've updated it per your comments. -Bill On Mon, Nov 9, 2020 at 4:47 AM David Jacot wrote: > Hi Bill, > > Thanks for the draft. One minor comment: > > For the KIP-612 part, I would rather say: `The 2.7.0 release contains the > first part of

[GitHub] [kafka-site] bbejeck edited a comment on pull request #307: [MINOR] fixing docs banner so it appears correctly on older versions

2020-11-09 Thread GitBox
bbejeck edited a comment on pull request #307: URL: https://github.com/apache/kafka-site/pull/307#issuecomment-72408 \cc @mimaison these changes need to go into 2.6.1 after 2.7 is released This is an automated message

Re: [DISCUSS] KIP-684 - Support mutual TLS authentication on SASL_SSL listeners

2020-11-09 Thread Ismael Juma
Thanks for the KIP Rajini. It's a good proposal. One suggestion for consideration: 1. We could print a warning if the unprefixed `ssl.client.auth` is used and there is a SASL_SSL listener. Then we could consider removing this inconsistency in Kafka 4.0 or something like that. What do you think?

[GitHub] [kafka-site] scott-confluent commented on pull request #307: [MINOR] fixing docs banner so it appears correctly on older versions

2020-11-09 Thread GitBox
scott-confluent commented on pull request #307: URL: https://github.com/apache/kafka-site/pull/307#issuecomment-724102500 ## NOTE: this should NOT be merged until 2.7 is officially released This is an automated message from

Kafka release dates for 2.5.2 and 2.6.1

2020-11-09 Thread Rahul Agarwal
Hi, Can anyone please share when are versions 2.5.2 and 2.6.1 expected to be released? Thanks, Rahul

[GitHub] [kafka-site] bbejeck commented on pull request #307: [MINOR] fixing docs banner so it appears correctly on older versions

2020-11-09 Thread GitBox
bbejeck commented on pull request #307: URL: https://github.com/apache/kafka-site/pull/307#issuecomment-72408 \cc @mimaison these changes need to go into 2.6.1 This is an automated message from the Apache Git Service.

[jira] [Created] (KAFKA-10701) First line of detailed stats from consumer-perf-test.sh incorrect

2020-11-09 Thread David Arthur (Jira)
David Arthur created KAFKA-10701: Summary: First line of detailed stats from consumer-perf-test.sh incorrect Key: KAFKA-10701 URL: https://issues.apache.org/jira/browse/KAFKA-10701 Project: Kafka

[GitHub] [kafka-site] scott-confluent opened a new pull request #307: [MINOR] fixing docs banner so it appears correctly on older versions

2020-11-09 Thread GitBox
scott-confluent opened a new pull request #307: URL: https://github.com/apache/kafka-site/pull/307 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

Re: [DISCUSS] KIP-684 - Support mutual TLS authentication on SASL_SSL listeners

2020-11-09 Thread Ron Dagostino
Hi Rajini. Thanks for the clearly-written KIP. The addition of mTLS for SASL connections makes a lot of sense. It was especially helpful that you documented the history of why we hadn’t supported this in the past and the issue related to backwards compatibility for misconfigured brokers — it

[DISCUSS] KIP-684 - Support mutual TLS authentication on SASL_SSL listeners

2020-11-09 Thread Rajini Sivaram
Hi all, I have submitted KIP-684 to support mTLS (TLS client authentication) for SASL_SSL listeners: - https://cwiki.apache.org/confluence/display/KAFKA/KIP-684+-+Support+mutual+TLS+authentication+on+SASL_SSL+listeners In security-critical deployments, TLS client authentication adds an

[jira] [Created] (KAFKA-10700) Support mutual TLS authentication for SASL_SSL listeners

2020-11-09 Thread Rajini Sivaram (Jira)
Rajini Sivaram created KAFKA-10700: -- Summary: Support mutual TLS authentication for SASL_SSL listeners Key: KAFKA-10700 URL: https://issues.apache.org/jira/browse/KAFKA-10700 Project: Kafka

Re: Preview blog post for the Apache 2.7.0 release

2020-11-09 Thread David Jacot
Hi Bill, Thanks for the draft. One minor comment: For the KIP-612 part, I would rather say: `The 2.7.0 release contains the first part of KIP-612, with per-IP connections rate limits expected to come in the 2.8.0 release.`. Best, David On Fri, Nov 6, 2020 at 11:51 PM Bill Bejeck wrote: >

Avoid Decompression in Mirror Maker

2020-11-09 Thread usha rani
Hi Team, Recently we have implemented compression at producer level in Kafka, which is decompressed while the consumer consumes it. Coming to Mirroring the data we end up decompressing it and compressing the same data. Is there a way we can stop this process and just mirror the producer